Aug 09 18:17:37 user nova-compute[72418]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 09 18:17:40 user nova-compute[72418]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=72418) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 09 18:17:40 user nova-compute[72418]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=72418) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 09 18:17:40 user nova-compute[72418]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=72418) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 09 18:17:40 user nova-compute[72418]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 09 18:17:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:17:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.022s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:17:41 user nova-compute[72418]: INFO nova.virt.driver [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 09 18:17:41 user nova-compute[72418]: INFO nova.compute.provider_config [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] Acquiring lock "singleton_lock" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] Acquired lock "singleton_lock" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] Releasing lock "singleton_lock" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] Full set of CONF: {{(pid=72418) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] ******************************************************************************** {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] Configuration options gathered from: {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] ================================================================================ {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] allow_resize_to_same_host      = True {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] arq_binding_timeout            = 300 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] backdoor_port                  = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] backdoor_socket                = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] block_device_allocate_retries  = 300 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] block_device_allocate_retries_interval = 5 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cert                           = self.pem {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] compute_monitors               = [] {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] config_dir                     = [] {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] config_drive_format            = iso9660 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] config_source                  = [] {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] console_host                   = user {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] control_exchange               = nova {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cpu_allocation_ratio           = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] daemon                         = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] debug                          = True {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] default_access_ip_network_name = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] default_availability_zone      = nova {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] default_ephemeral_format       = ext4 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] default_schedule_zone          = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] disk_allocation_ratio          = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] enable_new_services            = True {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] enabled_apis                   = ['osapi_compute'] {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] enabled_ssl_apis               = [] {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] flat_injected                  = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] force_config_drive             = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] force_raw_images               = True {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] graceful_shutdown_timeout      = 5 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] heal_instance_info_cache_interval = 60 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] host                           = user {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] instance_build_timeout         = 0 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] instance_delete_interval       = 300 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] instance_format                = [instance: %(uuid)s]  {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] instance_name_template         = instance-%08x {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] instance_usage_audit           = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] instance_usage_audit_period    = month {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] internal_service_availability_zone = internal {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] key                            = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] live_migration_retry_count     = 30 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] log_config_append              = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] log_dir                        = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] log_file                       = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] log_options                    = True {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] log_rotate_interval            = 1 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] log_rotate_interval_type       = days {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] log_rotation_type              = none {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] long_rpc_timeout               = 1800 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] max_concurrent_builds          = 10 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] max_concurrent_live_migrations = 1 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] max_concurrent_snapshots       = 5 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] max_local_block_devices        = 3 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] max_logfile_count              = 30 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] max_logfile_size_mb            = 200 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] maximum_instance_delete_attempts = 5 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] metadata_listen                = 0.0.0.0 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] metadata_listen_port           = 8775 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] metadata_workers               = 3 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] migrate_max_retries            = -1 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] mkisofs_cmd                    = genisoimage {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] my_ip                          = 10.0.0.210 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] network_allocate_retries       = 0 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] osapi_compute_listen_port      = 8774 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] osapi_compute_unique_server_name_scope =  {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] osapi_compute_workers          = 3 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] password_length                = 12 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] periodic_enable                = True {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] periodic_fuzzy_delay           = 60 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] pointer_model                  = ps2mouse {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] preallocate_images             = none {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] publish_errors                 = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] pybasedir                      = /opt/stack/nova {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] ram_allocation_ratio           = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] rate_limit_burst               = 0 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] rate_limit_except_level        = CRITICAL {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] rate_limit_interval            = 0 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] reboot_timeout                 = 0 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] reclaim_instance_interval      = 0 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] record                         = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] reimage_timeout_per_gb         = 60 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] report_interval                = 120 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] rescue_timeout                 = 0 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] reserved_host_cpus             = 0 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] reserved_host_disk_mb          = 0 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] reserved_host_memory_mb        = 512 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] reserved_huge_pages            = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] resize_confirm_window          = 0 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] resize_fs_using_block_device   = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] resume_guests_state_on_host_boot = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] rpc_response_timeout           = 60 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] run_external_periodic_tasks    = True {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] running_deleted_instance_action = reap {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] running_deleted_instance_poll_interval = 1800 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] running_deleted_instance_timeout = 0 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] scheduler_instance_sync_interval = 120 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] service_down_time              = 720 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] servicegroup_driver            = db {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] shelved_offload_time           = 0 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] shelved_poll_interval          = 3600 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] shutdown_timeout               = 0 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] source_is_ipv6                 = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] ssl_only                       = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] state_path                     = /opt/stack/data/nova {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] sync_power_state_interval      = 600 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] sync_power_state_pool_size     = 1000 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] syslog_log_facility            = LOG_USER {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] tempdir                        = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] timeout_nbd                    = 10 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] transport_url                  = **** {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] update_resources_interval      = 0 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] use_cow_images                 = True {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] use_eventlog                   = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] use_journal                    = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] use_json                       = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] use_rootwrap_daemon            = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] use_stderr                     = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] use_syslog                     = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vcpu_pin_set                   = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vif_plugging_is_fatal          = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vif_plugging_timeout           = 0 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] virt_mkfs                      = [] {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] volume_usage_poll_interval     = 0 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] watch_log_file                 = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] web                            = /usr/share/spice-html5 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_concurrency.disable_process_locking = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] api.auth_strategy              = keystone {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] api.compute_link_prefix        = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] api.dhcp_domain                = novalocal {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] api.enable_instance_password   = True {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] api.glance_link_prefix         = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] api.instance_list_per_project_cells = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] api.list_records_by_skipping_down_cells = True {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] api.local_metadata_per_cell    = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] api.max_limit                  = 1000 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] api.metadata_cache_expiration  = 15 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] api.neutron_default_tenant_id  = default {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] api.use_forwarded_for          = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] api.use_neutron_default_nets   = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] api.vendordata_dynamic_targets = [] {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] api.vendordata_jsonfile_path   = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cache.backend                  = dogpile.cache.memcached {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cache.backend_argument         = **** {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cache.config_prefix            = cache.oslo {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cache.dead_timeout             = 60.0 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cache.debug_cache_backend      = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cache.enable_retry_client      = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cache.enable_socket_keepalive  = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cache.enabled                  = True {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cache.expiration_time          = 600 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cache.hashclient_retry_attempts = 2 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cache.memcache_dead_retry      = 300 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cache.memcache_password        =  {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cache.memcache_pool_maxsize    = 10 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cache.memcache_sasl_enabled    = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cache.memcache_username        =  {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cache.proxies                  = [] {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cache.retry_attempts           = 2 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cache.retry_delay              = 0.0 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cache.socket_keepalive_count   = 1 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cache.socket_keepalive_idle    = 1 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cache.socket_keepalive_interval = 1 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cache.tls_allowed_ciphers      = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cache.tls_cafile               = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cache.tls_certfile             = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cache.tls_enabled              = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cache.tls_keyfile              = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cinder.auth_section            = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cinder.auth_type               = password {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cinder.cafile                  = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cinder.certfile                = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cinder.collect_timing          = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cinder.cross_az_attach         = True {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cinder.debug                   = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cinder.endpoint_template       = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cinder.http_retries            = 3 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cinder.insecure                = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cinder.keyfile                 = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cinder.os_region_name          = RegionOne {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cinder.split_loggers           = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cinder.timeout                 = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] compute.cpu_dedicated_set      = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] compute.cpu_shared_set         = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] compute.image_type_exclude_list = [] {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] compute.max_concurrent_disk_ops = 0 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] compute.max_disk_devices_to_attach = -1 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] compute.resource_provider_association_refresh = 300 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] compute.shutdown_retry_interval = 10 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] conductor.workers              = 3 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] console.allowed_origins        = [] {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] console.ssl_ciphers            = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] console.ssl_minimum_version    = default {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] consoleauth.token_ttl          = 600 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cyborg.cafile                  = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cyborg.certfile                = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cyborg.collect_timing          = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cyborg.connect_retries         = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cyborg.connect_retry_delay     = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cyborg.endpoint_override       = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cyborg.insecure                = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cyborg.keyfile                 = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cyborg.max_version             = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cyborg.min_version             = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cyborg.region_name             = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cyborg.service_name            = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cyborg.service_type            = accelerator {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cyborg.split_loggers           = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cyborg.status_code_retries     = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cyborg.status_code_retry_delay = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cyborg.timeout                 = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] cyborg.version                 = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] database.backend               = sqlalchemy {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] database.connection            = **** {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] database.connection_debug      = 0 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] database.connection_parameters =  {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] database.connection_recycle_time = 3600 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] database.connection_trace      = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] database.db_inc_retry_interval = True {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] database.db_max_retries        = 20 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] database.db_max_retry_interval = 10 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] database.db_retry_interval     = 1 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] database.max_overflow          = 50 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] database.max_pool_size         = 5 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] database.max_retries           = 10 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] database.mysql_enable_ndb      = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] database.mysql_wsrep_sync_wait = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] database.pool_timeout          = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] database.retry_interval        = 10 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] database.slave_connection      = **** {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] database.sqlite_synchronous    = True {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] api_database.backend           = sqlalchemy {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] api_database.connection        = **** {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] api_database.connection_debug  = 0 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] api_database.connection_parameters =  {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] api_database.connection_recycle_time = 3600 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] api_database.connection_trace  = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] api_database.db_inc_retry_interval = True {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] api_database.db_max_retries    = 20 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] api_database.db_max_retry_interval = 10 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] api_database.db_retry_interval = 1 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] api_database.max_overflow      = 50 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] api_database.max_pool_size     = 5 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] api_database.max_retries       = 10 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] api_database.mysql_enable_ndb  = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] api_database.pool_timeout      = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] api_database.retry_interval    = 10 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] api_database.slave_connection  = **** {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] api_database.sqlite_synchronous = True {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] devices.enabled_mdev_types     = [] {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] ephemeral_storage_encryption.enabled = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] glance.api_servers             = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] glance.cafile                  = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] glance.certfile                = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] glance.collect_timing          = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] glance.connect_retries         = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] glance.connect_retry_delay     = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] glance.debug                   = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] glance.default_trusted_certificate_ids = [] {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] glance.enable_certificate_validation = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] glance.enable_rbd_download     = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] glance.endpoint_override       = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] glance.insecure                = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] glance.keyfile                 = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] glance.max_version             = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] glance.min_version             = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] glance.num_retries             = 3 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] glance.rbd_ceph_conf           =  {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] glance.rbd_connect_timeout     = 5 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] glance.rbd_pool                =  {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] glance.rbd_user                =  {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] glance.region_name             = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] glance.service_name            = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] glance.service_type            = image {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] glance.split_loggers           = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] glance.status_code_retries     = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] glance.status_code_retry_delay = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] glance.timeout                 = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] glance.verify_glance_signatures = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] glance.version                 = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] guestfs.debug                  = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] hyperv.config_drive_cdrom      = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] hyperv.config_drive_inject_password = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] hyperv.enable_instance_metrics_collection = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] hyperv.enable_remotefx         = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] hyperv.instances_path_share    =  {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] hyperv.iscsi_initiator_list    = [] {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] hyperv.limit_cpu_features      = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] hyperv.power_state_check_timeframe = 60 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] hyperv.use_multipath_io        = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] hyperv.volume_attach_retry_count = 10 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] hyperv.vswitch_name            = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] mks.enabled                    = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] image_cache.manager_interval   = 2400 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] image_cache.precache_concurrency = 1 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] image_cache.remove_unused_base_images = True {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] image_cache.subdirectory_name  = _base {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] ironic.api_max_retries         = 60 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] ironic.api_retry_interval      = 2 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] ironic.auth_section            = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] ironic.auth_type               = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] ironic.cafile                  = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] ironic.certfile                = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] ironic.collect_timing          = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] ironic.connect_retries         = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] ironic.connect_retry_delay     = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] ironic.endpoint_override       = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] ironic.insecure                = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] ironic.keyfile                 = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] ironic.max_version             = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] ironic.min_version             = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] ironic.partition_key           = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] ironic.peer_list               = [] {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] ironic.region_name             = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] ironic.serial_console_state_timeout = 10 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] ironic.service_name            = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] ironic.service_type            = baremetal {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] ironic.split_loggers           = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] ironic.status_code_retries     = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] ironic.status_code_retry_delay = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] ironic.timeout                 = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] ironic.version                 = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] key_manager.fixed_key          = **** {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] barbican.barbican_api_version  = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] barbican.barbican_endpoint     = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] barbican.barbican_endpoint_type = public {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] barbican.barbican_region_name  = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] barbican.cafile                = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] barbican.certfile              = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] barbican.collect_timing        = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] barbican.insecure              = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] barbican.keyfile               = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] barbican.number_of_retries     = 60 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] barbican.retry_delay           = 1 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] barbican.send_service_user_token = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] barbican.split_loggers         = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] barbican.timeout               = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] barbican.verify_ssl            = True {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] barbican.verify_ssl_path       = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] barbican_service_user.auth_section = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] barbican_service_user.auth_type = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] barbican_service_user.cafile   = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] barbican_service_user.certfile = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] barbican_service_user.collect_timing = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] barbican_service_user.insecure = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] barbican_service_user.keyfile  = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] barbican_service_user.split_loggers = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] barbican_service_user.timeout  = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vault.approle_role_id          = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vault.approle_secret_id        = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vault.cafile                   = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vault.certfile                 = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vault.collect_timing           = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vault.insecure                 = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vault.keyfile                  = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vault.kv_mountpoint            = secret {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vault.kv_version               = 2 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vault.namespace                = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vault.root_token_id            = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vault.split_loggers            = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vault.ssl_ca_crt_file          = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vault.timeout                  = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vault.use_ssl                  = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] keystone.cafile                = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] keystone.certfile              = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] keystone.collect_timing        = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] keystone.connect_retries       = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] keystone.connect_retry_delay   = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] keystone.endpoint_override     = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] keystone.insecure              = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] keystone.keyfile               = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] keystone.max_version           = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] keystone.min_version           = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] keystone.region_name           = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] keystone.service_name          = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] keystone.service_type          = identity {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] keystone.split_loggers         = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] keystone.status_code_retries   = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] keystone.status_code_retry_delay = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] keystone.timeout               = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] keystone.version               = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.connection_uri         =  {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.cpu_mode               = custom {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: WARNING oslo_config.cfg [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.cpu_power_governor_high = performance {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.cpu_power_governor_low = powersave {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.cpu_power_management   = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.device_detach_attempts = 8 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.device_detach_timeout  = 20 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.disk_cachemodes        = [] {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.disk_prefix            = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.enabled_perf_events    = [] {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.file_backed_memory     = 0 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.gid_maps               = [] {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.hw_disk_discard        = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.hw_machine_type        = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.images_rbd_glance_store_name =  {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.images_rbd_pool        = rbd {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.images_type            = default {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.images_volume_group    = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.inject_key             = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.inject_partition       = -2 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.inject_password        = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.iscsi_iface            = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.iser_use_multipath     = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.live_migration_bandwidth = 0 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.live_migration_downtime = 500 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.live_migration_inbound_addr = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.live_migration_permit_post_copy = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.live_migration_scheme  = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.live_migration_timeout_action = abort {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.live_migration_tunnelled = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: WARNING oslo_config.cfg [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 09 18:17:41 user nova-compute[72418]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 09 18:17:41 user nova-compute[72418]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 09 18:17:41 user nova-compute[72418]: and ``live_migration_inbound_addr`` respectively.
Aug 09 18:17:41 user nova-compute[72418]: ).  Its value may be silently ignored in the future.
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.live_migration_with_native_tls = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.max_queues             = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.nfs_mount_options      = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.num_memory_encrypted_guests = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.num_pcie_ports         = 0 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.pmem_namespaces        = [] {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.quobyte_client_cfg     = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.rbd_secret_uuid        = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.rbd_user               = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.remote_filesystem_transport = ssh {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.rescue_image_id        = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.rescue_kernel_id       = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.rescue_ramdisk_id      = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.rx_queue_size          = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.smbfs_mount_options    =  {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.snapshot_compression   = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.snapshot_image_format  = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.sparse_logical_volumes = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.swtpm_enabled          = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.swtpm_group            = tss {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.swtpm_user             = tss {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.sysinfo_serial         = unique {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.tb_cache_size          = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.tx_queue_size          = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.uid_maps               = [] {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.use_virtio_for_bridges = True {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.virt_type              = kvm {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.volume_clear           = zero {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.volume_clear_size      = 0 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.volume_use_multipath   = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.vzstorage_cache_path   = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.vzstorage_mount_user   = stack {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] neutron.auth_section           = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] neutron.auth_type              = password {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] neutron.cafile                 = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] neutron.certfile               = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] neutron.collect_timing         = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] neutron.connect_retries        = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] neutron.connect_retry_delay    = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] neutron.default_floating_pool  = public {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] neutron.endpoint_override      = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] neutron.extension_sync_interval = 600 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] neutron.http_retries           = 3 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] neutron.insecure               = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] neutron.keyfile                = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] neutron.max_version            = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] neutron.min_version            = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] neutron.ovs_bridge             = br-int {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] neutron.physnets               = [] {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] neutron.region_name            = RegionOne {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] neutron.service_metadata_proxy = True {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] neutron.service_name           = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] neutron.service_type           = network {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] neutron.split_loggers          = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] neutron.status_code_retries    = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] neutron.status_code_retry_delay = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] neutron.timeout                = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] neutron.version                = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] notifications.bdms_in_notifications = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] notifications.default_level    = INFO {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] notifications.notification_format = unversioned {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] notifications.notify_on_state_change = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] pci.alias                      = [] {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] pci.device_spec                = [] {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] pci.report_in_placement        = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] placement.auth_section         = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] placement.auth_type            = password {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] placement.cafile               = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] placement.certfile             = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] placement.collect_timing       = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] placement.connect_retries      = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] placement.connect_retry_delay  = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] placement.default_domain_id    = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] placement.default_domain_name  = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] placement.domain_id            = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] placement.domain_name          = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] placement.endpoint_override    = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] placement.insecure             = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] placement.keyfile              = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] placement.max_version          = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] placement.min_version          = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] placement.password             = **** {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] placement.project_domain_id    = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] placement.project_domain_name  = Default {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] placement.project_id           = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] placement.project_name         = service {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] placement.region_name          = RegionOne {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] placement.service_name         = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] placement.service_type         = placement {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] placement.split_loggers        = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] placement.status_code_retries  = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] placement.status_code_retry_delay = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] placement.system_scope         = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] placement.timeout              = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] placement.trust_id             = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] placement.user_domain_id       = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] placement.user_domain_name     = Default {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] placement.user_id              = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] placement.username             = placement {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] placement.version              = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] quota.cores                    = 20 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] quota.count_usage_from_placement = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] quota.injected_file_content_bytes = 10240 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] quota.injected_file_path_length = 255 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] quota.injected_files           = 5 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] quota.instances                = 10 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] quota.key_pairs                = 100 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] quota.metadata_items           = 128 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] quota.ram                      = 51200 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] quota.recheck_quota            = True {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] quota.server_group_members     = 10 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] quota.server_groups            = 10 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] rdp.enabled                    = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] scheduler.image_metadata_prefilter = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] scheduler.max_attempts         = 3 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] scheduler.max_placement_results = 1000 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] scheduler.query_placement_for_availability_zone = True {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] scheduler.query_placement_for_image_type_support = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] scheduler.workers              = 3 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] filter_scheduler.host_subset_size = 1 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] filter_scheduler.isolated_hosts = [] {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] filter_scheduler.isolated_images = [] {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] filter_scheduler.pci_in_placement = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] filter_scheduler.track_instance_changes = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] metrics.required               = True {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] metrics.weight_multiplier      = 1.0 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] metrics.weight_setting         = [] {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] serial_console.enabled         = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] serial_console.port_range      = 10000:20000 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] serial_console.serialproxy_port = 6083 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] service_user.auth_section      = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] service_user.auth_type         = password {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] service_user.cafile            = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] service_user.certfile          = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] service_user.collect_timing    = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] service_user.insecure          = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] service_user.keyfile           = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] service_user.send_service_user_token = True {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] service_user.split_loggers     = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] service_user.timeout           = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] spice.agent_enabled            = True {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] spice.enabled                  = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] spice.html5proxy_port          = 6082 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] spice.image_compression        = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] spice.jpeg_compression         = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] spice.playback_compression     = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] spice.server_listen            = 127.0.0.1 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] spice.streaming_mode           = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] spice.zlib_compression         = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] upgrade_levels.baseapi         = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] upgrade_levels.cert            = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] upgrade_levels.compute         = auto {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] upgrade_levels.conductor       = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] upgrade_levels.scheduler       = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vendordata_dynamic_auth.auth_section = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vendordata_dynamic_auth.auth_type = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vendordata_dynamic_auth.cafile = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vendordata_dynamic_auth.certfile = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vendordata_dynamic_auth.insecure = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vendordata_dynamic_auth.keyfile = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vendordata_dynamic_auth.timeout = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vmware.api_retry_count         = 10 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vmware.ca_file                 = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vmware.cache_prefix            = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vmware.cluster_name            = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vmware.connection_pool_size    = 10 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vmware.console_delay_seconds   = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vmware.datastore_regex         = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vmware.host_ip                 = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vmware.host_password           = **** {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vmware.host_port               = 443 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vmware.host_username           = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vmware.insecure                = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vmware.integration_bridge      = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vmware.maximum_objects         = 100 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vmware.pbm_default_policy      = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vmware.pbm_enabled             = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vmware.pbm_wsdl_location       = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vmware.serial_port_proxy_uri   = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vmware.serial_port_service_uri = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vmware.task_poll_interval      = 0.5 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vmware.use_linked_clone        = True {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vmware.vnc_keymap              = en-us {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vmware.vnc_port                = 5900 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vmware.vnc_port_total          = 10000 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vnc.auth_schemes               = ['none'] {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vnc.enabled                    = True {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vnc.novncproxy_port            = 6080 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vnc.server_listen              = 0.0.0.0 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vnc.vencrypt_ca_certs          = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vnc.vencrypt_client_cert       = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vnc.vencrypt_client_key        = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] workarounds.disable_rootwrap   = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] workarounds.enable_numa_live_migration = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] workarounds.libvirt_disable_apic = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] wsgi.client_socket_timeout     = 900 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] wsgi.default_pool_size         = 1000 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] wsgi.keep_alive                = True {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] wsgi.max_header_line           = 16384 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] wsgi.ssl_ca_file               = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] wsgi.ssl_cert_file             = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] wsgi.ssl_key_file              = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] wsgi.tcp_keepidle              = 600 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] zvm.ca_file                    = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] zvm.cloud_connector_url        = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] zvm.reachable_timeout          = 300 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_policy.enforce_new_defaults = True {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_policy.enforce_scope      = True {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_policy.policy_default_rule = default {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_policy.policy_file        = policy.yaml {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] profiler.connection_string     = messaging:// {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] profiler.enabled               = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] profiler.es_doc_type           = notification {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] profiler.es_scroll_size        = 10000 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] profiler.es_scroll_time        = 2m {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] profiler.filter_error_trace    = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] profiler.hmac_keys             = **** {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] profiler.sentinel_service_name = mymaster {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] profiler.socket_timeout        = 0.1 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] profiler.trace_requests        = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] profiler.trace_sqlalchemy      = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] profiler_jaeger.process_tags   = {} {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] profiler_jaeger.service_name_prefix = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] profiler_otlp.service_name_prefix = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] remote_debug.host              = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] remote_debug.port              = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_messaging_rabbit.ssl      = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_messaging_notifications.retry = -1 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_limit.auth_section        = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_limit.auth_type           = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_limit.cafile              = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_limit.certfile            = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_limit.collect_timing      = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_limit.connect_retries     = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_limit.connect_retry_delay = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_limit.endpoint_id         = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_limit.endpoint_override   = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_limit.insecure            = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_limit.keyfile             = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_limit.max_version         = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_limit.min_version         = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_limit.region_name         = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_limit.service_name        = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_limit.service_type        = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_limit.split_loggers       = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_limit.status_code_retries = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_limit.status_code_retry_delay = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_limit.timeout             = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_limit.valid_interfaces    = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_limit.version             = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_reports.file_event_handler = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] oslo_reports.log_dir           = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vif_plug_ovs_privileged.group  = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] vif_plug_ovs_privileged.user   = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] os_vif_linux_bridge.flat_interface = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] os_vif_ovs.isolate_vif         = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] os_vif_ovs.per_port_bridge     = False {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] os_brick.lock_path             = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] privsep_osbrick.capabilities   = [21] {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] privsep_osbrick.group          = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] privsep_osbrick.helper_command = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] privsep_osbrick.user           = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] nova_sys_admin.group           = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] nova_sys_admin.helper_command  = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] nova_sys_admin.user            = None {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG oslo_service.service [None req-82d35690-4484-48a6-88a7-ba7eea4489f4 None None] ******************************************************************************** {{(pid=72418) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Aug 09 18:17:41 user nova-compute[72418]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 09 18:17:41 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Starting native event thread {{(pid=72418) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Starting green dispatch thread {{(pid=72418) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Starting connection event dispatch thread {{(pid=72418) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Connecting to libvirt: qemu:///system {{(pid=72418) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f4308bfcb20> {{(pid=72418) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 09 18:17:41 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f4308bfcb20> {{(pid=72418) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 09 18:17:41 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Connection event '1' reason 'None'
Aug 09 18:17:41 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 09 18:17:41 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.mount [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Initialising _HostMountState generation 0 {{(pid=72418) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 09 18:17:48 user nova-compute[72418]: INFO nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Libvirt host capabilities <capabilities>
Aug 09 18:17:48 user nova-compute[72418]:   <host>
Aug 09 18:17:48 user nova-compute[72418]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 09 18:17:48 user nova-compute[72418]:     <cpu>
Aug 09 18:17:48 user nova-compute[72418]:       <arch>x86_64</arch>
Aug 09 18:17:48 user nova-compute[72418]:       <model>IvyBridge-IBRS</model>
Aug 09 18:17:48 user nova-compute[72418]:       <vendor>Intel</vendor>
Aug 09 18:17:48 user nova-compute[72418]:       <microcode version='1070'/>
Aug 09 18:17:48 user nova-compute[72418]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 09 18:17:48 user nova-compute[72418]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 09 18:17:48 user nova-compute[72418]:       <feature name='ss'/>
Aug 09 18:17:48 user nova-compute[72418]:       <feature name='vmx'/>
Aug 09 18:17:48 user nova-compute[72418]:       <feature name='pcid'/>
Aug 09 18:17:48 user nova-compute[72418]:       <feature name='osxsave'/>
Aug 09 18:17:48 user nova-compute[72418]:       <feature name='hypervisor'/>
Aug 09 18:17:48 user nova-compute[72418]:       <feature name='arat'/>
Aug 09 18:17:48 user nova-compute[72418]:       <feature name='tsc_adjust'/>
Aug 09 18:17:48 user nova-compute[72418]:       <feature name='md-clear'/>
Aug 09 18:17:48 user nova-compute[72418]:       <feature name='stibp'/>
Aug 09 18:17:48 user nova-compute[72418]:       <feature name='arch-capabilities'/>
Aug 09 18:17:48 user nova-compute[72418]:       <feature name='ssbd'/>
Aug 09 18:17:48 user nova-compute[72418]:       <feature name='invtsc'/>
Aug 09 18:17:48 user nova-compute[72418]:       <feature name='rsba'/>
Aug 09 18:17:48 user nova-compute[72418]:       <feature name='skip-l1dfl-vmentry'/>
Aug 09 18:17:48 user nova-compute[72418]:       <pages unit='KiB' size='4'/>
Aug 09 18:17:48 user nova-compute[72418]:       <pages unit='KiB' size='2048'/>
Aug 09 18:17:48 user nova-compute[72418]:     </cpu>
Aug 09 18:17:48 user nova-compute[72418]:     <power_management>
Aug 09 18:17:48 user nova-compute[72418]:       <suspend_mem/>
Aug 09 18:17:48 user nova-compute[72418]:       <suspend_disk/>
Aug 09 18:17:48 user nova-compute[72418]:       <suspend_hybrid/>
Aug 09 18:17:48 user nova-compute[72418]:     </power_management>
Aug 09 18:17:48 user nova-compute[72418]:     <iommu support='no'/>
Aug 09 18:17:48 user nova-compute[72418]:     <migration_features>
Aug 09 18:17:48 user nova-compute[72418]:       <live/>
Aug 09 18:17:48 user nova-compute[72418]:       <uri_transports>
Aug 09 18:17:48 user nova-compute[72418]:         <uri_transport>tcp</uri_transport>
Aug 09 18:17:48 user nova-compute[72418]:         <uri_transport>rdma</uri_transport>
Aug 09 18:17:48 user nova-compute[72418]:       </uri_transports>
Aug 09 18:17:48 user nova-compute[72418]:     </migration_features>
Aug 09 18:17:48 user nova-compute[72418]:     <topology>
Aug 09 18:17:48 user nova-compute[72418]:       <cells num='2'>
Aug 09 18:17:48 user nova-compute[72418]:         <cell id='0'>
Aug 09 18:17:48 user nova-compute[72418]:           <memory unit='KiB'>8140616</memory>
Aug 09 18:17:48 user nova-compute[72418]:           <pages unit='KiB' size='4'>2035154</pages>
Aug 09 18:17:48 user nova-compute[72418]:           <pages unit='KiB' size='2048'>0</pages>
Aug 09 18:17:48 user nova-compute[72418]:           <distances>
Aug 09 18:17:48 user nova-compute[72418]:             <sibling id='0' value='10'/>
Aug 09 18:17:48 user nova-compute[72418]:             <sibling id='1' value='20'/>
Aug 09 18:17:48 user nova-compute[72418]:           </distances>
Aug 09 18:17:48 user nova-compute[72418]:           <cpus num='6'>
Aug 09 18:17:48 user nova-compute[72418]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 09 18:17:48 user nova-compute[72418]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 09 18:17:48 user nova-compute[72418]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 09 18:17:48 user nova-compute[72418]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 09 18:17:48 user nova-compute[72418]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 09 18:17:48 user nova-compute[72418]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 09 18:17:48 user nova-compute[72418]:           </cpus>
Aug 09 18:17:48 user nova-compute[72418]:         </cell>
Aug 09 18:17:48 user nova-compute[72418]:         <cell id='1'>
Aug 09 18:17:48 user nova-compute[72418]:           <memory unit='KiB'>8255068</memory>
Aug 09 18:17:48 user nova-compute[72418]:           <pages unit='KiB' size='4'>2063767</pages>
Aug 09 18:17:48 user nova-compute[72418]:           <pages unit='KiB' size='2048'>0</pages>
Aug 09 18:17:48 user nova-compute[72418]:           <distances>
Aug 09 18:17:48 user nova-compute[72418]:             <sibling id='0' value='20'/>
Aug 09 18:17:48 user nova-compute[72418]:             <sibling id='1' value='10'/>
Aug 09 18:17:48 user nova-compute[72418]:           </distances>
Aug 09 18:17:48 user nova-compute[72418]:           <cpus num='6'>
Aug 09 18:17:48 user nova-compute[72418]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 09 18:17:48 user nova-compute[72418]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 09 18:17:48 user nova-compute[72418]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 09 18:17:48 user nova-compute[72418]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 09 18:17:48 user nova-compute[72418]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 09 18:17:48 user nova-compute[72418]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 09 18:17:48 user nova-compute[72418]:           </cpus>
Aug 09 18:17:48 user nova-compute[72418]:         </cell>
Aug 09 18:17:48 user nova-compute[72418]:       </cells>
Aug 09 18:17:48 user nova-compute[72418]:     </topology>
Aug 09 18:17:48 user nova-compute[72418]:     <cache>
Aug 09 18:17:48 user nova-compute[72418]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 09 18:17:48 user nova-compute[72418]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 09 18:17:48 user nova-compute[72418]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 09 18:17:48 user nova-compute[72418]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 09 18:17:48 user nova-compute[72418]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 09 18:17:48 user nova-compute[72418]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 09 18:17:48 user nova-compute[72418]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 09 18:17:48 user nova-compute[72418]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 09 18:17:48 user nova-compute[72418]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 09 18:17:48 user nova-compute[72418]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 09 18:17:48 user nova-compute[72418]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 09 18:17:48 user nova-compute[72418]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 09 18:17:48 user nova-compute[72418]:     </cache>
Aug 09 18:17:48 user nova-compute[72418]:     <secmodel>
Aug 09 18:17:48 user nova-compute[72418]:       <model>apparmor</model>
Aug 09 18:17:48 user nova-compute[72418]:       <doi>0</doi>
Aug 09 18:17:48 user nova-compute[72418]:     </secmodel>
Aug 09 18:17:48 user nova-compute[72418]:     <secmodel>
Aug 09 18:17:48 user nova-compute[72418]:       <model>dac</model>
Aug 09 18:17:48 user nova-compute[72418]:       <doi>0</doi>
Aug 09 18:17:48 user nova-compute[72418]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 09 18:17:48 user nova-compute[72418]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 09 18:17:48 user nova-compute[72418]:     </secmodel>
Aug 09 18:17:48 user nova-compute[72418]:   </host>
Aug 09 18:17:48 user nova-compute[72418]:   <guest>
Aug 09 18:17:48 user nova-compute[72418]:     <os_type>hvm</os_type>
Aug 09 18:17:48 user nova-compute[72418]:     <arch name='alpha'>
Aug 09 18:17:48 user nova-compute[72418]:       <wordsize>64</wordsize>
Aug 09 18:17:48 user nova-compute[72418]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='4'>clipper</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <domain type='qemu'/>
Aug 09 18:17:48 user nova-compute[72418]:     </arch>
Aug 09 18:17:48 user nova-compute[72418]:     <features>
Aug 09 18:17:48 user nova-compute[72418]:       <cpuselection/>
Aug 09 18:17:48 user nova-compute[72418]:       <deviceboot/>
Aug 09 18:17:48 user nova-compute[72418]:       <disksnapshot default='on' toggle='no'/>
Aug 09 18:17:48 user nova-compute[72418]:     </features>
Aug 09 18:17:48 user nova-compute[72418]:   </guest>
Aug 09 18:17:48 user nova-compute[72418]:   <guest>
Aug 09 18:17:48 user nova-compute[72418]:     <os_type>hvm</os_type>
Aug 09 18:17:48 user nova-compute[72418]:     <arch name='armv6l'>
Aug 09 18:17:48 user nova-compute[72418]:       <wordsize>32</wordsize>
Aug 09 18:17:48 user nova-compute[72418]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>integratorcp</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>borzoi</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>spitz</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2'>nuri</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2'>musca-b1</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>versatileab</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>kzm</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2'>musca-a</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2'>smdkc210</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>sx1</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>z2</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>tosa</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='4'>sabrelite</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>realview-eb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>n810</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>n800</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>versatilepb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>terrier</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>mainstone</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='4'>midway</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>musicpal</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>microbit</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>cubieboard</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>verdex</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>netduino2</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='4'>raspi2b</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>cheetah</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='4'>highbank</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>akita</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>connex</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>collie</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>raspi0</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <domain type='qemu'/>
Aug 09 18:17:48 user nova-compute[72418]:     </arch>
Aug 09 18:17:48 user nova-compute[72418]:     <features>
Aug 09 18:17:48 user nova-compute[72418]:       <cpuselection/>
Aug 09 18:17:48 user nova-compute[72418]:       <deviceboot/>
Aug 09 18:17:48 user nova-compute[72418]:       <disksnapshot default='on' toggle='no'/>
Aug 09 18:17:48 user nova-compute[72418]:     </features>
Aug 09 18:17:48 user nova-compute[72418]:   </guest>
Aug 09 18:17:48 user nova-compute[72418]:   <guest>
Aug 09 18:17:48 user nova-compute[72418]:     <os_type>hvm</os_type>
Aug 09 18:17:48 user nova-compute[72418]:     <arch name='armv7l'>
Aug 09 18:17:48 user nova-compute[72418]:       <wordsize>32</wordsize>
Aug 09 18:17:48 user nova-compute[72418]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>integratorcp</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>borzoi</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>spitz</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2'>nuri</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2'>musca-b1</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>versatileab</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>kzm</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2'>musca-a</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2'>smdkc210</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>sx1</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>z2</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>tosa</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='4'>sabrelite</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>realview-eb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>n810</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>n800</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>versatilepb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>terrier</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>mainstone</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='4'>midway</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>musicpal</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>microbit</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>cubieboard</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>verdex</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>netduino2</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='4'>raspi2b</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>cheetah</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='4'>highbank</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>akita</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>connex</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>collie</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>raspi0</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <domain type='qemu'/>
Aug 09 18:17:48 user nova-compute[72418]:     </arch>
Aug 09 18:17:48 user nova-compute[72418]:     <features>
Aug 09 18:17:48 user nova-compute[72418]:       <cpuselection/>
Aug 09 18:17:48 user nova-compute[72418]:       <deviceboot/>
Aug 09 18:17:48 user nova-compute[72418]:       <disksnapshot default='on' toggle='no'/>
Aug 09 18:17:48 user nova-compute[72418]:     </features>
Aug 09 18:17:48 user nova-compute[72418]:   </guest>
Aug 09 18:17:48 user nova-compute[72418]:   <guest>
Aug 09 18:17:48 user nova-compute[72418]:     <os_type>hvm</os_type>
Aug 09 18:17:48 user nova-compute[72418]:     <arch name='aarch64'>
Aug 09 18:17:48 user nova-compute[72418]:       <wordsize>64</wordsize>
Aug 09 18:17:48 user nova-compute[72418]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>integratorcp</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>borzoi</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>spitz</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2'>nuri</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2'>musca-b1</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>versatileab</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>kzm</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2'>musca-a</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2'>smdkc210</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>sx1</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>z2</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>tosa</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='4'>sabrelite</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>realview-eb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>n810</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>n800</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>versatilepb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>terrier</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>mainstone</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='4'>midway</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>musicpal</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>microbit</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>cubieboard</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>verdex</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>netduino2</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='4'>raspi3b</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='4'>raspi2b</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>cheetah</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='4'>highbank</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>akita</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>connex</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>collie</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>raspi0</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <domain type='qemu'/>
Aug 09 18:17:48 user nova-compute[72418]:     </arch>
Aug 09 18:17:48 user nova-compute[72418]:     <features>
Aug 09 18:17:48 user nova-compute[72418]:       <acpi default='on' toggle='yes'/>
Aug 09 18:17:48 user nova-compute[72418]:       <cpuselection/>
Aug 09 18:17:48 user nova-compute[72418]:       <deviceboot/>
Aug 09 18:17:48 user nova-compute[72418]:       <disksnapshot default='on' toggle='no'/>
Aug 09 18:17:48 user nova-compute[72418]:     </features>
Aug 09 18:17:48 user nova-compute[72418]:   </guest>
Aug 09 18:17:48 user nova-compute[72418]:   <guest>
Aug 09 18:17:48 user nova-compute[72418]:     <os_type>hvm</os_type>
Aug 09 18:17:48 user nova-compute[72418]:     <arch name='cris'>
Aug 09 18:17:48 user nova-compute[72418]:       <wordsize>32</wordsize>
Aug 09 18:17:48 user nova-compute[72418]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <domain type='qemu'/>
Aug 09 18:17:48 user nova-compute[72418]:     </arch>
Aug 09 18:17:48 user nova-compute[72418]:     <features>
Aug 09 18:17:48 user nova-compute[72418]:       <cpuselection/>
Aug 09 18:17:48 user nova-compute[72418]:       <deviceboot/>
Aug 09 18:17:48 user nova-compute[72418]:       <disksnapshot default='on' toggle='no'/>
Aug 09 18:17:48 user nova-compute[72418]:     </features>
Aug 09 18:17:48 user nova-compute[72418]:   </guest>
Aug 09 18:17:48 user nova-compute[72418]:   <guest>
Aug 09 18:17:48 user nova-compute[72418]:     <os_type>hvm</os_type>
Aug 09 18:17:48 user nova-compute[72418]:     <arch name='i686'>
Aug 09 18:17:48 user nova-compute[72418]:       <wordsize>32</wordsize>
Aug 09 18:17:48 user nova-compute[72418]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>x-remote</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>isapc</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>microvm</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <domain type='qemu'/>
Aug 09 18:17:48 user nova-compute[72418]:       <domain type='kvm'/>
Aug 09 18:17:48 user nova-compute[72418]:     </arch>
Aug 09 18:17:48 user nova-compute[72418]:     <features>
Aug 09 18:17:48 user nova-compute[72418]:       <pae/>
Aug 09 18:17:48 user nova-compute[72418]:       <nonpae/>
Aug 09 18:17:48 user nova-compute[72418]:       <acpi default='on' toggle='yes'/>
Aug 09 18:17:48 user nova-compute[72418]:       <apic default='on' toggle='no'/>
Aug 09 18:17:48 user nova-compute[72418]:       <cpuselection/>
Aug 09 18:17:48 user nova-compute[72418]:       <deviceboot/>
Aug 09 18:17:48 user nova-compute[72418]:       <disksnapshot default='on' toggle='no'/>
Aug 09 18:17:48 user nova-compute[72418]:     </features>
Aug 09 18:17:48 user nova-compute[72418]:   </guest>
Aug 09 18:17:48 user nova-compute[72418]:   <guest>
Aug 09 18:17:48 user nova-compute[72418]:     <os_type>hvm</os_type>
Aug 09 18:17:48 user nova-compute[72418]:     <arch name='m68k'>
Aug 09 18:17:48 user nova-compute[72418]:       <wordsize>32</wordsize>
Aug 09 18:17:48 user nova-compute[72418]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>an5206</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>q800</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>next-cube</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <domain type='qemu'/>
Aug 09 18:17:48 user nova-compute[72418]:     </arch>
Aug 09 18:17:48 user nova-compute[72418]:     <features>
Aug 09 18:17:48 user nova-compute[72418]:       <cpuselection/>
Aug 09 18:17:48 user nova-compute[72418]:       <deviceboot/>
Aug 09 18:17:48 user nova-compute[72418]:       <disksnapshot default='on' toggle='no'/>
Aug 09 18:17:48 user nova-compute[72418]:     </features>
Aug 09 18:17:48 user nova-compute[72418]:   </guest>
Aug 09 18:17:48 user nova-compute[72418]:   <guest>
Aug 09 18:17:48 user nova-compute[72418]:     <os_type>hvm</os_type>
Aug 09 18:17:48 user nova-compute[72418]:     <arch name='microblaze'>
Aug 09 18:17:48 user nova-compute[72418]:       <wordsize>32</wordsize>
Aug 09 18:17:48 user nova-compute[72418]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <domain type='qemu'/>
Aug 09 18:17:48 user nova-compute[72418]:     </arch>
Aug 09 18:17:48 user nova-compute[72418]:     <features>
Aug 09 18:17:48 user nova-compute[72418]:       <cpuselection/>
Aug 09 18:17:48 user nova-compute[72418]:       <deviceboot/>
Aug 09 18:17:48 user nova-compute[72418]:       <disksnapshot default='on' toggle='no'/>
Aug 09 18:17:48 user nova-compute[72418]:     </features>
Aug 09 18:17:48 user nova-compute[72418]:   </guest>
Aug 09 18:17:48 user nova-compute[72418]:   <guest>
Aug 09 18:17:48 user nova-compute[72418]:     <os_type>hvm</os_type>
Aug 09 18:17:48 user nova-compute[72418]:     <arch name='microblazeel'>
Aug 09 18:17:48 user nova-compute[72418]:       <wordsize>32</wordsize>
Aug 09 18:17:48 user nova-compute[72418]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <domain type='qemu'/>
Aug 09 18:17:48 user nova-compute[72418]:     </arch>
Aug 09 18:17:48 user nova-compute[72418]:     <features>
Aug 09 18:17:48 user nova-compute[72418]:       <cpuselection/>
Aug 09 18:17:48 user nova-compute[72418]:       <deviceboot/>
Aug 09 18:17:48 user nova-compute[72418]:       <disksnapshot default='on' toggle='no'/>
Aug 09 18:17:48 user nova-compute[72418]:     </features>
Aug 09 18:17:48 user nova-compute[72418]:   </guest>
Aug 09 18:17:48 user nova-compute[72418]:   <guest>
Aug 09 18:17:48 user nova-compute[72418]:     <os_type>hvm</os_type>
Aug 09 18:17:48 user nova-compute[72418]:     <arch name='mips'>
Aug 09 18:17:48 user nova-compute[72418]:       <wordsize>32</wordsize>
Aug 09 18:17:48 user nova-compute[72418]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='16'>malta</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>mipssim</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <domain type='qemu'/>
Aug 09 18:17:48 user nova-compute[72418]:     </arch>
Aug 09 18:17:48 user nova-compute[72418]:     <features>
Aug 09 18:17:48 user nova-compute[72418]:       <cpuselection/>
Aug 09 18:17:48 user nova-compute[72418]:       <deviceboot/>
Aug 09 18:17:48 user nova-compute[72418]:       <disksnapshot default='on' toggle='no'/>
Aug 09 18:17:48 user nova-compute[72418]:     </features>
Aug 09 18:17:48 user nova-compute[72418]:   </guest>
Aug 09 18:17:48 user nova-compute[72418]:   <guest>
Aug 09 18:17:48 user nova-compute[72418]:     <os_type>hvm</os_type>
Aug 09 18:17:48 user nova-compute[72418]:     <arch name='mipsel'>
Aug 09 18:17:48 user nova-compute[72418]:       <wordsize>32</wordsize>
Aug 09 18:17:48 user nova-compute[72418]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='16'>malta</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>mipssim</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <domain type='qemu'/>
Aug 09 18:17:48 user nova-compute[72418]:     </arch>
Aug 09 18:17:48 user nova-compute[72418]:     <features>
Aug 09 18:17:48 user nova-compute[72418]:       <cpuselection/>
Aug 09 18:17:48 user nova-compute[72418]:       <deviceboot/>
Aug 09 18:17:48 user nova-compute[72418]:       <disksnapshot default='on' toggle='no'/>
Aug 09 18:17:48 user nova-compute[72418]:     </features>
Aug 09 18:17:48 user nova-compute[72418]:   </guest>
Aug 09 18:17:48 user nova-compute[72418]:   <guest>
Aug 09 18:17:48 user nova-compute[72418]:     <os_type>hvm</os_type>
Aug 09 18:17:48 user nova-compute[72418]:     <arch name='mips64'>
Aug 09 18:17:48 user nova-compute[72418]:       <wordsize>64</wordsize>
Aug 09 18:17:48 user nova-compute[72418]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='16'>malta</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>mipssim</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>pica61</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>magnum</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <domain type='qemu'/>
Aug 09 18:17:48 user nova-compute[72418]:     </arch>
Aug 09 18:17:48 user nova-compute[72418]:     <features>
Aug 09 18:17:48 user nova-compute[72418]:       <cpuselection/>
Aug 09 18:17:48 user nova-compute[72418]:       <deviceboot/>
Aug 09 18:17:48 user nova-compute[72418]:       <disksnapshot default='on' toggle='no'/>
Aug 09 18:17:48 user nova-compute[72418]:     </features>
Aug 09 18:17:48 user nova-compute[72418]:   </guest>
Aug 09 18:17:48 user nova-compute[72418]:   <guest>
Aug 09 18:17:48 user nova-compute[72418]:     <os_type>hvm</os_type>
Aug 09 18:17:48 user nova-compute[72418]:     <arch name='mips64el'>
Aug 09 18:17:48 user nova-compute[72418]:       <wordsize>64</wordsize>
Aug 09 18:17:48 user nova-compute[72418]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='16'>malta</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>mipssim</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>pica61</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>magnum</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='16'>boston</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <domain type='qemu'/>
Aug 09 18:17:48 user nova-compute[72418]:     </arch>
Aug 09 18:17:48 user nova-compute[72418]:     <features>
Aug 09 18:17:48 user nova-compute[72418]:       <cpuselection/>
Aug 09 18:17:48 user nova-compute[72418]:       <deviceboot/>
Aug 09 18:17:48 user nova-compute[72418]:       <disksnapshot default='on' toggle='no'/>
Aug 09 18:17:48 user nova-compute[72418]:     </features>
Aug 09 18:17:48 user nova-compute[72418]:   </guest>
Aug 09 18:17:48 user nova-compute[72418]:   <guest>
Aug 09 18:17:48 user nova-compute[72418]:     <os_type>hvm</os_type>
Aug 09 18:17:48 user nova-compute[72418]:     <arch name='ppc'>
Aug 09 18:17:48 user nova-compute[72418]:       <wordsize>32</wordsize>
Aug 09 18:17:48 user nova-compute[72418]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>g3beige</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>mac99</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='32'>ppce500</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>pegasos2</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>sam460ex</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>bamboo</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>40p</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>ref405ep</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>taihu</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <domain type='qemu'/>
Aug 09 18:17:48 user nova-compute[72418]:     </arch>
Aug 09 18:17:48 user nova-compute[72418]:     <features>
Aug 09 18:17:48 user nova-compute[72418]:       <cpuselection/>
Aug 09 18:17:48 user nova-compute[72418]:       <deviceboot/>
Aug 09 18:17:48 user nova-compute[72418]:       <disksnapshot default='on' toggle='no'/>
Aug 09 18:17:48 user nova-compute[72418]:     </features>
Aug 09 18:17:48 user nova-compute[72418]:   </guest>
Aug 09 18:17:48 user nova-compute[72418]:   <guest>
Aug 09 18:17:48 user nova-compute[72418]:     <os_type>hvm</os_type>
Aug 09 18:17:48 user nova-compute[72418]:     <arch name='ppc64'>
Aug 09 18:17:48 user nova-compute[72418]:       <wordsize>64</wordsize>
Aug 09 18:17:48 user nova-compute[72418]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2048'>powernv9</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>taihu</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2048'>powernv10</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='32'>ppce500</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>40p</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>pegasos2</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>bamboo</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>g3beige</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>mac99</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>sam460ex</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>ref405ep</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2048'>powernv8</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <domain type='qemu'/>
Aug 09 18:17:48 user nova-compute[72418]:     </arch>
Aug 09 18:17:48 user nova-compute[72418]:     <features>
Aug 09 18:17:48 user nova-compute[72418]:       <cpuselection/>
Aug 09 18:17:48 user nova-compute[72418]:       <deviceboot/>
Aug 09 18:17:48 user nova-compute[72418]:       <disksnapshot default='on' toggle='no'/>
Aug 09 18:17:48 user nova-compute[72418]:     </features>
Aug 09 18:17:48 user nova-compute[72418]:   </guest>
Aug 09 18:17:48 user nova-compute[72418]:   <guest>
Aug 09 18:17:48 user nova-compute[72418]:     <os_type>hvm</os_type>
Aug 09 18:17:48 user nova-compute[72418]:     <arch name='ppc64le'>
Aug 09 18:17:48 user nova-compute[72418]:       <wordsize>64</wordsize>
Aug 09 18:17:48 user nova-compute[72418]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2048'>powernv9</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>taihu</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2048'>powernv10</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='32'>ppce500</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>40p</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>pegasos2</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>bamboo</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>g3beige</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>mac99</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>sam460ex</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>ref405ep</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2048'>powernv8</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <domain type='qemu'/>
Aug 09 18:17:48 user nova-compute[72418]:     </arch>
Aug 09 18:17:48 user nova-compute[72418]:     <features>
Aug 09 18:17:48 user nova-compute[72418]:       <cpuselection/>
Aug 09 18:17:48 user nova-compute[72418]:       <deviceboot/>
Aug 09 18:17:48 user nova-compute[72418]:       <disksnapshot default='on' toggle='no'/>
Aug 09 18:17:48 user nova-compute[72418]:     </features>
Aug 09 18:17:48 user nova-compute[72418]:   </guest>
Aug 09 18:17:48 user nova-compute[72418]:   <guest>
Aug 09 18:17:48 user nova-compute[72418]:     <os_type>hvm</os_type>
Aug 09 18:17:48 user nova-compute[72418]:     <arch name='riscv32'>
Aug 09 18:17:48 user nova-compute[72418]:       <wordsize>32</wordsize>
Aug 09 18:17:48 user nova-compute[72418]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='8'>spike</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>opentitan</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='5'>sifive_u</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>sifive_e</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='8'>virt</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <domain type='qemu'/>
Aug 09 18:17:48 user nova-compute[72418]:     </arch>
Aug 09 18:17:48 user nova-compute[72418]:     <features>
Aug 09 18:17:48 user nova-compute[72418]:       <cpuselection/>
Aug 09 18:17:48 user nova-compute[72418]:       <deviceboot/>
Aug 09 18:17:48 user nova-compute[72418]:       <disksnapshot default='on' toggle='no'/>
Aug 09 18:17:48 user nova-compute[72418]:     </features>
Aug 09 18:17:48 user nova-compute[72418]:   </guest>
Aug 09 18:17:48 user nova-compute[72418]:   <guest>
Aug 09 18:17:48 user nova-compute[72418]:     <os_type>hvm</os_type>
Aug 09 18:17:48 user nova-compute[72418]:     <arch name='riscv64'>
Aug 09 18:17:48 user nova-compute[72418]:       <wordsize>64</wordsize>
Aug 09 18:17:48 user nova-compute[72418]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='8'>spike</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='5'>sifive_u</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>shakti_c</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>sifive_e</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='8'>virt</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <domain type='qemu'/>
Aug 09 18:17:48 user nova-compute[72418]:     </arch>
Aug 09 18:17:48 user nova-compute[72418]:     <features>
Aug 09 18:17:48 user nova-compute[72418]:       <cpuselection/>
Aug 09 18:17:48 user nova-compute[72418]:       <deviceboot/>
Aug 09 18:17:48 user nova-compute[72418]:       <disksnapshot default='on' toggle='no'/>
Aug 09 18:17:48 user nova-compute[72418]:     </features>
Aug 09 18:17:48 user nova-compute[72418]:   </guest>
Aug 09 18:17:48 user nova-compute[72418]:   <guest>
Aug 09 18:17:48 user nova-compute[72418]:     <os_type>hvm</os_type>
Aug 09 18:17:48 user nova-compute[72418]:     <arch name='s390x'>
Aug 09 18:17:48 user nova-compute[72418]:       <wordsize>64</wordsize>
Aug 09 18:17:48 user nova-compute[72418]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <domain type='qemu'/>
Aug 09 18:17:48 user nova-compute[72418]:     </arch>
Aug 09 18:17:48 user nova-compute[72418]:     <features>
Aug 09 18:17:48 user nova-compute[72418]:       <cpuselection/>
Aug 09 18:17:48 user nova-compute[72418]:       <deviceboot/>
Aug 09 18:17:48 user nova-compute[72418]:       <disksnapshot default='on' toggle='no'/>
Aug 09 18:17:48 user nova-compute[72418]:     </features>
Aug 09 18:17:48 user nova-compute[72418]:   </guest>
Aug 09 18:17:48 user nova-compute[72418]:   <guest>
Aug 09 18:17:48 user nova-compute[72418]:     <os_type>hvm</os_type>
Aug 09 18:17:48 user nova-compute[72418]:     <arch name='sh4'>
Aug 09 18:17:48 user nova-compute[72418]:       <wordsize>32</wordsize>
Aug 09 18:17:48 user nova-compute[72418]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>shix</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>r2d</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <domain type='qemu'/>
Aug 09 18:17:48 user nova-compute[72418]:     </arch>
Aug 09 18:17:48 user nova-compute[72418]:     <features>
Aug 09 18:17:48 user nova-compute[72418]:       <cpuselection/>
Aug 09 18:17:48 user nova-compute[72418]:       <deviceboot/>
Aug 09 18:17:48 user nova-compute[72418]:       <disksnapshot default='on' toggle='no'/>
Aug 09 18:17:48 user nova-compute[72418]:     </features>
Aug 09 18:17:48 user nova-compute[72418]:   </guest>
Aug 09 18:17:48 user nova-compute[72418]:   <guest>
Aug 09 18:17:48 user nova-compute[72418]:     <os_type>hvm</os_type>
Aug 09 18:17:48 user nova-compute[72418]:     <arch name='sh4eb'>
Aug 09 18:17:48 user nova-compute[72418]:       <wordsize>64</wordsize>
Aug 09 18:17:48 user nova-compute[72418]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>shix</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>r2d</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <domain type='qemu'/>
Aug 09 18:17:48 user nova-compute[72418]:     </arch>
Aug 09 18:17:48 user nova-compute[72418]:     <features>
Aug 09 18:17:48 user nova-compute[72418]:       <cpuselection/>
Aug 09 18:17:48 user nova-compute[72418]:       <deviceboot/>
Aug 09 18:17:48 user nova-compute[72418]:       <disksnapshot default='on' toggle='no'/>
Aug 09 18:17:48 user nova-compute[72418]:     </features>
Aug 09 18:17:48 user nova-compute[72418]:   </guest>
Aug 09 18:17:48 user nova-compute[72418]:   <guest>
Aug 09 18:17:48 user nova-compute[72418]:     <os_type>hvm</os_type>
Aug 09 18:17:48 user nova-compute[72418]:     <arch name='sparc'>
Aug 09 18:17:48 user nova-compute[72418]:       <wordsize>32</wordsize>
Aug 09 18:17:48 user nova-compute[72418]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>SS-5</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='4'>SS-20</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>LX</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>SS-4</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='4'>SS-10</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>Voyager</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <domain type='qemu'/>
Aug 09 18:17:48 user nova-compute[72418]:     </arch>
Aug 09 18:17:48 user nova-compute[72418]:     <features>
Aug 09 18:17:48 user nova-compute[72418]:       <cpuselection/>
Aug 09 18:17:48 user nova-compute[72418]:       <deviceboot/>
Aug 09 18:17:48 user nova-compute[72418]:       <disksnapshot default='on' toggle='no'/>
Aug 09 18:17:48 user nova-compute[72418]:     </features>
Aug 09 18:17:48 user nova-compute[72418]:   </guest>
Aug 09 18:17:48 user nova-compute[72418]:   <guest>
Aug 09 18:17:48 user nova-compute[72418]:     <os_type>hvm</os_type>
Aug 09 18:17:48 user nova-compute[72418]:     <arch name='sparc64'>
Aug 09 18:17:48 user nova-compute[72418]:       <wordsize>64</wordsize>
Aug 09 18:17:48 user nova-compute[72418]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>sun4u</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>niagara</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>sun4v</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <domain type='qemu'/>
Aug 09 18:17:48 user nova-compute[72418]:     </arch>
Aug 09 18:17:48 user nova-compute[72418]:     <features>
Aug 09 18:17:48 user nova-compute[72418]:       <cpuselection/>
Aug 09 18:17:48 user nova-compute[72418]:       <deviceboot/>
Aug 09 18:17:48 user nova-compute[72418]:       <disksnapshot default='on' toggle='no'/>
Aug 09 18:17:48 user nova-compute[72418]:     </features>
Aug 09 18:17:48 user nova-compute[72418]:   </guest>
Aug 09 18:17:48 user nova-compute[72418]:   <guest>
Aug 09 18:17:48 user nova-compute[72418]:     <os_type>hvm</os_type>
Aug 09 18:17:48 user nova-compute[72418]:     <arch name='x86_64'>
Aug 09 18:17:48 user nova-compute[72418]:       <wordsize>64</wordsize>
Aug 09 18:17:48 user nova-compute[72418]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>x-remote</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='1'>isapc</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>microvm</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <domain type='qemu'/>
Aug 09 18:17:48 user nova-compute[72418]:       <domain type='kvm'/>
Aug 09 18:17:48 user nova-compute[72418]:     </arch>
Aug 09 18:17:48 user nova-compute[72418]:     <features>
Aug 09 18:17:48 user nova-compute[72418]:       <acpi default='on' toggle='yes'/>
Aug 09 18:17:48 user nova-compute[72418]:       <apic default='on' toggle='no'/>
Aug 09 18:17:48 user nova-compute[72418]:       <cpuselection/>
Aug 09 18:17:48 user nova-compute[72418]:       <deviceboot/>
Aug 09 18:17:48 user nova-compute[72418]:       <disksnapshot default='on' toggle='no'/>
Aug 09 18:17:48 user nova-compute[72418]:     </features>
Aug 09 18:17:48 user nova-compute[72418]:   </guest>
Aug 09 18:17:48 user nova-compute[72418]:   <guest>
Aug 09 18:17:48 user nova-compute[72418]:     <os_type>hvm</os_type>
Aug 09 18:17:48 user nova-compute[72418]:     <arch name='xtensa'>
Aug 09 18:17:48 user nova-compute[72418]:       <wordsize>32</wordsize>
Aug 09 18:17:48 user nova-compute[72418]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='4'>sim</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='32'>kc705</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='32'>ml605</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='32'>virt</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='32'>lx200</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='32'>lx60</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <domain type='qemu'/>
Aug 09 18:17:48 user nova-compute[72418]:     </arch>
Aug 09 18:17:48 user nova-compute[72418]:     <features>
Aug 09 18:17:48 user nova-compute[72418]:       <cpuselection/>
Aug 09 18:17:48 user nova-compute[72418]:       <deviceboot/>
Aug 09 18:17:48 user nova-compute[72418]:       <disksnapshot default='on' toggle='no'/>
Aug 09 18:17:48 user nova-compute[72418]:     </features>
Aug 09 18:17:48 user nova-compute[72418]:   </guest>
Aug 09 18:17:48 user nova-compute[72418]:   <guest>
Aug 09 18:17:48 user nova-compute[72418]:     <os_type>hvm</os_type>
Aug 09 18:17:48 user nova-compute[72418]:     <arch name='xtensaeb'>
Aug 09 18:17:48 user nova-compute[72418]:       <wordsize>32</wordsize>
Aug 09 18:17:48 user nova-compute[72418]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='4'>sim</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='32'>kc705</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='32'>ml605</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='32'>virt</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='32'>lx200</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='32'>lx60</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 09 18:17:48 user nova-compute[72418]:       <domain type='qemu'/>
Aug 09 18:17:48 user nova-compute[72418]:     </arch>
Aug 09 18:17:48 user nova-compute[72418]:     <features>
Aug 09 18:17:48 user nova-compute[72418]:       <cpuselection/>
Aug 09 18:17:48 user nova-compute[72418]:       <deviceboot/>
Aug 09 18:17:48 user nova-compute[72418]:       <disksnapshot default='on' toggle='no'/>
Aug 09 18:17:48 user nova-compute[72418]:     </features>
Aug 09 18:17:48 user nova-compute[72418]:   </guest>
Aug 09 18:17:48 user nova-compute[72418]: </capabilities>
Aug 09 18:17:48 user nova-compute[72418]: 
Aug 09 18:17:48 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=72418) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 18:17:48 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=72418) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 18:17:48 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=72418) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 18:17:48 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72418) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 18:17:48 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72418) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 18:17:48 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=72418) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 18:17:48 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72418) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 18:17:48 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=72418) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 18:17:48 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=72418) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 18:17:48 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=72418) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 18:17:48 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=72418) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 18:17:48 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu', 'ubuntu-q35', 'pc'} {{(pid=72418) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 18:17:48 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 09 18:17:48 user nova-compute[72418]: <domainCapabilities>
Aug 09 18:17:48 user nova-compute[72418]:   <path>/usr/bin/qemu-system-i386</path>
Aug 09 18:17:48 user nova-compute[72418]:   <domain>kvm</domain>
Aug 09 18:17:48 user nova-compute[72418]:   <machine>pc-q35-6.2</machine>
Aug 09 18:17:48 user nova-compute[72418]:   <arch>i686</arch>
Aug 09 18:17:48 user nova-compute[72418]:   <vcpu max='288'/>
Aug 09 18:17:48 user nova-compute[72418]:   <iothreads supported='yes'/>
Aug 09 18:17:48 user nova-compute[72418]:   <os supported='yes'>
Aug 09 18:17:48 user nova-compute[72418]:     <enum name='firmware'/>
Aug 09 18:17:48 user nova-compute[72418]:     <loader supported='yes'>
Aug 09 18:17:48 user nova-compute[72418]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 09 18:17:48 user nova-compute[72418]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 09 18:17:48 user nova-compute[72418]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 09 18:17:48 user nova-compute[72418]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 09 18:17:48 user nova-compute[72418]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 09 18:17:48 user nova-compute[72418]:       <enum name='type'>
Aug 09 18:17:48 user nova-compute[72418]:         <value>rom</value>
Aug 09 18:17:48 user nova-compute[72418]:         <value>pflash</value>
Aug 09 18:17:48 user nova-compute[72418]:       </enum>
Aug 09 18:17:48 user nova-compute[72418]:       <enum name='readonly'>
Aug 09 18:17:48 user nova-compute[72418]:         <value>yes</value>
Aug 09 18:17:48 user nova-compute[72418]:         <value>no</value>
Aug 09 18:17:48 user nova-compute[72418]:       </enum>
Aug 09 18:17:48 user nova-compute[72418]:       <enum name='secure'>
Aug 09 18:17:48 user nova-compute[72418]:         <value>no</value>
Aug 09 18:17:48 user nova-compute[72418]:       </enum>
Aug 09 18:17:48 user nova-compute[72418]:     </loader>
Aug 09 18:17:48 user nova-compute[72418]:   </os>
Aug 09 18:17:48 user nova-compute[72418]:   <cpu>
Aug 09 18:17:48 user nova-compute[72418]:     <mode name='host-passthrough' supported='yes'>
Aug 09 18:17:48 user nova-compute[72418]:       <enum name='hostPassthroughMigratable'>
Aug 09 18:17:48 user nova-compute[72418]:         <value>off</value>
Aug 09 18:17:48 user nova-compute[72418]:       </enum>
Aug 09 18:17:48 user nova-compute[72418]:     </mode>
Aug 09 18:17:48 user nova-compute[72418]:     <mode name='maximum' supported='yes'>
Aug 09 18:17:48 user nova-compute[72418]:       <enum name='maximumMigratable'>
Aug 09 18:17:48 user nova-compute[72418]:         <value>on</value>
Aug 09 18:17:48 user nova-compute[72418]:         <value>off</value>
Aug 09 18:17:48 user nova-compute[72418]:       </enum>
Aug 09 18:17:48 user nova-compute[72418]:     </mode>
Aug 09 18:17:48 user nova-compute[72418]:     <mode name='host-model' supported='yes'>
Aug 09 18:17:48 user nova-compute[72418]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 18:17:48 user nova-compute[72418]:       <vendor>Intel</vendor>
Aug 09 18:17:48 user nova-compute[72418]:       <feature policy='require' name='ss'/>
Aug 09 18:17:48 user nova-compute[72418]:       <feature policy='require' name='vmx'/>
Aug 09 18:17:48 user nova-compute[72418]:       <feature policy='require' name='pcid'/>
Aug 09 18:17:48 user nova-compute[72418]:       <feature policy='require' name='hypervisor'/>
Aug 09 18:17:48 user nova-compute[72418]:       <feature policy='require' name='arat'/>
Aug 09 18:17:48 user nova-compute[72418]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 18:17:48 user nova-compute[72418]:       <feature policy='require' name='umip'/>
Aug 09 18:17:48 user nova-compute[72418]:       <feature policy='require' name='md-clear'/>
Aug 09 18:17:48 user nova-compute[72418]:       <feature policy='require' name='stibp'/>
Aug 09 18:17:48 user nova-compute[72418]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 18:17:48 user nova-compute[72418]:       <feature policy='require' name='ssbd'/>
Aug 09 18:17:48 user nova-compute[72418]:       <feature policy='require' name='ibpb'/>
Aug 09 18:17:48 user nova-compute[72418]:       <feature policy='require' name='ibrs'/>
Aug 09 18:17:48 user nova-compute[72418]:       <feature policy='require' name='amd-stibp'/>
Aug 09 18:17:48 user nova-compute[72418]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 18:17:48 user nova-compute[72418]:       <feature policy='disable' name='erms'/>
Aug 09 18:17:48 user nova-compute[72418]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 18:17:48 user nova-compute[72418]:       <feature policy='disable' name='lm'/>
Aug 09 18:17:48 user nova-compute[72418]:     </mode>
Aug 09 18:17:48 user nova-compute[72418]:     <mode name='custom' supported='yes'>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>qemu64</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='yes'>qemu32</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>phenom</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='yes'>pentium3</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='yes'>pentium2</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='yes'>pentium</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>n270</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>kvm64</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='yes'>kvm32</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='yes'>coreduo</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>core2duo</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>athlon</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>Westmere-IBRS</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>Westmere</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>Snowridge</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>Skylake-Server</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>Skylake-Client</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>SandyBridge</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>Penryn</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>Opteron_G5</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>Opteron_G4</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>Opteron_G3</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>Opteron_G2</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>Opteron_G1</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>Nehalem-IBRS</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>Nehalem</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>IvyBridge</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>Icelake-Server</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>Haswell</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>EPYC-Rome</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>EPYC-Milan</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>EPYC</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>Dhyana</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>Cooperlake</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>Conroe</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>Broadwell</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='yes'>486</model>
Aug 09 18:17:48 user nova-compute[72418]:     </mode>
Aug 09 18:17:48 user nova-compute[72418]:   </cpu>
Aug 09 18:17:48 user nova-compute[72418]:   <memoryBacking supported='yes'>
Aug 09 18:17:48 user nova-compute[72418]:     <enum name='sourceType'>
Aug 09 18:17:48 user nova-compute[72418]:       <value>file</value>
Aug 09 18:17:48 user nova-compute[72418]:       <value>anonymous</value>
Aug 09 18:17:48 user nova-compute[72418]:       <value>memfd</value>
Aug 09 18:17:48 user nova-compute[72418]:     </enum>
Aug 09 18:17:48 user nova-compute[72418]:   </memoryBacking>
Aug 09 18:17:48 user nova-compute[72418]:   <devices>
Aug 09 18:17:48 user nova-compute[72418]:     <disk supported='yes'>
Aug 09 18:17:48 user nova-compute[72418]:       <enum name='diskDevice'>
Aug 09 18:17:48 user nova-compute[72418]:         <value>disk</value>
Aug 09 18:17:48 user nova-compute[72418]:         <value>cdrom</value>
Aug 09 18:17:48 user nova-compute[72418]:         <value>floppy</value>
Aug 09 18:17:48 user nova-compute[72418]:         <value>lun</value>
Aug 09 18:17:48 user nova-compute[72418]:       </enum>
Aug 09 18:17:48 user nova-compute[72418]:       <enum name='bus'>
Aug 09 18:17:48 user nova-compute[72418]:         <value>fdc</value>
Aug 09 18:17:48 user nova-compute[72418]:         <value>scsi</value>
Aug 09 18:17:48 user nova-compute[72418]:         <value>virtio</value>
Aug 09 18:17:48 user nova-compute[72418]:         <value>usb</value>
Aug 09 18:17:48 user nova-compute[72418]:         <value>sata</value>
Aug 09 18:17:48 user nova-compute[72418]:       </enum>
Aug 09 18:17:48 user nova-compute[72418]:       <enum name='model'>
Aug 09 18:17:48 user nova-compute[72418]:         <value>virtio</value>
Aug 09 18:17:48 user nova-compute[72418]:         <value>virtio-transitional</value>
Aug 09 18:17:48 user nova-compute[72418]:         <value>virtio-non-transitional</value>
Aug 09 18:17:48 user nova-compute[72418]:       </enum>
Aug 09 18:17:48 user nova-compute[72418]:     </disk>
Aug 09 18:17:48 user nova-compute[72418]:     <graphics supported='yes'>
Aug 09 18:17:48 user nova-compute[72418]:       <enum name='type'>
Aug 09 18:17:48 user nova-compute[72418]:         <value>sdl</value>
Aug 09 18:17:48 user nova-compute[72418]:         <value>vnc</value>
Aug 09 18:17:48 user nova-compute[72418]:         <value>spice</value>
Aug 09 18:17:48 user nova-compute[72418]:         <value>egl-headless</value>
Aug 09 18:17:48 user nova-compute[72418]:       </enum>
Aug 09 18:17:48 user nova-compute[72418]:     </graphics>
Aug 09 18:17:48 user nova-compute[72418]:     <video supported='yes'>
Aug 09 18:17:48 user nova-compute[72418]:       <enum name='modelType'>
Aug 09 18:17:48 user nova-compute[72418]:         <value>vga</value>
Aug 09 18:17:48 user nova-compute[72418]:         <value>cirrus</value>
Aug 09 18:17:48 user nova-compute[72418]:         <value>vmvga</value>
Aug 09 18:17:48 user nova-compute[72418]:         <value>qxl</value>
Aug 09 18:17:48 user nova-compute[72418]:         <value>virtio</value>
Aug 09 18:17:48 user nova-compute[72418]:         <value>none</value>
Aug 09 18:17:48 user nova-compute[72418]:         <value>bochs</value>
Aug 09 18:17:48 user nova-compute[72418]:         <value>ramfb</value>
Aug 09 18:17:48 user nova-compute[72418]:       </enum>
Aug 09 18:17:48 user nova-compute[72418]:     </video>
Aug 09 18:17:48 user nova-compute[72418]:     <hostdev supported='yes'>
Aug 09 18:17:48 user nova-compute[72418]:       <enum name='mode'>
Aug 09 18:17:48 user nova-compute[72418]:         <value>subsystem</value>
Aug 09 18:17:48 user nova-compute[72418]:       </enum>
Aug 09 18:17:48 user nova-compute[72418]:       <enum name='startupPolicy'>
Aug 09 18:17:48 user nova-compute[72418]:         <value>default</value>
Aug 09 18:17:48 user nova-compute[72418]:         <value>mandatory</value>
Aug 09 18:17:48 user nova-compute[72418]:         <value>requisite</value>
Aug 09 18:17:48 user nova-compute[72418]:         <value>optional</value>
Aug 09 18:17:48 user nova-compute[72418]:       </enum>
Aug 09 18:17:48 user nova-compute[72418]:       <enum name='subsysType'>
Aug 09 18:17:48 user nova-compute[72418]:         <value>usb</value>
Aug 09 18:17:48 user nova-compute[72418]:         <value>pci</value>
Aug 09 18:17:48 user nova-compute[72418]:         <value>scsi</value>
Aug 09 18:17:48 user nova-compute[72418]:       </enum>
Aug 09 18:17:48 user nova-compute[72418]:       <enum name='capsType'/>
Aug 09 18:17:48 user nova-compute[72418]:       <enum name='pciBackend'/>
Aug 09 18:17:48 user nova-compute[72418]:     </hostdev>
Aug 09 18:17:48 user nova-compute[72418]:     <rng supported='yes'>
Aug 09 18:17:48 user nova-compute[72418]:       <enum name='model'>
Aug 09 18:17:48 user nova-compute[72418]:         <value>virtio</value>
Aug 09 18:17:48 user nova-compute[72418]:         <value>virtio-transitional</value>
Aug 09 18:17:48 user nova-compute[72418]:         <value>virtio-non-transitional</value>
Aug 09 18:17:48 user nova-compute[72418]:       </enum>
Aug 09 18:17:48 user nova-compute[72418]:       <enum name='backendModel'>
Aug 09 18:17:48 user nova-compute[72418]:         <value>random</value>
Aug 09 18:17:48 user nova-compute[72418]:         <value>egd</value>
Aug 09 18:17:48 user nova-compute[72418]:         <value>builtin</value>
Aug 09 18:17:48 user nova-compute[72418]:       </enum>
Aug 09 18:17:48 user nova-compute[72418]:     </rng>
Aug 09 18:17:48 user nova-compute[72418]:     <filesystem supported='yes'>
Aug 09 18:17:48 user nova-compute[72418]:       <enum name='driverType'>
Aug 09 18:17:48 user nova-compute[72418]:         <value>path</value>
Aug 09 18:17:48 user nova-compute[72418]:         <value>handle</value>
Aug 09 18:17:48 user nova-compute[72418]:         <value>virtiofs</value>
Aug 09 18:17:48 user nova-compute[72418]:       </enum>
Aug 09 18:17:48 user nova-compute[72418]:     </filesystem>
Aug 09 18:17:48 user nova-compute[72418]:     <tpm supported='yes'>
Aug 09 18:17:48 user nova-compute[72418]:       <enum name='model'>
Aug 09 18:17:48 user nova-compute[72418]:         <value>tpm-tis</value>
Aug 09 18:17:48 user nova-compute[72418]:         <value>tpm-crb</value>
Aug 09 18:17:48 user nova-compute[72418]:       </enum>
Aug 09 18:17:48 user nova-compute[72418]:       <enum name='backendModel'>
Aug 09 18:17:48 user nova-compute[72418]:         <value>passthrough</value>
Aug 09 18:17:48 user nova-compute[72418]:         <value>emulator</value>
Aug 09 18:17:48 user nova-compute[72418]:       </enum>
Aug 09 18:17:48 user nova-compute[72418]:     </tpm>
Aug 09 18:17:48 user nova-compute[72418]:   </devices>
Aug 09 18:17:48 user nova-compute[72418]:   <features>
Aug 09 18:17:48 user nova-compute[72418]:     <gic supported='no'/>
Aug 09 18:17:48 user nova-compute[72418]:     <vmcoreinfo supported='yes'/>
Aug 09 18:17:48 user nova-compute[72418]:     <genid supported='yes'/>
Aug 09 18:17:48 user nova-compute[72418]:     <backingStoreInput supported='yes'/>
Aug 09 18:17:48 user nova-compute[72418]:     <backup supported='yes'/>
Aug 09 18:17:48 user nova-compute[72418]:     <sev supported='no'/>
Aug 09 18:17:48 user nova-compute[72418]:   </features>
Aug 09 18:17:48 user nova-compute[72418]: </domainCapabilities>
Aug 09 18:17:48 user nova-compute[72418]:  {{(pid=72418) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 18:17:48 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 09 18:17:48 user nova-compute[72418]: <domainCapabilities>
Aug 09 18:17:48 user nova-compute[72418]:   <path>/usr/bin/qemu-system-i386</path>
Aug 09 18:17:48 user nova-compute[72418]:   <domain>kvm</domain>
Aug 09 18:17:48 user nova-compute[72418]:   <machine>pc-i440fx-jammy</machine>
Aug 09 18:17:48 user nova-compute[72418]:   <arch>i686</arch>
Aug 09 18:17:48 user nova-compute[72418]:   <vcpu max='255'/>
Aug 09 18:17:48 user nova-compute[72418]:   <iothreads supported='yes'/>
Aug 09 18:17:48 user nova-compute[72418]:   <os supported='yes'>
Aug 09 18:17:48 user nova-compute[72418]:     <enum name='firmware'/>
Aug 09 18:17:48 user nova-compute[72418]:     <loader supported='yes'>
Aug 09 18:17:48 user nova-compute[72418]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 09 18:17:48 user nova-compute[72418]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 09 18:17:48 user nova-compute[72418]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 09 18:17:48 user nova-compute[72418]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 09 18:17:48 user nova-compute[72418]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 09 18:17:48 user nova-compute[72418]:       <enum name='type'>
Aug 09 18:17:48 user nova-compute[72418]:         <value>rom</value>
Aug 09 18:17:48 user nova-compute[72418]:         <value>pflash</value>
Aug 09 18:17:48 user nova-compute[72418]:       </enum>
Aug 09 18:17:48 user nova-compute[72418]:       <enum name='readonly'>
Aug 09 18:17:48 user nova-compute[72418]:         <value>yes</value>
Aug 09 18:17:48 user nova-compute[72418]:         <value>no</value>
Aug 09 18:17:48 user nova-compute[72418]:       </enum>
Aug 09 18:17:48 user nova-compute[72418]:       <enum name='secure'>
Aug 09 18:17:48 user nova-compute[72418]:         <value>no</value>
Aug 09 18:17:48 user nova-compute[72418]:       </enum>
Aug 09 18:17:48 user nova-compute[72418]:     </loader>
Aug 09 18:17:48 user nova-compute[72418]:   </os>
Aug 09 18:17:48 user nova-compute[72418]:   <cpu>
Aug 09 18:17:48 user nova-compute[72418]:     <mode name='host-passthrough' supported='yes'>
Aug 09 18:17:48 user nova-compute[72418]:       <enum name='hostPassthroughMigratable'>
Aug 09 18:17:48 user nova-compute[72418]:         <value>off</value>
Aug 09 18:17:48 user nova-compute[72418]:       </enum>
Aug 09 18:17:48 user nova-compute[72418]:     </mode>
Aug 09 18:17:48 user nova-compute[72418]:     <mode name='maximum' supported='yes'>
Aug 09 18:17:48 user nova-compute[72418]:       <enum name='maximumMigratable'>
Aug 09 18:17:48 user nova-compute[72418]:         <value>on</value>
Aug 09 18:17:48 user nova-compute[72418]:         <value>off</value>
Aug 09 18:17:48 user nova-compute[72418]:       </enum>
Aug 09 18:17:48 user nova-compute[72418]:     </mode>
Aug 09 18:17:48 user nova-compute[72418]:     <mode name='host-model' supported='yes'>
Aug 09 18:17:48 user nova-compute[72418]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 18:17:48 user nova-compute[72418]:       <vendor>Intel</vendor>
Aug 09 18:17:48 user nova-compute[72418]:       <feature policy='require' name='ss'/>
Aug 09 18:17:48 user nova-compute[72418]:       <feature policy='require' name='vmx'/>
Aug 09 18:17:48 user nova-compute[72418]:       <feature policy='require' name='pcid'/>
Aug 09 18:17:48 user nova-compute[72418]:       <feature policy='require' name='hypervisor'/>
Aug 09 18:17:48 user nova-compute[72418]:       <feature policy='require' name='arat'/>
Aug 09 18:17:48 user nova-compute[72418]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 18:17:48 user nova-compute[72418]:       <feature policy='require' name='umip'/>
Aug 09 18:17:48 user nova-compute[72418]:       <feature policy='require' name='md-clear'/>
Aug 09 18:17:48 user nova-compute[72418]:       <feature policy='require' name='stibp'/>
Aug 09 18:17:48 user nova-compute[72418]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 18:17:48 user nova-compute[72418]:       <feature policy='require' name='ssbd'/>
Aug 09 18:17:48 user nova-compute[72418]:       <feature policy='require' name='ibpb'/>
Aug 09 18:17:48 user nova-compute[72418]:       <feature policy='require' name='ibrs'/>
Aug 09 18:17:48 user nova-compute[72418]:       <feature policy='require' name='amd-stibp'/>
Aug 09 18:17:48 user nova-compute[72418]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 18:17:48 user nova-compute[72418]:       <feature policy='disable' name='erms'/>
Aug 09 18:17:48 user nova-compute[72418]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 18:17:48 user nova-compute[72418]:       <feature policy='disable' name='lm'/>
Aug 09 18:17:48 user nova-compute[72418]:     </mode>
Aug 09 18:17:48 user nova-compute[72418]:     <mode name='custom' supported='yes'>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>qemu64</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='yes'>qemu32</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>phenom</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='yes'>pentium3</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='yes'>pentium2</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='yes'>pentium</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>n270</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>kvm64</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='yes'>kvm32</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='yes'>coreduo</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>core2duo</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>athlon</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>Westmere-IBRS</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>Westmere</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>Snowridge</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>Skylake-Server</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>Skylake-Client</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>SandyBridge</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>Penryn</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>Opteron_G5</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>Opteron_G4</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>Opteron_G3</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>Opteron_G2</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>Opteron_G1</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>Nehalem-IBRS</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>Nehalem</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>IvyBridge</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no'>Icelake-Server</model>
Aug 09 18:17:48 user nova-compute[72418]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Haswell</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>EPYC-Rome</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>EPYC-Milan</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>EPYC</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Dhyana</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Cooperlake</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Conroe</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Broadwell</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>486</model>
Aug 09 18:17:49 user nova-compute[72418]:     </mode>
Aug 09 18:17:49 user nova-compute[72418]:   </cpu>
Aug 09 18:17:49 user nova-compute[72418]:   <memoryBacking supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:     <enum name='sourceType'>
Aug 09 18:17:49 user nova-compute[72418]:       <value>file</value>
Aug 09 18:17:49 user nova-compute[72418]:       <value>anonymous</value>
Aug 09 18:17:49 user nova-compute[72418]:       <value>memfd</value>
Aug 09 18:17:49 user nova-compute[72418]:     </enum>
Aug 09 18:17:49 user nova-compute[72418]:   </memoryBacking>
Aug 09 18:17:49 user nova-compute[72418]:   <devices>
Aug 09 18:17:49 user nova-compute[72418]:     <disk supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='diskDevice'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>disk</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>cdrom</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>floppy</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>lun</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='bus'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>ide</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>fdc</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>scsi</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtio</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>usb</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>sata</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='model'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtio</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtio-transitional</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtio-non-transitional</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </disk>
Aug 09 18:17:49 user nova-compute[72418]:     <graphics supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='type'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>sdl</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>vnc</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>spice</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>egl-headless</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </graphics>
Aug 09 18:17:49 user nova-compute[72418]:     <video supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='modelType'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>vga</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>cirrus</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>vmvga</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>qxl</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtio</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>none</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>bochs</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>ramfb</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </video>
Aug 09 18:17:49 user nova-compute[72418]:     <hostdev supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='mode'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>subsystem</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='startupPolicy'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>default</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>mandatory</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>requisite</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>optional</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='subsysType'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>usb</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>pci</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>scsi</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='capsType'/>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='pciBackend'/>
Aug 09 18:17:49 user nova-compute[72418]:     </hostdev>
Aug 09 18:17:49 user nova-compute[72418]:     <rng supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='model'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtio</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtio-transitional</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtio-non-transitional</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='backendModel'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>random</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>egd</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>builtin</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </rng>
Aug 09 18:17:49 user nova-compute[72418]:     <filesystem supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='driverType'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>path</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>handle</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtiofs</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </filesystem>
Aug 09 18:17:49 user nova-compute[72418]:     <tpm supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='model'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>tpm-tis</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>tpm-crb</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='backendModel'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>passthrough</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>emulator</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </tpm>
Aug 09 18:17:49 user nova-compute[72418]:   </devices>
Aug 09 18:17:49 user nova-compute[72418]:   <features>
Aug 09 18:17:49 user nova-compute[72418]:     <gic supported='no'/>
Aug 09 18:17:49 user nova-compute[72418]:     <vmcoreinfo supported='yes'/>
Aug 09 18:17:49 user nova-compute[72418]:     <genid supported='yes'/>
Aug 09 18:17:49 user nova-compute[72418]:     <backingStoreInput supported='yes'/>
Aug 09 18:17:49 user nova-compute[72418]:     <backup supported='yes'/>
Aug 09 18:17:49 user nova-compute[72418]:     <sev supported='no'/>
Aug 09 18:17:49 user nova-compute[72418]:   </features>
Aug 09 18:17:49 user nova-compute[72418]: </domainCapabilities>
Aug 09 18:17:49 user nova-compute[72418]:  {{(pid=72418) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 09 18:17:49 user nova-compute[72418]: <domainCapabilities>
Aug 09 18:17:49 user nova-compute[72418]:   <path>/usr/bin/qemu-system-i386</path>
Aug 09 18:17:49 user nova-compute[72418]:   <domain>kvm</domain>
Aug 09 18:17:49 user nova-compute[72418]:   <machine>pc-q35-jammy</machine>
Aug 09 18:17:49 user nova-compute[72418]:   <arch>i686</arch>
Aug 09 18:17:49 user nova-compute[72418]:   <vcpu max='288'/>
Aug 09 18:17:49 user nova-compute[72418]:   <iothreads supported='yes'/>
Aug 09 18:17:49 user nova-compute[72418]:   <os supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:     <enum name='firmware'/>
Aug 09 18:17:49 user nova-compute[72418]:     <loader supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 09 18:17:49 user nova-compute[72418]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 09 18:17:49 user nova-compute[72418]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 09 18:17:49 user nova-compute[72418]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 09 18:17:49 user nova-compute[72418]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='type'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>rom</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>pflash</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='readonly'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>yes</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>no</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='secure'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>no</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </loader>
Aug 09 18:17:49 user nova-compute[72418]:   </os>
Aug 09 18:17:49 user nova-compute[72418]:   <cpu>
Aug 09 18:17:49 user nova-compute[72418]:     <mode name='host-passthrough' supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='hostPassthroughMigratable'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>off</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </mode>
Aug 09 18:17:49 user nova-compute[72418]:     <mode name='maximum' supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='maximumMigratable'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>on</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>off</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </mode>
Aug 09 18:17:49 user nova-compute[72418]:     <mode name='host-model' supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <vendor>Intel</vendor>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='ss'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='vmx'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='pcid'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='hypervisor'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='arat'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='umip'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='md-clear'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='stibp'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='ssbd'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='ibpb'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='ibrs'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='amd-stibp'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='disable' name='erms'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='disable' name='lm'/>
Aug 09 18:17:49 user nova-compute[72418]:     </mode>
Aug 09 18:17:49 user nova-compute[72418]:     <mode name='custom' supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>qemu64</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>qemu32</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>phenom</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>pentium3</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>pentium2</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>pentium</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>n270</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>kvm64</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>kvm32</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>coreduo</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>core2duo</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>athlon</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Westmere-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Westmere</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Snowridge</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Skylake-Server</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Skylake-Client</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>SandyBridge</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Penryn</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Opteron_G5</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Opteron_G4</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Opteron_G3</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Opteron_G2</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Opteron_G1</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Nehalem-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Nehalem</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>IvyBridge</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Icelake-Server</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Haswell</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>EPYC-Rome</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>EPYC-Milan</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>EPYC</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Dhyana</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Cooperlake</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Conroe</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Broadwell</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>486</model>
Aug 09 18:17:49 user nova-compute[72418]:     </mode>
Aug 09 18:17:49 user nova-compute[72418]:   </cpu>
Aug 09 18:17:49 user nova-compute[72418]:   <memoryBacking supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:     <enum name='sourceType'>
Aug 09 18:17:49 user nova-compute[72418]:       <value>file</value>
Aug 09 18:17:49 user nova-compute[72418]:       <value>anonymous</value>
Aug 09 18:17:49 user nova-compute[72418]:       <value>memfd</value>
Aug 09 18:17:49 user nova-compute[72418]:     </enum>
Aug 09 18:17:49 user nova-compute[72418]:   </memoryBacking>
Aug 09 18:17:49 user nova-compute[72418]:   <devices>
Aug 09 18:17:49 user nova-compute[72418]:     <disk supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='diskDevice'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>disk</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>cdrom</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>floppy</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>lun</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='bus'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>fdc</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>scsi</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtio</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>usb</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>sata</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='model'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtio</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtio-transitional</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtio-non-transitional</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </disk>
Aug 09 18:17:49 user nova-compute[72418]:     <graphics supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='type'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>sdl</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>vnc</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>spice</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>egl-headless</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </graphics>
Aug 09 18:17:49 user nova-compute[72418]:     <video supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='modelType'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>vga</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>cirrus</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>vmvga</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>qxl</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtio</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>none</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>bochs</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>ramfb</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </video>
Aug 09 18:17:49 user nova-compute[72418]:     <hostdev supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='mode'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>subsystem</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='startupPolicy'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>default</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>mandatory</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>requisite</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>optional</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='subsysType'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>usb</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>pci</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>scsi</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='capsType'/>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='pciBackend'/>
Aug 09 18:17:49 user nova-compute[72418]:     </hostdev>
Aug 09 18:17:49 user nova-compute[72418]:     <rng supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='model'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtio</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtio-transitional</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtio-non-transitional</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='backendModel'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>random</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>egd</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>builtin</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </rng>
Aug 09 18:17:49 user nova-compute[72418]:     <filesystem supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='driverType'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>path</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>handle</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtiofs</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </filesystem>
Aug 09 18:17:49 user nova-compute[72418]:     <tpm supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='model'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>tpm-tis</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>tpm-crb</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='backendModel'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>passthrough</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>emulator</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </tpm>
Aug 09 18:17:49 user nova-compute[72418]:   </devices>
Aug 09 18:17:49 user nova-compute[72418]:   <features>
Aug 09 18:17:49 user nova-compute[72418]:     <gic supported='no'/>
Aug 09 18:17:49 user nova-compute[72418]:     <vmcoreinfo supported='yes'/>
Aug 09 18:17:49 user nova-compute[72418]:     <genid supported='yes'/>
Aug 09 18:17:49 user nova-compute[72418]:     <backingStoreInput supported='yes'/>
Aug 09 18:17:49 user nova-compute[72418]:     <backup supported='yes'/>
Aug 09 18:17:49 user nova-compute[72418]:     <sev supported='no'/>
Aug 09 18:17:49 user nova-compute[72418]:   </features>
Aug 09 18:17:49 user nova-compute[72418]: </domainCapabilities>
Aug 09 18:17:49 user nova-compute[72418]:  {{(pid=72418) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 09 18:17:49 user nova-compute[72418]: <domainCapabilities>
Aug 09 18:17:49 user nova-compute[72418]:   <path>/usr/bin/qemu-system-i386</path>
Aug 09 18:17:49 user nova-compute[72418]:   <domain>kvm</domain>
Aug 09 18:17:49 user nova-compute[72418]:   <machine>pc-i440fx-6.2</machine>
Aug 09 18:17:49 user nova-compute[72418]:   <arch>i686</arch>
Aug 09 18:17:49 user nova-compute[72418]:   <vcpu max='255'/>
Aug 09 18:17:49 user nova-compute[72418]:   <iothreads supported='yes'/>
Aug 09 18:17:49 user nova-compute[72418]:   <os supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:     <enum name='firmware'/>
Aug 09 18:17:49 user nova-compute[72418]:     <loader supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 09 18:17:49 user nova-compute[72418]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 09 18:17:49 user nova-compute[72418]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 09 18:17:49 user nova-compute[72418]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 09 18:17:49 user nova-compute[72418]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='type'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>rom</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>pflash</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='readonly'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>yes</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>no</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='secure'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>no</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </loader>
Aug 09 18:17:49 user nova-compute[72418]:   </os>
Aug 09 18:17:49 user nova-compute[72418]:   <cpu>
Aug 09 18:17:49 user nova-compute[72418]:     <mode name='host-passthrough' supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='hostPassthroughMigratable'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>off</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </mode>
Aug 09 18:17:49 user nova-compute[72418]:     <mode name='maximum' supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='maximumMigratable'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>on</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>off</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </mode>
Aug 09 18:17:49 user nova-compute[72418]:     <mode name='host-model' supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <vendor>Intel</vendor>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='ss'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='vmx'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='pcid'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='hypervisor'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='arat'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='umip'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='md-clear'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='stibp'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='ssbd'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='ibpb'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='ibrs'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='amd-stibp'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='disable' name='erms'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='disable' name='lm'/>
Aug 09 18:17:49 user nova-compute[72418]:     </mode>
Aug 09 18:17:49 user nova-compute[72418]:     <mode name='custom' supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>qemu64</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>qemu32</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>phenom</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>pentium3</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>pentium2</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>pentium</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>n270</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>kvm64</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>kvm32</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>coreduo</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>core2duo</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>athlon</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Westmere-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Westmere</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Snowridge</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Skylake-Server</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Skylake-Client</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>SandyBridge</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Penryn</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Opteron_G5</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Opteron_G4</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Opteron_G3</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Opteron_G2</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Opteron_G1</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Nehalem-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Nehalem</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>IvyBridge</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Icelake-Server</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Haswell</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>EPYC-Rome</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>EPYC-Milan</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>EPYC</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Dhyana</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Cooperlake</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Conroe</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Broadwell</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>486</model>
Aug 09 18:17:49 user nova-compute[72418]:     </mode>
Aug 09 18:17:49 user nova-compute[72418]:   </cpu>
Aug 09 18:17:49 user nova-compute[72418]:   <memoryBacking supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:     <enum name='sourceType'>
Aug 09 18:17:49 user nova-compute[72418]:       <value>file</value>
Aug 09 18:17:49 user nova-compute[72418]:       <value>anonymous</value>
Aug 09 18:17:49 user nova-compute[72418]:       <value>memfd</value>
Aug 09 18:17:49 user nova-compute[72418]:     </enum>
Aug 09 18:17:49 user nova-compute[72418]:   </memoryBacking>
Aug 09 18:17:49 user nova-compute[72418]:   <devices>
Aug 09 18:17:49 user nova-compute[72418]:     <disk supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='diskDevice'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>disk</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>cdrom</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>floppy</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>lun</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='bus'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>ide</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>fdc</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>scsi</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtio</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>usb</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>sata</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='model'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtio</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtio-transitional</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtio-non-transitional</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </disk>
Aug 09 18:17:49 user nova-compute[72418]:     <graphics supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='type'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>sdl</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>vnc</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>spice</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>egl-headless</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </graphics>
Aug 09 18:17:49 user nova-compute[72418]:     <video supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='modelType'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>vga</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>cirrus</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>vmvga</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>qxl</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtio</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>none</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>bochs</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>ramfb</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </video>
Aug 09 18:17:49 user nova-compute[72418]:     <hostdev supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='mode'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>subsystem</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='startupPolicy'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>default</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>mandatory</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>requisite</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>optional</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='subsysType'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>usb</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>pci</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>scsi</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='capsType'/>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='pciBackend'/>
Aug 09 18:17:49 user nova-compute[72418]:     </hostdev>
Aug 09 18:17:49 user nova-compute[72418]:     <rng supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='model'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtio</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtio-transitional</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtio-non-transitional</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='backendModel'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>random</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>egd</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>builtin</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </rng>
Aug 09 18:17:49 user nova-compute[72418]:     <filesystem supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='driverType'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>path</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>handle</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtiofs</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </filesystem>
Aug 09 18:17:49 user nova-compute[72418]:     <tpm supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='model'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>tpm-tis</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>tpm-crb</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='backendModel'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>passthrough</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>emulator</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </tpm>
Aug 09 18:17:49 user nova-compute[72418]:   </devices>
Aug 09 18:17:49 user nova-compute[72418]:   <features>
Aug 09 18:17:49 user nova-compute[72418]:     <gic supported='no'/>
Aug 09 18:17:49 user nova-compute[72418]:     <vmcoreinfo supported='yes'/>
Aug 09 18:17:49 user nova-compute[72418]:     <genid supported='yes'/>
Aug 09 18:17:49 user nova-compute[72418]:     <backingStoreInput supported='yes'/>
Aug 09 18:17:49 user nova-compute[72418]:     <backup supported='yes'/>
Aug 09 18:17:49 user nova-compute[72418]:     <sev supported='no'/>
Aug 09 18:17:49 user nova-compute[72418]:   </features>
Aug 09 18:17:49 user nova-compute[72418]: </domainCapabilities>
Aug 09 18:17:49 user nova-compute[72418]:  {{(pid=72418) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=72418) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72418) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72418) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=72418) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=72418) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=72418) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=72418) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=72418) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=72418) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=72418) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=72418) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=72418) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=72418) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=72418) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=72418) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=72418) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=72418) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=72418) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72418) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72418) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72418) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=72418) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72418) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72418) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=72418) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=72418) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=72418) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=72418) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=72418) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=72418) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=72418) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=72418) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=72418) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=72418) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=72418) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=72418) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=72418) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=72418) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu', 'ubuntu-q35', 'pc'} {{(pid=72418) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 09 18:17:49 user nova-compute[72418]: <domainCapabilities>
Aug 09 18:17:49 user nova-compute[72418]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 09 18:17:49 user nova-compute[72418]:   <domain>kvm</domain>
Aug 09 18:17:49 user nova-compute[72418]:   <machine>pc-q35-6.2</machine>
Aug 09 18:17:49 user nova-compute[72418]:   <arch>x86_64</arch>
Aug 09 18:17:49 user nova-compute[72418]:   <vcpu max='288'/>
Aug 09 18:17:49 user nova-compute[72418]:   <iothreads supported='yes'/>
Aug 09 18:17:49 user nova-compute[72418]:   <os supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:     <enum name='firmware'>
Aug 09 18:17:49 user nova-compute[72418]:       <value>efi</value>
Aug 09 18:17:49 user nova-compute[72418]:     </enum>
Aug 09 18:17:49 user nova-compute[72418]:     <loader supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 09 18:17:49 user nova-compute[72418]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 09 18:17:49 user nova-compute[72418]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='type'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>rom</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>pflash</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='readonly'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>yes</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>no</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='secure'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>yes</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>no</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </loader>
Aug 09 18:17:49 user nova-compute[72418]:   </os>
Aug 09 18:17:49 user nova-compute[72418]:   <cpu>
Aug 09 18:17:49 user nova-compute[72418]:     <mode name='host-passthrough' supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='hostPassthroughMigratable'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>on</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>off</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </mode>
Aug 09 18:17:49 user nova-compute[72418]:     <mode name='maximum' supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='maximumMigratable'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>on</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>off</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </mode>
Aug 09 18:17:49 user nova-compute[72418]:     <mode name='host-model' supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <vendor>Intel</vendor>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='ss'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='vmx'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='pcid'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='hypervisor'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='arat'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='umip'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='md-clear'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='stibp'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='ssbd'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='invtsc'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='ibpb'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='ibrs'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='amd-stibp'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='rsba'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='pschange-mc-no'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='disable' name='erms'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 18:17:49 user nova-compute[72418]:     </mode>
Aug 09 18:17:49 user nova-compute[72418]:     <mode name='custom' supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>qemu64</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>qemu32</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>phenom</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>pentium3</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>pentium2</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>pentium</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>n270</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>kvm64</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>kvm32</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>coreduo</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>core2duo</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>athlon</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>Westmere-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>Westmere</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Snowridge</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Skylake-Server</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Skylake-Client</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>SandyBridge</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>Penryn</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Opteron_G5</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Opteron_G4</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Opteron_G3</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Opteron_G2</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>Opteron_G1</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>Nehalem</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>IvyBridge</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Icelake-Server</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Haswell</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>EPYC-Rome</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>EPYC-Milan</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>EPYC</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Dhyana</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Cooperlake</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>Conroe</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Broadwell</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>486</model>
Aug 09 18:17:49 user nova-compute[72418]:     </mode>
Aug 09 18:17:49 user nova-compute[72418]:   </cpu>
Aug 09 18:17:49 user nova-compute[72418]:   <memoryBacking supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:     <enum name='sourceType'>
Aug 09 18:17:49 user nova-compute[72418]:       <value>file</value>
Aug 09 18:17:49 user nova-compute[72418]:       <value>anonymous</value>
Aug 09 18:17:49 user nova-compute[72418]:       <value>memfd</value>
Aug 09 18:17:49 user nova-compute[72418]:     </enum>
Aug 09 18:17:49 user nova-compute[72418]:   </memoryBacking>
Aug 09 18:17:49 user nova-compute[72418]:   <devices>
Aug 09 18:17:49 user nova-compute[72418]:     <disk supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='diskDevice'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>disk</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>cdrom</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>floppy</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>lun</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='bus'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>fdc</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>scsi</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtio</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>usb</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>sata</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='model'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtio</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtio-transitional</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtio-non-transitional</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </disk>
Aug 09 18:17:49 user nova-compute[72418]:     <graphics supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='type'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>sdl</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>vnc</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>spice</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>egl-headless</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </graphics>
Aug 09 18:17:49 user nova-compute[72418]:     <video supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='modelType'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>vga</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>cirrus</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>vmvga</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>qxl</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtio</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>none</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>bochs</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>ramfb</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </video>
Aug 09 18:17:49 user nova-compute[72418]:     <hostdev supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='mode'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>subsystem</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='startupPolicy'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>default</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>mandatory</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>requisite</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>optional</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='subsysType'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>usb</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>pci</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>scsi</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='capsType'/>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='pciBackend'/>
Aug 09 18:17:49 user nova-compute[72418]:     </hostdev>
Aug 09 18:17:49 user nova-compute[72418]:     <rng supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='model'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtio</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtio-transitional</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtio-non-transitional</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='backendModel'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>random</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>egd</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>builtin</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </rng>
Aug 09 18:17:49 user nova-compute[72418]:     <filesystem supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='driverType'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>path</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>handle</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtiofs</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </filesystem>
Aug 09 18:17:49 user nova-compute[72418]:     <tpm supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='model'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>tpm-tis</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>tpm-crb</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='backendModel'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>passthrough</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>emulator</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </tpm>
Aug 09 18:17:49 user nova-compute[72418]:   </devices>
Aug 09 18:17:49 user nova-compute[72418]:   <features>
Aug 09 18:17:49 user nova-compute[72418]:     <gic supported='no'/>
Aug 09 18:17:49 user nova-compute[72418]:     <vmcoreinfo supported='yes'/>
Aug 09 18:17:49 user nova-compute[72418]:     <genid supported='yes'/>
Aug 09 18:17:49 user nova-compute[72418]:     <backingStoreInput supported='yes'/>
Aug 09 18:17:49 user nova-compute[72418]:     <backup supported='yes'/>
Aug 09 18:17:49 user nova-compute[72418]:     <sev supported='no'/>
Aug 09 18:17:49 user nova-compute[72418]:   </features>
Aug 09 18:17:49 user nova-compute[72418]: </domainCapabilities>
Aug 09 18:17:49 user nova-compute[72418]:  {{(pid=72418) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 09 18:17:49 user nova-compute[72418]: <domainCapabilities>
Aug 09 18:17:49 user nova-compute[72418]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 09 18:17:49 user nova-compute[72418]:   <domain>kvm</domain>
Aug 09 18:17:49 user nova-compute[72418]:   <machine>pc-i440fx-jammy</machine>
Aug 09 18:17:49 user nova-compute[72418]:   <arch>x86_64</arch>
Aug 09 18:17:49 user nova-compute[72418]:   <vcpu max='255'/>
Aug 09 18:17:49 user nova-compute[72418]:   <iothreads supported='yes'/>
Aug 09 18:17:49 user nova-compute[72418]:   <os supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:     <enum name='firmware'>
Aug 09 18:17:49 user nova-compute[72418]:       <value>efi</value>
Aug 09 18:17:49 user nova-compute[72418]:     </enum>
Aug 09 18:17:49 user nova-compute[72418]:     <loader supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='type'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>rom</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>pflash</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='readonly'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>yes</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>no</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='secure'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>no</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </loader>
Aug 09 18:17:49 user nova-compute[72418]:   </os>
Aug 09 18:17:49 user nova-compute[72418]:   <cpu>
Aug 09 18:17:49 user nova-compute[72418]:     <mode name='host-passthrough' supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='hostPassthroughMigratable'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>on</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>off</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </mode>
Aug 09 18:17:49 user nova-compute[72418]:     <mode name='maximum' supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='maximumMigratable'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>on</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>off</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </mode>
Aug 09 18:17:49 user nova-compute[72418]:     <mode name='host-model' supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <vendor>Intel</vendor>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='ss'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='vmx'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='pcid'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='hypervisor'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='arat'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='umip'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='md-clear'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='stibp'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='ssbd'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='invtsc'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='ibpb'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='ibrs'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='amd-stibp'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='rsba'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='pschange-mc-no'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='disable' name='erms'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 18:17:49 user nova-compute[72418]:     </mode>
Aug 09 18:17:49 user nova-compute[72418]:     <mode name='custom' supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>qemu64</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>qemu32</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>phenom</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>pentium3</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>pentium2</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>pentium</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>n270</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>kvm64</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>kvm32</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>coreduo</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>core2duo</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>athlon</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>Westmere-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>Westmere</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Snowridge</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Skylake-Server</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Skylake-Client</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>SandyBridge</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>Penryn</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Opteron_G5</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Opteron_G4</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Opteron_G3</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Opteron_G2</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>Opteron_G1</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>Nehalem</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>IvyBridge</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Icelake-Server</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Haswell</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>EPYC-Rome</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>EPYC-Milan</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>EPYC</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Dhyana</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Cooperlake</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>Conroe</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Broadwell</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>486</model>
Aug 09 18:17:49 user nova-compute[72418]:     </mode>
Aug 09 18:17:49 user nova-compute[72418]:   </cpu>
Aug 09 18:17:49 user nova-compute[72418]:   <memoryBacking supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:     <enum name='sourceType'>
Aug 09 18:17:49 user nova-compute[72418]:       <value>file</value>
Aug 09 18:17:49 user nova-compute[72418]:       <value>anonymous</value>
Aug 09 18:17:49 user nova-compute[72418]:       <value>memfd</value>
Aug 09 18:17:49 user nova-compute[72418]:     </enum>
Aug 09 18:17:49 user nova-compute[72418]:   </memoryBacking>
Aug 09 18:17:49 user nova-compute[72418]:   <devices>
Aug 09 18:17:49 user nova-compute[72418]:     <disk supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='diskDevice'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>disk</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>cdrom</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>floppy</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>lun</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='bus'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>ide</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>fdc</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>scsi</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtio</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>usb</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>sata</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='model'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtio</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtio-transitional</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtio-non-transitional</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </disk>
Aug 09 18:17:49 user nova-compute[72418]:     <graphics supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='type'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>sdl</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>vnc</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>spice</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>egl-headless</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </graphics>
Aug 09 18:17:49 user nova-compute[72418]:     <video supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='modelType'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>vga</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>cirrus</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>vmvga</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>qxl</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtio</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>none</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>bochs</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>ramfb</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </video>
Aug 09 18:17:49 user nova-compute[72418]:     <hostdev supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='mode'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>subsystem</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='startupPolicy'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>default</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>mandatory</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>requisite</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>optional</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='subsysType'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>usb</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>pci</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>scsi</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='capsType'/>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='pciBackend'/>
Aug 09 18:17:49 user nova-compute[72418]:     </hostdev>
Aug 09 18:17:49 user nova-compute[72418]:     <rng supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='model'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtio</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtio-transitional</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtio-non-transitional</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='backendModel'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>random</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>egd</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>builtin</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </rng>
Aug 09 18:17:49 user nova-compute[72418]:     <filesystem supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='driverType'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>path</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>handle</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtiofs</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </filesystem>
Aug 09 18:17:49 user nova-compute[72418]:     <tpm supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='model'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>tpm-tis</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>tpm-crb</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='backendModel'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>passthrough</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>emulator</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </tpm>
Aug 09 18:17:49 user nova-compute[72418]:   </devices>
Aug 09 18:17:49 user nova-compute[72418]:   <features>
Aug 09 18:17:49 user nova-compute[72418]:     <gic supported='no'/>
Aug 09 18:17:49 user nova-compute[72418]:     <vmcoreinfo supported='yes'/>
Aug 09 18:17:49 user nova-compute[72418]:     <genid supported='yes'/>
Aug 09 18:17:49 user nova-compute[72418]:     <backingStoreInput supported='yes'/>
Aug 09 18:17:49 user nova-compute[72418]:     <backup supported='yes'/>
Aug 09 18:17:49 user nova-compute[72418]:     <sev supported='no'/>
Aug 09 18:17:49 user nova-compute[72418]:   </features>
Aug 09 18:17:49 user nova-compute[72418]: </domainCapabilities>
Aug 09 18:17:49 user nova-compute[72418]:  {{(pid=72418) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 09 18:17:49 user nova-compute[72418]: <domainCapabilities>
Aug 09 18:17:49 user nova-compute[72418]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 09 18:17:49 user nova-compute[72418]:   <domain>kvm</domain>
Aug 09 18:17:49 user nova-compute[72418]:   <machine>pc-q35-jammy</machine>
Aug 09 18:17:49 user nova-compute[72418]:   <arch>x86_64</arch>
Aug 09 18:17:49 user nova-compute[72418]:   <vcpu max='288'/>
Aug 09 18:17:49 user nova-compute[72418]:   <iothreads supported='yes'/>
Aug 09 18:17:49 user nova-compute[72418]:   <os supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:     <enum name='firmware'>
Aug 09 18:17:49 user nova-compute[72418]:       <value>efi</value>
Aug 09 18:17:49 user nova-compute[72418]:     </enum>
Aug 09 18:17:49 user nova-compute[72418]:     <loader supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 09 18:17:49 user nova-compute[72418]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 09 18:17:49 user nova-compute[72418]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='type'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>rom</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>pflash</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='readonly'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>yes</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>no</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='secure'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>yes</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>no</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </loader>
Aug 09 18:17:49 user nova-compute[72418]:   </os>
Aug 09 18:17:49 user nova-compute[72418]:   <cpu>
Aug 09 18:17:49 user nova-compute[72418]:     <mode name='host-passthrough' supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='hostPassthroughMigratable'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>on</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>off</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </mode>
Aug 09 18:17:49 user nova-compute[72418]:     <mode name='maximum' supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='maximumMigratable'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>on</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>off</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </mode>
Aug 09 18:17:49 user nova-compute[72418]:     <mode name='host-model' supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <vendor>Intel</vendor>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='ss'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='vmx'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='pcid'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='hypervisor'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='arat'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='umip'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='md-clear'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='stibp'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='ssbd'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='invtsc'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='ibpb'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='ibrs'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='amd-stibp'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='rsba'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='pschange-mc-no'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='disable' name='erms'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 18:17:49 user nova-compute[72418]:     </mode>
Aug 09 18:17:49 user nova-compute[72418]:     <mode name='custom' supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>qemu64</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>qemu32</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>phenom</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>pentium3</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>pentium2</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>pentium</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>n270</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>kvm64</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>kvm32</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>coreduo</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>core2duo</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>athlon</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>Westmere-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>Westmere</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Snowridge</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Skylake-Server</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Skylake-Client</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>SandyBridge</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>Penryn</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Opteron_G5</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Opteron_G4</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Opteron_G3</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Opteron_G2</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>Opteron_G1</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>Nehalem</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>IvyBridge</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Icelake-Server</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Haswell</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>EPYC-Rome</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>EPYC-Milan</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>EPYC</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Dhyana</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Cooperlake</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>Conroe</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Broadwell</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>486</model>
Aug 09 18:17:49 user nova-compute[72418]:     </mode>
Aug 09 18:17:49 user nova-compute[72418]:   </cpu>
Aug 09 18:17:49 user nova-compute[72418]:   <memoryBacking supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:     <enum name='sourceType'>
Aug 09 18:17:49 user nova-compute[72418]:       <value>file</value>
Aug 09 18:17:49 user nova-compute[72418]:       <value>anonymous</value>
Aug 09 18:17:49 user nova-compute[72418]:       <value>memfd</value>
Aug 09 18:17:49 user nova-compute[72418]:     </enum>
Aug 09 18:17:49 user nova-compute[72418]:   </memoryBacking>
Aug 09 18:17:49 user nova-compute[72418]:   <devices>
Aug 09 18:17:49 user nova-compute[72418]:     <disk supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='diskDevice'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>disk</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>cdrom</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>floppy</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>lun</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='bus'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>fdc</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>scsi</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtio</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>usb</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>sata</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='model'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtio</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtio-transitional</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtio-non-transitional</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </disk>
Aug 09 18:17:49 user nova-compute[72418]:     <graphics supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='type'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>sdl</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>vnc</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>spice</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>egl-headless</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </graphics>
Aug 09 18:17:49 user nova-compute[72418]:     <video supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='modelType'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>vga</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>cirrus</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>vmvga</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>qxl</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtio</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>none</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>bochs</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>ramfb</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </video>
Aug 09 18:17:49 user nova-compute[72418]:     <hostdev supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='mode'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>subsystem</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='startupPolicy'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>default</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>mandatory</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>requisite</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>optional</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='subsysType'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>usb</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>pci</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>scsi</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='capsType'/>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='pciBackend'/>
Aug 09 18:17:49 user nova-compute[72418]:     </hostdev>
Aug 09 18:17:49 user nova-compute[72418]:     <rng supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='model'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtio</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtio-transitional</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtio-non-transitional</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='backendModel'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>random</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>egd</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>builtin</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </rng>
Aug 09 18:17:49 user nova-compute[72418]:     <filesystem supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='driverType'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>path</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>handle</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtiofs</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </filesystem>
Aug 09 18:17:49 user nova-compute[72418]:     <tpm supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='model'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>tpm-tis</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>tpm-crb</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='backendModel'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>passthrough</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>emulator</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </tpm>
Aug 09 18:17:49 user nova-compute[72418]:   </devices>
Aug 09 18:17:49 user nova-compute[72418]:   <features>
Aug 09 18:17:49 user nova-compute[72418]:     <gic supported='no'/>
Aug 09 18:17:49 user nova-compute[72418]:     <vmcoreinfo supported='yes'/>
Aug 09 18:17:49 user nova-compute[72418]:     <genid supported='yes'/>
Aug 09 18:17:49 user nova-compute[72418]:     <backingStoreInput supported='yes'/>
Aug 09 18:17:49 user nova-compute[72418]:     <backup supported='yes'/>
Aug 09 18:17:49 user nova-compute[72418]:     <sev supported='no'/>
Aug 09 18:17:49 user nova-compute[72418]:   </features>
Aug 09 18:17:49 user nova-compute[72418]: </domainCapabilities>
Aug 09 18:17:49 user nova-compute[72418]:  {{(pid=72418) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 09 18:17:49 user nova-compute[72418]: <domainCapabilities>
Aug 09 18:17:49 user nova-compute[72418]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 09 18:17:49 user nova-compute[72418]:   <domain>kvm</domain>
Aug 09 18:17:49 user nova-compute[72418]:   <machine>pc-i440fx-6.2</machine>
Aug 09 18:17:49 user nova-compute[72418]:   <arch>x86_64</arch>
Aug 09 18:17:49 user nova-compute[72418]:   <vcpu max='255'/>
Aug 09 18:17:49 user nova-compute[72418]:   <iothreads supported='yes'/>
Aug 09 18:17:49 user nova-compute[72418]:   <os supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:     <enum name='firmware'>
Aug 09 18:17:49 user nova-compute[72418]:       <value>efi</value>
Aug 09 18:17:49 user nova-compute[72418]:     </enum>
Aug 09 18:17:49 user nova-compute[72418]:     <loader supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='type'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>rom</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>pflash</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='readonly'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>yes</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>no</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='secure'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>no</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </loader>
Aug 09 18:17:49 user nova-compute[72418]:   </os>
Aug 09 18:17:49 user nova-compute[72418]:   <cpu>
Aug 09 18:17:49 user nova-compute[72418]:     <mode name='host-passthrough' supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='hostPassthroughMigratable'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>on</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>off</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </mode>
Aug 09 18:17:49 user nova-compute[72418]:     <mode name='maximum' supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='maximumMigratable'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>on</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>off</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </mode>
Aug 09 18:17:49 user nova-compute[72418]:     <mode name='host-model' supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <vendor>Intel</vendor>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='ss'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='vmx'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='pcid'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='hypervisor'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='arat'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='umip'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='md-clear'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='stibp'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='ssbd'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='invtsc'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='ibpb'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='ibrs'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='amd-stibp'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='rsba'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='require' name='pschange-mc-no'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='disable' name='erms'/>
Aug 09 18:17:49 user nova-compute[72418]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 18:17:49 user nova-compute[72418]:     </mode>
Aug 09 18:17:49 user nova-compute[72418]:     <mode name='custom' supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>qemu64</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>qemu32</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>phenom</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>pentium3</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>pentium2</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>pentium</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>n270</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>kvm64</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>kvm32</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>coreduo</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>core2duo</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>athlon</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>Westmere-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>Westmere</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Snowridge</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Skylake-Server</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Skylake-Client</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>SandyBridge</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>Penryn</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Opteron_G5</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Opteron_G4</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Opteron_G3</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Opteron_G2</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>Opteron_G1</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>Nehalem</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>IvyBridge</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Icelake-Server</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Haswell</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>EPYC-Rome</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>EPYC-Milan</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>EPYC</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Dhyana</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Cooperlake</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>Conroe</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='no'>Broadwell</model>
Aug 09 18:17:49 user nova-compute[72418]:       <model usable='yes'>486</model>
Aug 09 18:17:49 user nova-compute[72418]:     </mode>
Aug 09 18:17:49 user nova-compute[72418]:   </cpu>
Aug 09 18:17:49 user nova-compute[72418]:   <memoryBacking supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:     <enum name='sourceType'>
Aug 09 18:17:49 user nova-compute[72418]:       <value>file</value>
Aug 09 18:17:49 user nova-compute[72418]:       <value>anonymous</value>
Aug 09 18:17:49 user nova-compute[72418]:       <value>memfd</value>
Aug 09 18:17:49 user nova-compute[72418]:     </enum>
Aug 09 18:17:49 user nova-compute[72418]:   </memoryBacking>
Aug 09 18:17:49 user nova-compute[72418]:   <devices>
Aug 09 18:17:49 user nova-compute[72418]:     <disk supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='diskDevice'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>disk</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>cdrom</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>floppy</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>lun</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='bus'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>ide</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>fdc</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>scsi</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtio</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>usb</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>sata</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='model'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtio</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtio-transitional</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtio-non-transitional</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </disk>
Aug 09 18:17:49 user nova-compute[72418]:     <graphics supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='type'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>sdl</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>vnc</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>spice</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>egl-headless</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </graphics>
Aug 09 18:17:49 user nova-compute[72418]:     <video supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='modelType'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>vga</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>cirrus</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>vmvga</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>qxl</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtio</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>none</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>bochs</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>ramfb</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </video>
Aug 09 18:17:49 user nova-compute[72418]:     <hostdev supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='mode'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>subsystem</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='startupPolicy'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>default</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>mandatory</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>requisite</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>optional</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='subsysType'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>usb</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>pci</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>scsi</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='capsType'/>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='pciBackend'/>
Aug 09 18:17:49 user nova-compute[72418]:     </hostdev>
Aug 09 18:17:49 user nova-compute[72418]:     <rng supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='model'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtio</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtio-transitional</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtio-non-transitional</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='backendModel'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>random</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>egd</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>builtin</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </rng>
Aug 09 18:17:49 user nova-compute[72418]:     <filesystem supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='driverType'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>path</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>handle</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>virtiofs</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </filesystem>
Aug 09 18:17:49 user nova-compute[72418]:     <tpm supported='yes'>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='model'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>tpm-tis</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>tpm-crb</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:       <enum name='backendModel'>
Aug 09 18:17:49 user nova-compute[72418]:         <value>passthrough</value>
Aug 09 18:17:49 user nova-compute[72418]:         <value>emulator</value>
Aug 09 18:17:49 user nova-compute[72418]:       </enum>
Aug 09 18:17:49 user nova-compute[72418]:     </tpm>
Aug 09 18:17:49 user nova-compute[72418]:   </devices>
Aug 09 18:17:49 user nova-compute[72418]:   <features>
Aug 09 18:17:49 user nova-compute[72418]:     <gic supported='no'/>
Aug 09 18:17:49 user nova-compute[72418]:     <vmcoreinfo supported='yes'/>
Aug 09 18:17:49 user nova-compute[72418]:     <genid supported='yes'/>
Aug 09 18:17:49 user nova-compute[72418]:     <backingStoreInput supported='yes'/>
Aug 09 18:17:49 user nova-compute[72418]:     <backup supported='yes'/>
Aug 09 18:17:49 user nova-compute[72418]:     <sev supported='no'/>
Aug 09 18:17:49 user nova-compute[72418]:   </features>
Aug 09 18:17:49 user nova-compute[72418]: </domainCapabilities>
Aug 09 18:17:49 user nova-compute[72418]:  {{(pid=72418) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=72418) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=72418) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=72418) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=72418) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Checking secure boot support for host arch (x86_64) {{(pid=72418) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 09 18:17:49 user nova-compute[72418]: INFO nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Secure Boot support detected
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] cpu compare xml: <cpu match="exact">
Aug 09 18:17:49 user nova-compute[72418]:   <model>Nehalem</model>
Aug 09 18:17:49 user nova-compute[72418]: </cpu>
Aug 09 18:17:49 user nova-compute[72418]:  {{(pid=72418) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 09 18:17:49 user nova-compute[72418]: INFO nova.virt.node [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Generated node identity 50628e48-0a01-4c3f-9ff5-2a66453cd194
Aug 09 18:17:49 user nova-compute[72418]: INFO nova.virt.node [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Wrote node identity 50628e48-0a01-4c3f-9ff5-2a66453cd194 to /opt/stack/data/nova/compute_id
Aug 09 18:17:49 user nova-compute[72418]: WARNING nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Compute nodes ['50628e48-0a01-4c3f-9ff5-2a66453cd194'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 09 18:17:49 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 09 18:17:49 user nova-compute[72418]: WARNING nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 09 18:17:49 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Auditing locally available compute resources for user (node: user) {{(pid=72418) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 18:17:49 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:17:49 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Hypervisor/Node resource view: name=user free_ram=10871MB free_disk=26.474620819091797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72418) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:17:49 user nova-compute[72418]: WARNING nova.compute.resource_tracker [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] No compute node record for user:50628e48-0a01-4c3f-9ff5-2a66453cd194: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 50628e48-0a01-4c3f-9ff5-2a66453cd194 could not be found.
Aug 09 18:17:49 user nova-compute[72418]: INFO nova.compute.resource_tracker [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Compute node record created for user:user with uuid: 50628e48-0a01-4c3f-9ff5-2a66453cd194
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 18:17:49 user nova-compute[72418]: INFO nova.scheduler.client.report [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [req-a7befffd-5d19-4b3c-8c91-6d759ec50ad9] Created resource provider record via placement API for resource provider with UUID 50628e48-0a01-4c3f-9ff5-2a66453cd194 and name user.
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=72418) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 09 18:17:49 user nova-compute[72418]: INFO nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] kernel doesn't support AMD SEV
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Updating inventory in ProviderTree for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72418) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Libvirt baseline CPU <cpu>
Aug 09 18:17:49 user nova-compute[72418]:   <arch>x86_64</arch>
Aug 09 18:17:49 user nova-compute[72418]:   <model>Nehalem</model>
Aug 09 18:17:49 user nova-compute[72418]:   <vendor>Intel</vendor>
Aug 09 18:17:49 user nova-compute[72418]:   <topology sockets="6" cores="1" threads="1"/>
Aug 09 18:17:49 user nova-compute[72418]: </cpu>
Aug 09 18:17:49 user nova-compute[72418]:  {{(pid=72418) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Updated inventory for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Updating resource provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 generation from 0 to 1 during operation: update_inventory {{(pid=72418) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 09 18:17:49 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Updating inventory in ProviderTree for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 18:17:50 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Updating resource provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 generation from 1 to 2 during operation: update_traits {{(pid=72418) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 09 18:17:50 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Compute_service record updated for user:user {{(pid=72418) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 18:17:50 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.602s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:17:50 user nova-compute[72418]: DEBUG nova.service [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Creating RPC server for service compute {{(pid=72418) start /opt/stack/nova/nova/service.py:182}}
Aug 09 18:17:50 user nova-compute[72418]: DEBUG nova.service [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Join ServiceGroup membership for this service compute {{(pid=72418) start /opt/stack/nova/nova/service.py:199}}
Aug 09 18:17:50 user nova-compute[72418]: DEBUG nova.servicegroup.drivers.db [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=72418) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 09 18:18:41 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:18:41 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:18:41 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Starting heal instance info cache {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 18:18:41 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Rebuilding the list of instances to heal {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 18:18:41 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Didn't find any instances for network info cache update. {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 18:18:41 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:18:41 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:18:41 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:18:41 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:18:41 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:18:41 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:18:41 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:18:41 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72418) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 18:18:41 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:18:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:18:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:18:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:18:41 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Auditing locally available compute resources for user (node: user) {{(pid=72418) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 18:18:41 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:18:41 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:18:41 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Hypervisor/Node resource view: name=user free_ram=10229MB free_disk=26.378360748291016GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72418) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 18:18:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:18:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:18:41 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 18:18:41 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 18:18:41 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:18:41 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:18:41 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Compute_service record updated for user:user {{(pid=72418) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 18:18:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.174s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:18:41 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:19:41 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:19:41 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:19:41 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:19:41 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:19:41 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:19:41 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72418) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 18:19:41 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:19:41 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:19:41 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:19:42 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:19:42 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Starting heal instance info cache {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 18:19:42 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Rebuilding the list of instances to heal {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 18:19:42 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Didn't find any instances for network info cache update. {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 18:19:42 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:19:42 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:19:42 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:19:42 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:19:42 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Auditing locally available compute resources for user (node: user) {{(pid=72418) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 18:19:43 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:19:43 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:19:43 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Hypervisor/Node resource view: name=user free_ram=10210MB free_disk=26.422237396240234GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72418) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 18:19:43 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:19:43 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:19:43 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 18:19:43 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 18:19:43 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:19:43 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:19:43 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Compute_service record updated for user:user {{(pid=72418) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 18:19:43 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.100s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:20:41 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:20:41 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:20:41 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:20:41 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72418) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 18:20:42 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:20:42 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:20:42 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:20:42 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:20:44 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:20:44 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Starting heal instance info cache {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 18:20:44 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Rebuilding the list of instances to heal {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 18:20:44 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Didn't find any instances for network info cache update. {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 18:20:44 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:20:44 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:20:44 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:20:44 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:20:44 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Auditing locally available compute resources for user (node: user) {{(pid=72418) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 18:20:45 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:20:45 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:20:45 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Hypervisor/Node resource view: name=user free_ram=10170MB free_disk=26.197349548339844GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72418) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 18:20:45 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:20:45 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:20:45 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 18:20:45 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 18:20:45 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:20:45 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:20:45 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Compute_service record updated for user:user {{(pid=72418) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 18:20:45 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.107s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:21:42 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:21:42 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:21:42 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72418) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 18:21:42 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:21:42 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:21:43 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:21:43 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:21:44 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:21:44 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:21:44 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:21:44 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:21:44 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:21:44 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:21:44 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Auditing locally available compute resources for user (node: user) {{(pid=72418) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 18:21:45 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:21:45 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:21:45 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Hypervisor/Node resource view: name=user free_ram=9477MB free_disk=26.220012664794922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72418) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 18:21:45 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:21:45 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:21:45 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 18:21:45 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 18:21:45 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:21:45 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:21:45 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Compute_service record updated for user:user {{(pid=72418) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 18:21:45 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.133s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:21:47 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:21:47 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Starting heal instance info cache {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 18:21:47 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Rebuilding the list of instances to heal {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 18:21:47 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Didn't find any instances for network info cache update. {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 18:21:51 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Acquiring lock "6af7918a-ce90-45ab-93d8-684e1489e891" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:21:51 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "6af7918a-ce90-45ab-93d8-684e1489e891" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:21:51 user nova-compute[72418]: DEBUG nova.compute.manager [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Starting instance... {{(pid=72418) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 18:21:52 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquiring lock "8fe41968-a219-4a5a-afdb-32eb2082bb40" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:21:52 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "8fe41968-a219-4a5a-afdb-32eb2082bb40" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:21:52 user nova-compute[72418]: DEBUG nova.compute.manager [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Starting instance... {{(pid=72418) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 18:21:52 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:21:52 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:21:52 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72418) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 18:21:52 user nova-compute[72418]: INFO nova.compute.claims [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Claim successful on node user
Aug 09 18:21:52 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Acquiring lock "17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:21:52 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Lock "17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:21:52 user nova-compute[72418]: DEBUG nova.compute.manager [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Starting instance... {{(pid=72418) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 18:21:52 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:21:52 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:21:52 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:21:52 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:21:52 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.416s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:21:52 user nova-compute[72418]: DEBUG nova.compute.manager [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Start building networks asynchronously for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 18:21:52 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.195s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:21:52 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72418) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 18:21:52 user nova-compute[72418]: INFO nova.compute.claims [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Claim successful on node user
Aug 09 18:21:52 user nova-compute[72418]: DEBUG nova.compute.manager [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Allocating IP information in the background. {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 18:21:52 user nova-compute[72418]: DEBUG nova.network.neutron [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] allocate_for_instance() {{(pid=72418) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 18:21:52 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 18:21:52 user nova-compute[72418]: DEBUG nova.compute.manager [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Start building block device mappings for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 18:21:52 user nova-compute[72418]: DEBUG nova.compute.manager [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Start spawning the instance on the hypervisor. {{(pid=72418) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 18:21:52 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Creating instance directory {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 18:21:52 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Creating image(s)
Aug 09 18:21:52 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Acquiring lock "/opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:21:52 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "/opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:21:52 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "/opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:21:52 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Acquiring lock "458773cfa7230b717e41c60277832e9f83806d71" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:21:52 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:21:52 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:21:53 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:21:53 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.528s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:21:53 user nova-compute[72418]: DEBUG nova.compute.manager [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Start building networks asynchronously for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 18:21:53 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.713s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:21:53 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72418) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 18:21:53 user nova-compute[72418]: INFO nova.compute.claims [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Claim successful on node user
Aug 09 18:21:53 user nova-compute[72418]: DEBUG nova.policy [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b3c4feb0a14841eeb757a79b6a05d1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c68622cd79472ba6ad14a6876aeaea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72418) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 18:21:53 user nova-compute[72418]: DEBUG nova.compute.manager [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Allocating IP information in the background. {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 18:21:53 user nova-compute[72418]: DEBUG nova.network.neutron [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] allocate_for_instance() {{(pid=72418) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 18:21:53 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 18:21:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71.part --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:21:53 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Acquiring lock "01c46b33-6788-44a5-a43c-88ee4acc4d39" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:21:53 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "01c46b33-6788-44a5-a43c-88ee4acc4d39" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:21:53 user nova-compute[72418]: DEBUG nova.policy [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '621fd2b971c543d197a354c38e0d1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e5863cda54487682a4edcc24202c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72418) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 18:21:53 user nova-compute[72418]: DEBUG nova.compute.manager [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Start building block device mappings for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 18:21:53 user nova-compute[72418]: DEBUG nova.compute.manager [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Starting instance... {{(pid=72418) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 18:21:53 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Acquiring lock "479ea4c3-ad7f-4da0-a901-defe46d96065" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:21:53 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Lock "479ea4c3-ad7f-4da0-a901-defe46d96065" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:21:53 user nova-compute[72418]: DEBUG nova.compute.manager [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Starting instance... {{(pid=72418) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 18:21:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71.part --force-share --output=json" returned: 0 in 0.165s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:21:53 user nova-compute[72418]: DEBUG nova.virt.images [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] 8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e was qcow2, converting to raw {{(pid=72418) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 18:21:53 user nova-compute[72418]: DEBUG nova.privsep.utils [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72418) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 18:21:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71.part /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71.converted {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:21:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:21:54 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:21:54 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:21:54 user nova-compute[72418]: DEBUG nova.compute.manager [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Start spawning the instance on the hypervisor. {{(pid=72418) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 18:21:54 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Creating instance directory {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 18:21:54 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Creating image(s)
Aug 09 18:21:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquiring lock "/opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:21:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "/opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:21:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "/opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:21:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquiring lock "458773cfa7230b717e41c60277832e9f83806d71" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:21:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:21:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.057s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:21:54 user nova-compute[72418]: DEBUG nova.compute.manager [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Start building networks asynchronously for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 18:21:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.075s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:21:54 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72418) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 18:21:54 user nova-compute[72418]: INFO nova.compute.claims [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Claim successful on node user
Aug 09 18:21:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71.part /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71.converted" returned: 0 in 0.202s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:21:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71.converted --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:21:54 user nova-compute[72418]: DEBUG nova.compute.manager [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Allocating IP information in the background. {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 18:21:54 user nova-compute[72418]: DEBUG nova.network.neutron [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] allocate_for_instance() {{(pid=72418) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 18:21:54 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 18:21:54 user nova-compute[72418]: DEBUG nova.compute.manager [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Start building block device mappings for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 18:21:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71.converted --force-share --output=json" returned: 0 in 0.144s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:21:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.377s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:21:54 user nova-compute[72418]: INFO oslo.privsep.daemon [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpl6qgmudc/privsep.sock']
Aug 09 18:21:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.232s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:21:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:21:54 user sudo[81570]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpl6qgmudc/privsep.sock
Aug 09 18:21:54 user sudo[81570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 09 18:21:54 user nova-compute[72418]: DEBUG nova.compute.manager [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Start spawning the instance on the hypervisor. {{(pid=72418) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 18:21:54 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Creating instance directory {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 18:21:54 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Creating image(s)
Aug 09 18:21:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Acquiring lock "/opt/stack/data/nova/instances/17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:21:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Lock "/opt/stack/data/nova/instances/17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:21:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Lock "/opt/stack/data/nova/instances/17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:21:54 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:21:54 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:21:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.414s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:21:54 user nova-compute[72418]: DEBUG nova.compute.manager [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Start building networks asynchronously for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 18:21:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.445s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:21:54 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72418) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 18:21:54 user nova-compute[72418]: INFO nova.compute.claims [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Claim successful on node user
Aug 09 18:21:54 user nova-compute[72418]: DEBUG nova.compute.manager [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Allocating IP information in the background. {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 18:21:54 user nova-compute[72418]: DEBUG nova.network.neutron [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] allocate_for_instance() {{(pid=72418) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 18:21:54 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 18:21:54 user nova-compute[72418]: DEBUG nova.compute.manager [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Start building block device mappings for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 18:21:54 user nova-compute[72418]: DEBUG nova.policy [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '55f358ec00924ae69a00e3718cbc3f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc13d02ace44ca1a9ae7bf264a784cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72418) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 18:21:54 user nova-compute[72418]: DEBUG nova.compute.manager [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Start spawning the instance on the hypervisor. {{(pid=72418) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 18:21:54 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Creating instance directory {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 18:21:54 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Creating image(s)
Aug 09 18:21:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Acquiring lock "/opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:21:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "/opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:21:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "/opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:21:54 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:21:54 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:21:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.397s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:21:54 user nova-compute[72418]: DEBUG nova.compute.manager [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Start building networks asynchronously for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 18:21:55 user nova-compute[72418]: DEBUG nova.compute.manager [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Allocating IP information in the background. {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 18:21:55 user nova-compute[72418]: DEBUG nova.network.neutron [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] allocate_for_instance() {{(pid=72418) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 18:21:55 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 18:21:55 user nova-compute[72418]: DEBUG nova.compute.manager [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Start building block device mappings for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 18:21:55 user nova-compute[72418]: DEBUG nova.policy [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b3c4feb0a14841eeb757a79b6a05d1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c68622cd79472ba6ad14a6876aeaea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72418) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 18:21:55 user nova-compute[72418]: DEBUG nova.compute.manager [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Start spawning the instance on the hypervisor. {{(pid=72418) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 18:21:55 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Creating instance directory {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 18:21:55 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Creating image(s)
Aug 09 18:21:55 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Acquiring lock "/opt/stack/data/nova/instances/479ea4c3-ad7f-4da0-a901-defe46d96065/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:21:55 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Lock "/opt/stack/data/nova/instances/479ea4c3-ad7f-4da0-a901-defe46d96065/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:21:55 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Lock "/opt/stack/data/nova/instances/479ea4c3-ad7f-4da0-a901-defe46d96065/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:21:55 user nova-compute[72418]: DEBUG nova.network.neutron [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Successfully created port: 2b44ecc4-13c5-43ba-8425-5f42d86bc716 {{(pid=72418) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 18:21:55 user nova-compute[72418]: DEBUG nova.policy [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6e1439f58ac640f481a59944ee145f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60e3274c2e3447fcad6d1f16765f4afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72418) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 18:21:56 user sudo[81570]: pam_unix(sudo:session): session closed for user root
Aug 09 18:21:56 user nova-compute[72418]: INFO oslo.privsep.daemon [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Spawned new privsep daemon via rootwrap
Aug 09 18:21:56 user nova-compute[72418]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 09 18:21:56 user nova-compute[72418]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 09 18:21:56 user nova-compute[72418]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 09 18:21:56 user nova-compute[72418]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81577
Aug 09 18:21:56 user nova-compute[72418]: WARNING oslo_privsep.priv_context [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] privsep daemon already running
Aug 09 18:21:56 user nova-compute[72418]: WARNING oslo_privsep.priv_context [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] privsep daemon already running
Aug 09 18:21:56 user nova-compute[72418]: WARNING oslo_privsep.priv_context [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] privsep daemon already running
Aug 09 18:21:56 user nova-compute[72418]: WARNING oslo_privsep.priv_context [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] privsep daemon already running
Aug 09 18:21:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:21:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:21:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:21:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:21:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:21:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.146s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:21:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.182s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:21:56 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Acquiring lock "458773cfa7230b717e41c60277832e9f83806d71" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:21:56 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:21:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:21:56 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Acquiring lock "458773cfa7230b717e41c60277832e9f83806d71" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:21:56 user nova-compute[72418]: DEBUG nova.network.neutron [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Successfully created port: 2e2b5832-b357-4012-8bfc-d26009aa91f8 {{(pid=72418) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 18:21:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.158s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:21:56 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquiring lock "458773cfa7230b717e41c60277832e9f83806d71" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:21:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.156s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:21:56 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Acquiring lock "458773cfa7230b717e41c60277832e9f83806d71" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:21:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.137s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:21:56 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Acquiring lock "458773cfa7230b717e41c60277832e9f83806d71" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:21:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.123s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:21:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6/disk 1073741824 {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:21:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6/disk 1073741824" returned: 0 in 0.046s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:21:56 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.173s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:21:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:21:56 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.172s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:21:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:21:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.138s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:21:56 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Checking if we can resize image /opt/stack/data/nova/instances/17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6/disk. size=1073741824 {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 18:21:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:21:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.147s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:21:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk 1073741824 {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:21:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk 1073741824" returned: 0 in 0.050s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:21:56 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:21:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:21:56 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.396s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:21:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:21:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:21:56 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Cannot resize image /opt/stack/data/nova/instances/17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6/disk to a smaller size. {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 18:21:56 user nova-compute[72418]: DEBUG nova.objects.instance [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Lazy-loading 'migration_context' on Instance uuid 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:21:56 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Created local disks {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 18:21:56 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Ensure instance console log exists: /opt/stack/data/nova/instances/17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6/console.log {{(pid=72418) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 18:21:56 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:21:56 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:21:56 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:21:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.136s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:21:56 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk. size=1073741824 {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 18:21:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:21:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.141s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:21:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk 1073741824 {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk 1073741824" returned: 0 in 0.053s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.595s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Cannot resize image /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk to a smaller size. {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG nova.objects.instance [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lazy-loading 'migration_context' on Instance uuid 6af7918a-ce90-45ab-93d8-684e1489e891 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Created local disks {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Ensure instance console log exists: /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/console.log {{(pid=72418) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG nova.network.neutron [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Successfully created port: c58368cc-29db-48a5-ab5d-a56526aba194 {{(pid=72418) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.150s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk. size=1073741824 {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.164s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk 1073741824 {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk 1073741824" returned: 0 in 0.057s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.823s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Cannot resize image /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk to a smaller size. {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG nova.objects.instance [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lazy-loading 'migration_context' on Instance uuid 8fe41968-a219-4a5a-afdb-32eb2082bb40 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Created local disks {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Ensure instance console log exists: /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/console.log {{(pid=72418) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.150s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Checking if we can resize image /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk. size=1073741824 {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.155s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/479ea4c3-ad7f-4da0-a901-defe46d96065/disk 1073741824 {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG nova.network.neutron [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Successfully created port: 1487cbc0-54ec-4134-9e08-88f02ff870f5 {{(pid=72418) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Cannot resize image /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk to a smaller size. {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG nova.objects.instance [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lazy-loading 'migration_context' on Instance uuid 01c46b33-6788-44a5-a43c-88ee4acc4d39 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Created local disks {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Ensure instance console log exists: /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/console.log {{(pid=72418) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/479ea4c3-ad7f-4da0-a901-defe46d96065/disk 1073741824" returned: 0 in 0.142s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.303s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.136s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Checking if we can resize image /opt/stack/data/nova/instances/479ea4c3-ad7f-4da0-a901-defe46d96065/disk. size=1073741824 {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/479ea4c3-ad7f-4da0-a901-defe46d96065/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/479ea4c3-ad7f-4da0-a901-defe46d96065/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Cannot resize image /opt/stack/data/nova/instances/479ea4c3-ad7f-4da0-a901-defe46d96065/disk to a smaller size. {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG nova.objects.instance [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Lazy-loading 'migration_context' on Instance uuid 479ea4c3-ad7f-4da0-a901-defe46d96065 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Created local disks {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Ensure instance console log exists: /opt/stack/data/nova/instances/479ea4c3-ad7f-4da0-a901-defe46d96065/console.log {{(pid=72418) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:21:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:21:58 user nova-compute[72418]: DEBUG nova.network.neutron [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Successfully updated port: 2b44ecc4-13c5-43ba-8425-5f42d86bc716 {{(pid=72418) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 18:21:58 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Acquiring lock "refresh_cache-6af7918a-ce90-45ab-93d8-684e1489e891" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:21:58 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Acquired lock "refresh_cache-6af7918a-ce90-45ab-93d8-684e1489e891" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:21:58 user nova-compute[72418]: DEBUG nova.network.neutron [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:21:58 user nova-compute[72418]: DEBUG nova.network.neutron [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Successfully created port: 1ebdd43e-c423-4e1c-9e50-1419f2857ae4 {{(pid=72418) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 18:21:59 user nova-compute[72418]: DEBUG nova.network.neutron [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Instance cache missing network info. {{(pid=72418) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 18:21:59 user nova-compute[72418]: DEBUG nova.compute.manager [req-43f9904c-3b03-4414-a411-49a594f22606 req-3e78d534-3d5c-4fab-9de1-29dd179ed61d service nova] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Received event network-changed-2b44ecc4-13c5-43ba-8425-5f42d86bc716 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:21:59 user nova-compute[72418]: DEBUG nova.compute.manager [req-43f9904c-3b03-4414-a411-49a594f22606 req-3e78d534-3d5c-4fab-9de1-29dd179ed61d service nova] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Refreshing instance network info cache due to event network-changed-2b44ecc4-13c5-43ba-8425-5f42d86bc716. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:21:59 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-43f9904c-3b03-4414-a411-49a594f22606 req-3e78d534-3d5c-4fab-9de1-29dd179ed61d service nova] Acquiring lock "refresh_cache-6af7918a-ce90-45ab-93d8-684e1489e891" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:21:59 user nova-compute[72418]: DEBUG nova.network.neutron [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Successfully updated port: 2e2b5832-b357-4012-8bfc-d26009aa91f8 {{(pid=72418) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 18:21:59 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquiring lock "refresh_cache-8fe41968-a219-4a5a-afdb-32eb2082bb40" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:21:59 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquired lock "refresh_cache-8fe41968-a219-4a5a-afdb-32eb2082bb40" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:21:59 user nova-compute[72418]: DEBUG nova.network.neutron [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:21:59 user nova-compute[72418]: DEBUG nova.network.neutron [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Instance cache missing network info. {{(pid=72418) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 18:22:00 user nova-compute[72418]: DEBUG nova.network.neutron [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Successfully updated port: 1487cbc0-54ec-4134-9e08-88f02ff870f5 {{(pid=72418) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 18:22:00 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Acquiring lock "refresh_cache-01c46b33-6788-44a5-a43c-88ee4acc4d39" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:22:00 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Acquired lock "refresh_cache-01c46b33-6788-44a5-a43c-88ee4acc4d39" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:22:00 user nova-compute[72418]: DEBUG nova.network.neutron [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:22:00 user nova-compute[72418]: DEBUG nova.network.neutron [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Updating instance_info_cache with network_info: [{"id": "2b44ecc4-13c5-43ba-8425-5f42d86bc716", "address": "fa:16:3e:8d:41:82", "network": {"id": "15a49d9b-3c0d-449b-9473-29f219960e2c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c68622cd79472ba6ad14a6876aeaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b44ecc4-13", "ovs_interfaceid": "2b44ecc4-13c5-43ba-8425-5f42d86bc716", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:22:00 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Releasing lock "refresh_cache-6af7918a-ce90-45ab-93d8-684e1489e891" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:22:00 user nova-compute[72418]: DEBUG nova.compute.manager [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Instance network_info: |[{"id": "2b44ecc4-13c5-43ba-8425-5f42d86bc716", "address": "fa:16:3e:8d:41:82", "network": {"id": "15a49d9b-3c0d-449b-9473-29f219960e2c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c68622cd79472ba6ad14a6876aeaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b44ecc4-13", "ovs_interfaceid": "2b44ecc4-13c5-43ba-8425-5f42d86bc716", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 18:22:00 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-43f9904c-3b03-4414-a411-49a594f22606 req-3e78d534-3d5c-4fab-9de1-29dd179ed61d service nova] Acquired lock "refresh_cache-6af7918a-ce90-45ab-93d8-684e1489e891" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:22:00 user nova-compute[72418]: DEBUG nova.network.neutron [req-43f9904c-3b03-4414-a411-49a594f22606 req-3e78d534-3d5c-4fab-9de1-29dd179ed61d service nova] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Refreshing network info cache for port 2b44ecc4-13c5-43ba-8425-5f42d86bc716 {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:22:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Start _get_guest_xml network_info=[{"id": "2b44ecc4-13c5-43ba-8425-5f42d86bc716", "address": "fa:16:3e:8d:41:82", "network": {"id": "15a49d9b-3c0d-449b-9473-29f219960e2c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c68622cd79472ba6ad14a6876aeaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b44ecc4-13", "ovs_interfaceid": "2b44ecc4-13c5-43ba-8425-5f42d86bc716", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 18:22:00 user nova-compute[72418]: DEBUG nova.network.neutron [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Successfully updated port: c58368cc-29db-48a5-ab5d-a56526aba194 {{(pid=72418) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 18:22:00 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:22:00 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:22:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 18:22:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] CPU controller missing on host. {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 18:22:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 18:22:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] CPU controller found on host. {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 18:22:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72418) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 18:22:00 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T18:17:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 18:22:00 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Flavor limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 18:22:00 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Image limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 18:22:00 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Flavor pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 18:22:00 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Image pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 18:22:00 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 18:22:00 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 18:22:00 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 18:22:00 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Got 1 possible topologies {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 18:22:00 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 18:22:00 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 18:22:00 user nova-compute[72418]: DEBUG nova.privsep.utils [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72418) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 18:22:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:21:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-640969578',display_name='tempest-ServerRescueNegativeTestJSON-server-640969578',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-640969578',id=1,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5c68622cd79472ba6ad14a6876aeaea',ramdisk_id='',reservation_id='r-e2sltd8s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-326572915',owner_user_name='tempest-ServerRescueNegativeTestJSON-326572915-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:21:53Z,user_data=None,user_id='b3c4feb0a14841eeb757a79b6a05d1fa',uuid=6af7918a-ce90-45ab-93d8-684e1489e891,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b44ecc4-13c5-43ba-8425-5f42d86bc716", "address": "fa:16:3e:8d:41:82", "network": {"id": "15a49d9b-3c0d-449b-9473-29f219960e2c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c68622cd79472ba6ad14a6876aeaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b44ecc4-13", "ovs_interfaceid": "2b44ecc4-13c5-43ba-8425-5f42d86bc716", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:22:00 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Converting VIF {"id": "2b44ecc4-13c5-43ba-8425-5f42d86bc716", "address": "fa:16:3e:8d:41:82", "network": {"id": "15a49d9b-3c0d-449b-9473-29f219960e2c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c68622cd79472ba6ad14a6876aeaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b44ecc4-13", "ovs_interfaceid": "2b44ecc4-13c5-43ba-8425-5f42d86bc716", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:22:00 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:41:82,bridge_name='br-int',has_traffic_filtering=True,id=2b44ecc4-13c5-43ba-8425-5f42d86bc716,network=Network(15a49d9b-3c0d-449b-9473-29f219960e2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b44ecc4-13') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:22:00 user nova-compute[72418]: DEBUG nova.objects.instance [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lazy-loading 'pci_devices' on Instance uuid 6af7918a-ce90-45ab-93d8-684e1489e891 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:22:00 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Acquiring lock "refresh_cache-17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:22:00 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Acquired lock "refresh_cache-17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:22:00 user nova-compute[72418]: DEBUG nova.network.neutron [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:22:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] End _get_guest_xml xml=<domain type="kvm">
Aug 09 18:22:00 user nova-compute[72418]:   <uuid>6af7918a-ce90-45ab-93d8-684e1489e891</uuid>
Aug 09 18:22:00 user nova-compute[72418]:   <name>instance-00000001</name>
Aug 09 18:22:00 user nova-compute[72418]:   <memory>524288</memory>
Aug 09 18:22:00 user nova-compute[72418]:   <vcpu>1</vcpu>
Aug 09 18:22:00 user nova-compute[72418]:   <metadata>
Aug 09 18:22:00 user nova-compute[72418]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:22:00 user nova-compute[72418]:       <nova:package version="0.0.0"/>
Aug 09 18:22:00 user nova-compute[72418]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-640969578</nova:name>
Aug 09 18:22:00 user nova-compute[72418]:       <nova:creationTime>2023-08-09 18:22:00</nova:creationTime>
Aug 09 18:22:00 user nova-compute[72418]:       <nova:flavor name="m1.tiny">
Aug 09 18:22:00 user nova-compute[72418]:         <nova:memory>512</nova:memory>
Aug 09 18:22:00 user nova-compute[72418]:         <nova:disk>1</nova:disk>
Aug 09 18:22:00 user nova-compute[72418]:         <nova:swap>0</nova:swap>
Aug 09 18:22:00 user nova-compute[72418]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:22:00 user nova-compute[72418]:         <nova:vcpus>1</nova:vcpus>
Aug 09 18:22:00 user nova-compute[72418]:       </nova:flavor>
Aug 09 18:22:00 user nova-compute[72418]:       <nova:owner>
Aug 09 18:22:00 user nova-compute[72418]:         <nova:user uuid="b3c4feb0a14841eeb757a79b6a05d1fa">tempest-ServerRescueNegativeTestJSON-326572915-project-member</nova:user>
Aug 09 18:22:00 user nova-compute[72418]:         <nova:project uuid="b5c68622cd79472ba6ad14a6876aeaea">tempest-ServerRescueNegativeTestJSON-326572915</nova:project>
Aug 09 18:22:00 user nova-compute[72418]:       </nova:owner>
Aug 09 18:22:00 user nova-compute[72418]:       <nova:root type="image" uuid="8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e"/>
Aug 09 18:22:00 user nova-compute[72418]:       <nova:ports>
Aug 09 18:22:00 user nova-compute[72418]:         <nova:port uuid="2b44ecc4-13c5-43ba-8425-5f42d86bc716">
Aug 09 18:22:00 user nova-compute[72418]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 18:22:00 user nova-compute[72418]:         </nova:port>
Aug 09 18:22:00 user nova-compute[72418]:       </nova:ports>
Aug 09 18:22:00 user nova-compute[72418]:     </nova:instance>
Aug 09 18:22:00 user nova-compute[72418]:   </metadata>
Aug 09 18:22:00 user nova-compute[72418]:   <sysinfo type="smbios">
Aug 09 18:22:00 user nova-compute[72418]:     <system>
Aug 09 18:22:00 user nova-compute[72418]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 18:22:00 user nova-compute[72418]:       <entry name="product">OpenStack Nova</entry>
Aug 09 18:22:00 user nova-compute[72418]:       <entry name="version">0.0.0</entry>
Aug 09 18:22:00 user nova-compute[72418]:       <entry name="serial">6af7918a-ce90-45ab-93d8-684e1489e891</entry>
Aug 09 18:22:00 user nova-compute[72418]:       <entry name="uuid">6af7918a-ce90-45ab-93d8-684e1489e891</entry>
Aug 09 18:22:00 user nova-compute[72418]:       <entry name="family">Virtual Machine</entry>
Aug 09 18:22:00 user nova-compute[72418]:     </system>
Aug 09 18:22:00 user nova-compute[72418]:   </sysinfo>
Aug 09 18:22:00 user nova-compute[72418]:   <os>
Aug 09 18:22:00 user nova-compute[72418]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 18:22:00 user nova-compute[72418]:     <boot dev="hd"/>
Aug 09 18:22:00 user nova-compute[72418]:     <smbios mode="sysinfo"/>
Aug 09 18:22:00 user nova-compute[72418]:   </os>
Aug 09 18:22:00 user nova-compute[72418]:   <features>
Aug 09 18:22:00 user nova-compute[72418]:     <acpi/>
Aug 09 18:22:00 user nova-compute[72418]:     <apic/>
Aug 09 18:22:00 user nova-compute[72418]:     <vmcoreinfo/>
Aug 09 18:22:00 user nova-compute[72418]:   </features>
Aug 09 18:22:00 user nova-compute[72418]:   <clock offset="utc">
Aug 09 18:22:00 user nova-compute[72418]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 18:22:00 user nova-compute[72418]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 18:22:00 user nova-compute[72418]:     <timer name="hpet" present="no"/>
Aug 09 18:22:00 user nova-compute[72418]:   </clock>
Aug 09 18:22:00 user nova-compute[72418]:   <cpu mode="custom" match="exact">
Aug 09 18:22:00 user nova-compute[72418]:     <model>Nehalem</model>
Aug 09 18:22:00 user nova-compute[72418]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 18:22:00 user nova-compute[72418]:   </cpu>
Aug 09 18:22:00 user nova-compute[72418]:   <devices>
Aug 09 18:22:00 user nova-compute[72418]:     <disk type="file" device="disk">
Aug 09 18:22:00 user nova-compute[72418]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 18:22:00 user nova-compute[72418]:       <source file="/opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk"/>
Aug 09 18:22:00 user nova-compute[72418]:       <target dev="vda" bus="virtio"/>
Aug 09 18:22:00 user nova-compute[72418]:     </disk>
Aug 09 18:22:00 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:22:00 user nova-compute[72418]:       <mac address="fa:16:3e:8d:41:82"/>
Aug 09 18:22:00 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:22:00 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:22:00 user nova-compute[72418]:       <target dev="tap2b44ecc4-13"/>
Aug 09 18:22:00 user nova-compute[72418]:     </interface>
Aug 09 18:22:00 user nova-compute[72418]:     <serial type="pty">
Aug 09 18:22:00 user nova-compute[72418]:       <log file="/opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/console.log" append="off"/>
Aug 09 18:22:00 user nova-compute[72418]:     </serial>
Aug 09 18:22:00 user nova-compute[72418]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 18:22:00 user nova-compute[72418]:     <video>
Aug 09 18:22:00 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:22:00 user nova-compute[72418]:     </video>
Aug 09 18:22:00 user nova-compute[72418]:     <rng model="virtio">
Aug 09 18:22:00 user nova-compute[72418]:       <backend model="random">/dev/urandom</backend>
Aug 09 18:22:00 user nova-compute[72418]:     </rng>
Aug 09 18:22:00 user nova-compute[72418]:     <controller type="usb" index="0" model="none"/>
Aug 09 18:22:00 user nova-compute[72418]:     <memballoon model="virtio">
Aug 09 18:22:00 user nova-compute[72418]:       <stats period="10"/>
Aug 09 18:22:00 user nova-compute[72418]:     </memballoon>
Aug 09 18:22:00 user nova-compute[72418]:   </devices>
Aug 09 18:22:00 user nova-compute[72418]: </domain>
Aug 09 18:22:00 user nova-compute[72418]:  {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 18:22:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:21:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-640969578',display_name='tempest-ServerRescueNegativeTestJSON-server-640969578',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-640969578',id=1,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5c68622cd79472ba6ad14a6876aeaea',ramdisk_id='',reservation_id='r-e2sltd8s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-326572915',owner_user_name='tempest-ServerRescueNegativeTestJSON-326572915-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:21:53Z,user_data=None,user_id='b3c4feb0a14841eeb757a79b6a05d1fa',uuid=6af7918a-ce90-45ab-93d8-684e1489e891,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b44ecc4-13c5-43ba-8425-5f42d86bc716", "address": "fa:16:3e:8d:41:82", "network": {"id": "15a49d9b-3c0d-449b-9473-29f219960e2c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c68622cd79472ba6ad14a6876aeaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b44ecc4-13", "ovs_interfaceid": "2b44ecc4-13c5-43ba-8425-5f42d86bc716", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:22:00 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Converting VIF {"id": "2b44ecc4-13c5-43ba-8425-5f42d86bc716", "address": "fa:16:3e:8d:41:82", "network": {"id": "15a49d9b-3c0d-449b-9473-29f219960e2c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c68622cd79472ba6ad14a6876aeaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b44ecc4-13", "ovs_interfaceid": "2b44ecc4-13c5-43ba-8425-5f42d86bc716", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:22:00 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:41:82,bridge_name='br-int',has_traffic_filtering=True,id=2b44ecc4-13c5-43ba-8425-5f42d86bc716,network=Network(15a49d9b-3c0d-449b-9473-29f219960e2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b44ecc4-13') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:22:00 user nova-compute[72418]: DEBUG os_vif [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:41:82,bridge_name='br-int',has_traffic_filtering=True,id=2b44ecc4-13c5-43ba-8425-5f42d86bc716,network=Network(15a49d9b-3c0d-449b-9473-29f219960e2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b44ecc4-13') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:22:00 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Created schema index Interface.name {{(pid=72418) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 09 18:22:00 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Created schema index Port.name {{(pid=72418) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 09 18:22:00 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Created schema index Bridge.name {{(pid=72418) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 09 18:22:00 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=72418) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 18:22:00 user nova-compute[72418]: DEBUG nova.network.neutron [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Instance cache missing network info. {{(pid=72418) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 18:22:00 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [POLLOUT] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:00 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72418) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 18:22:00 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:00 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:00 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:00 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:22:00 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:22:00 user nova-compute[72418]: INFO oslo.privsep.daemon [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp75m2njrt/privsep.sock']
Aug 09 18:22:00 user sudo[81691]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp75m2njrt/privsep.sock
Aug 09 18:22:00 user sudo[81691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 09 18:22:00 user nova-compute[72418]: DEBUG nova.compute.manager [req-f9c44f46-9292-4b96-a44e-75090036860e req-a3dc0706-4dad-4ed2-bee1-3204c6aceb38 service nova] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Received event network-changed-1487cbc0-54ec-4134-9e08-88f02ff870f5 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:22:00 user nova-compute[72418]: DEBUG nova.compute.manager [req-f9c44f46-9292-4b96-a44e-75090036860e req-a3dc0706-4dad-4ed2-bee1-3204c6aceb38 service nova] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Refreshing instance network info cache due to event network-changed-1487cbc0-54ec-4134-9e08-88f02ff870f5. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:22:00 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-f9c44f46-9292-4b96-a44e-75090036860e req-a3dc0706-4dad-4ed2-bee1-3204c6aceb38 service nova] Acquiring lock "refresh_cache-01c46b33-6788-44a5-a43c-88ee4acc4d39" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:22:00 user nova-compute[72418]: DEBUG nova.network.neutron [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Instance cache missing network info. {{(pid=72418) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 18:22:00 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.network.neutron [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Updating instance_info_cache with network_info: [{"id": "1487cbc0-54ec-4134-9e08-88f02ff870f5", "address": "fa:16:3e:b3:6b:21", "network": {"id": "15a49d9b-3c0d-449b-9473-29f219960e2c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c68622cd79472ba6ad14a6876aeaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1487cbc0-54", "ovs_interfaceid": "1487cbc0-54ec-4134-9e08-88f02ff870f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Releasing lock "refresh_cache-01c46b33-6788-44a5-a43c-88ee4acc4d39" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.compute.manager [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Instance network_info: |[{"id": "1487cbc0-54ec-4134-9e08-88f02ff870f5", "address": "fa:16:3e:b3:6b:21", "network": {"id": "15a49d9b-3c0d-449b-9473-29f219960e2c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c68622cd79472ba6ad14a6876aeaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1487cbc0-54", "ovs_interfaceid": "1487cbc0-54ec-4134-9e08-88f02ff870f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-f9c44f46-9292-4b96-a44e-75090036860e req-a3dc0706-4dad-4ed2-bee1-3204c6aceb38 service nova] Acquired lock "refresh_cache-01c46b33-6788-44a5-a43c-88ee4acc4d39" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.network.neutron [req-f9c44f46-9292-4b96-a44e-75090036860e req-a3dc0706-4dad-4ed2-bee1-3204c6aceb38 service nova] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Refreshing network info cache for port 1487cbc0-54ec-4134-9e08-88f02ff870f5 {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Start _get_guest_xml network_info=[{"id": "1487cbc0-54ec-4134-9e08-88f02ff870f5", "address": "fa:16:3e:b3:6b:21", "network": {"id": "15a49d9b-3c0d-449b-9473-29f219960e2c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c68622cd79472ba6ad14a6876aeaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1487cbc0-54", "ovs_interfaceid": "1487cbc0-54ec-4134-9e08-88f02ff870f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 18:22:01 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:22:01 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] CPU controller missing on host. {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] CPU controller found on host. {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72418) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T18:17:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Flavor limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Image limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Flavor pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Image pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Got 1 possible topologies {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:21:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1456004149',display_name='tempest-ServerRescueNegativeTestJSON-server-1456004149',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1456004149',id=4,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5c68622cd79472ba6ad14a6876aeaea',ramdisk_id='',reservation_id='r-jh195jvw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-326572915',owner_user_name='tempest-ServerRescueNegativeTestJSON-326572915-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:21:55Z,user_data=None,user_id='b3c4feb0a14841eeb757a79b6a05d1fa',uuid=01c46b33-6788-44a5-a43c-88ee4acc4d39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1487cbc0-54ec-4134-9e08-88f02ff870f5", "address": "fa:16:3e:b3:6b:21", "network": {"id": "15a49d9b-3c0d-449b-9473-29f219960e2c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c68622cd79472ba6ad14a6876aeaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1487cbc0-54", "ovs_interfaceid": "1487cbc0-54ec-4134-9e08-88f02ff870f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Converting VIF {"id": "1487cbc0-54ec-4134-9e08-88f02ff870f5", "address": "fa:16:3e:b3:6b:21", "network": {"id": "15a49d9b-3c0d-449b-9473-29f219960e2c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c68622cd79472ba6ad14a6876aeaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1487cbc0-54", "ovs_interfaceid": "1487cbc0-54ec-4134-9e08-88f02ff870f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:6b:21,bridge_name='br-int',has_traffic_filtering=True,id=1487cbc0-54ec-4134-9e08-88f02ff870f5,network=Network(15a49d9b-3c0d-449b-9473-29f219960e2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1487cbc0-54') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.objects.instance [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lazy-loading 'pci_devices' on Instance uuid 01c46b33-6788-44a5-a43c-88ee4acc4d39 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] End _get_guest_xml xml=<domain type="kvm">
Aug 09 18:22:01 user nova-compute[72418]:   <uuid>01c46b33-6788-44a5-a43c-88ee4acc4d39</uuid>
Aug 09 18:22:01 user nova-compute[72418]:   <name>instance-00000004</name>
Aug 09 18:22:01 user nova-compute[72418]:   <memory>524288</memory>
Aug 09 18:22:01 user nova-compute[72418]:   <vcpu>1</vcpu>
Aug 09 18:22:01 user nova-compute[72418]:   <metadata>
Aug 09 18:22:01 user nova-compute[72418]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:22:01 user nova-compute[72418]:       <nova:package version="0.0.0"/>
Aug 09 18:22:01 user nova-compute[72418]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1456004149</nova:name>
Aug 09 18:22:01 user nova-compute[72418]:       <nova:creationTime>2023-08-09 18:22:01</nova:creationTime>
Aug 09 18:22:01 user nova-compute[72418]:       <nova:flavor name="m1.tiny">
Aug 09 18:22:01 user nova-compute[72418]:         <nova:memory>512</nova:memory>
Aug 09 18:22:01 user nova-compute[72418]:         <nova:disk>1</nova:disk>
Aug 09 18:22:01 user nova-compute[72418]:         <nova:swap>0</nova:swap>
Aug 09 18:22:01 user nova-compute[72418]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:22:01 user nova-compute[72418]:         <nova:vcpus>1</nova:vcpus>
Aug 09 18:22:01 user nova-compute[72418]:       </nova:flavor>
Aug 09 18:22:01 user nova-compute[72418]:       <nova:owner>
Aug 09 18:22:01 user nova-compute[72418]:         <nova:user uuid="b3c4feb0a14841eeb757a79b6a05d1fa">tempest-ServerRescueNegativeTestJSON-326572915-project-member</nova:user>
Aug 09 18:22:01 user nova-compute[72418]:         <nova:project uuid="b5c68622cd79472ba6ad14a6876aeaea">tempest-ServerRescueNegativeTestJSON-326572915</nova:project>
Aug 09 18:22:01 user nova-compute[72418]:       </nova:owner>
Aug 09 18:22:01 user nova-compute[72418]:       <nova:root type="image" uuid="8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e"/>
Aug 09 18:22:01 user nova-compute[72418]:       <nova:ports>
Aug 09 18:22:01 user nova-compute[72418]:         <nova:port uuid="1487cbc0-54ec-4134-9e08-88f02ff870f5">
Aug 09 18:22:01 user nova-compute[72418]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 18:22:01 user nova-compute[72418]:         </nova:port>
Aug 09 18:22:01 user nova-compute[72418]:       </nova:ports>
Aug 09 18:22:01 user nova-compute[72418]:     </nova:instance>
Aug 09 18:22:01 user nova-compute[72418]:   </metadata>
Aug 09 18:22:01 user nova-compute[72418]:   <sysinfo type="smbios">
Aug 09 18:22:01 user nova-compute[72418]:     <system>
Aug 09 18:22:01 user nova-compute[72418]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 18:22:01 user nova-compute[72418]:       <entry name="product">OpenStack Nova</entry>
Aug 09 18:22:01 user nova-compute[72418]:       <entry name="version">0.0.0</entry>
Aug 09 18:22:01 user nova-compute[72418]:       <entry name="serial">01c46b33-6788-44a5-a43c-88ee4acc4d39</entry>
Aug 09 18:22:01 user nova-compute[72418]:       <entry name="uuid">01c46b33-6788-44a5-a43c-88ee4acc4d39</entry>
Aug 09 18:22:01 user nova-compute[72418]:       <entry name="family">Virtual Machine</entry>
Aug 09 18:22:01 user nova-compute[72418]:     </system>
Aug 09 18:22:01 user nova-compute[72418]:   </sysinfo>
Aug 09 18:22:01 user nova-compute[72418]:   <os>
Aug 09 18:22:01 user nova-compute[72418]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 18:22:01 user nova-compute[72418]:     <boot dev="hd"/>
Aug 09 18:22:01 user nova-compute[72418]:     <smbios mode="sysinfo"/>
Aug 09 18:22:01 user nova-compute[72418]:   </os>
Aug 09 18:22:01 user nova-compute[72418]:   <features>
Aug 09 18:22:01 user nova-compute[72418]:     <acpi/>
Aug 09 18:22:01 user nova-compute[72418]:     <apic/>
Aug 09 18:22:01 user nova-compute[72418]:     <vmcoreinfo/>
Aug 09 18:22:01 user nova-compute[72418]:   </features>
Aug 09 18:22:01 user nova-compute[72418]:   <clock offset="utc">
Aug 09 18:22:01 user nova-compute[72418]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 18:22:01 user nova-compute[72418]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 18:22:01 user nova-compute[72418]:     <timer name="hpet" present="no"/>
Aug 09 18:22:01 user nova-compute[72418]:   </clock>
Aug 09 18:22:01 user nova-compute[72418]:   <cpu mode="custom" match="exact">
Aug 09 18:22:01 user nova-compute[72418]:     <model>Nehalem</model>
Aug 09 18:22:01 user nova-compute[72418]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 18:22:01 user nova-compute[72418]:   </cpu>
Aug 09 18:22:01 user nova-compute[72418]:   <devices>
Aug 09 18:22:01 user nova-compute[72418]:     <disk type="file" device="disk">
Aug 09 18:22:01 user nova-compute[72418]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 18:22:01 user nova-compute[72418]:       <source file="/opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk"/>
Aug 09 18:22:01 user nova-compute[72418]:       <target dev="vda" bus="virtio"/>
Aug 09 18:22:01 user nova-compute[72418]:     </disk>
Aug 09 18:22:01 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:22:01 user nova-compute[72418]:       <mac address="fa:16:3e:b3:6b:21"/>
Aug 09 18:22:01 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:22:01 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:22:01 user nova-compute[72418]:       <target dev="tap1487cbc0-54"/>
Aug 09 18:22:01 user nova-compute[72418]:     </interface>
Aug 09 18:22:01 user nova-compute[72418]:     <serial type="pty">
Aug 09 18:22:01 user nova-compute[72418]:       <log file="/opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/console.log" append="off"/>
Aug 09 18:22:01 user nova-compute[72418]:     </serial>
Aug 09 18:22:01 user nova-compute[72418]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 18:22:01 user nova-compute[72418]:     <video>
Aug 09 18:22:01 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:22:01 user nova-compute[72418]:     </video>
Aug 09 18:22:01 user nova-compute[72418]:     <rng model="virtio">
Aug 09 18:22:01 user nova-compute[72418]:       <backend model="random">/dev/urandom</backend>
Aug 09 18:22:01 user nova-compute[72418]:     </rng>
Aug 09 18:22:01 user nova-compute[72418]:     <controller type="usb" index="0" model="none"/>
Aug 09 18:22:01 user nova-compute[72418]:     <memballoon model="virtio">
Aug 09 18:22:01 user nova-compute[72418]:       <stats period="10"/>
Aug 09 18:22:01 user nova-compute[72418]:     </memballoon>
Aug 09 18:22:01 user nova-compute[72418]:   </devices>
Aug 09 18:22:01 user nova-compute[72418]: </domain>
Aug 09 18:22:01 user nova-compute[72418]:  {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:21:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1456004149',display_name='tempest-ServerRescueNegativeTestJSON-server-1456004149',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1456004149',id=4,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5c68622cd79472ba6ad14a6876aeaea',ramdisk_id='',reservation_id='r-jh195jvw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-326572915',owner_user_name='tempest-ServerRescueNegativeTestJSON-326572915-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:21:55Z,user_data=None,user_id='b3c4feb0a14841eeb757a79b6a05d1fa',uuid=01c46b33-6788-44a5-a43c-88ee4acc4d39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1487cbc0-54ec-4134-9e08-88f02ff870f5", "address": "fa:16:3e:b3:6b:21", "network": {"id": "15a49d9b-3c0d-449b-9473-29f219960e2c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c68622cd79472ba6ad14a6876aeaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1487cbc0-54", "ovs_interfaceid": "1487cbc0-54ec-4134-9e08-88f02ff870f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Converting VIF {"id": "1487cbc0-54ec-4134-9e08-88f02ff870f5", "address": "fa:16:3e:b3:6b:21", "network": {"id": "15a49d9b-3c0d-449b-9473-29f219960e2c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c68622cd79472ba6ad14a6876aeaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1487cbc0-54", "ovs_interfaceid": "1487cbc0-54ec-4134-9e08-88f02ff870f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:6b:21,bridge_name='br-int',has_traffic_filtering=True,id=1487cbc0-54ec-4134-9e08-88f02ff870f5,network=Network(15a49d9b-3c0d-449b-9473-29f219960e2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1487cbc0-54') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG os_vif [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:6b:21,bridge_name='br-int',has_traffic_filtering=True,id=1487cbc0-54ec-4134-9e08-88f02ff870f5,network=Network(15a49d9b-3c0d-449b-9473-29f219960e2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1487cbc0-54') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.compute.manager [req-a83f4d17-d327-460d-8284-9048afff5080 req-83651fff-b36f-4813-9d1e-3c4db9875442 service nova] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Received event network-changed-2e2b5832-b357-4012-8bfc-d26009aa91f8 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.compute.manager [req-a83f4d17-d327-460d-8284-9048afff5080 req-83651fff-b36f-4813-9d1e-3c4db9875442 service nova] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Refreshing instance network info cache due to event network-changed-2e2b5832-b357-4012-8bfc-d26009aa91f8. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a83f4d17-d327-460d-8284-9048afff5080 req-83651fff-b36f-4813-9d1e-3c4db9875442 service nova] Acquiring lock "refresh_cache-8fe41968-a219-4a5a-afdb-32eb2082bb40" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.network.neutron [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Updating instance_info_cache with network_info: [{"id": "2e2b5832-b357-4012-8bfc-d26009aa91f8", "address": "fa:16:3e:ee:f9:5d", "network": {"id": "beaefb5c-f5e4-47e7-ab68-60131f532ade", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e5863cda54487682a4edcc24202c91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2b5832-b3", "ovs_interfaceid": "2e2b5832-b357-4012-8bfc-d26009aa91f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Releasing lock "refresh_cache-8fe41968-a219-4a5a-afdb-32eb2082bb40" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.compute.manager [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Instance network_info: |[{"id": "2e2b5832-b357-4012-8bfc-d26009aa91f8", "address": "fa:16:3e:ee:f9:5d", "network": {"id": "beaefb5c-f5e4-47e7-ab68-60131f532ade", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e5863cda54487682a4edcc24202c91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2b5832-b3", "ovs_interfaceid": "2e2b5832-b357-4012-8bfc-d26009aa91f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a83f4d17-d327-460d-8284-9048afff5080 req-83651fff-b36f-4813-9d1e-3c4db9875442 service nova] Acquired lock "refresh_cache-8fe41968-a219-4a5a-afdb-32eb2082bb40" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.network.neutron [req-a83f4d17-d327-460d-8284-9048afff5080 req-83651fff-b36f-4813-9d1e-3c4db9875442 service nova] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Refreshing network info cache for port 2e2b5832-b357-4012-8bfc-d26009aa91f8 {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Start _get_guest_xml network_info=[{"id": "2e2b5832-b357-4012-8bfc-d26009aa91f8", "address": "fa:16:3e:ee:f9:5d", "network": {"id": "beaefb5c-f5e4-47e7-ab68-60131f532ade", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e5863cda54487682a4edcc24202c91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2b5832-b3", "ovs_interfaceid": "2e2b5832-b357-4012-8bfc-d26009aa91f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 18:22:01 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:22:01 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] CPU controller missing on host. {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] CPU controller found on host. {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72418) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T18:17:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Flavor limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Image limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Flavor pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Image pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Got 1 possible topologies {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:21:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-127597739',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-127597739',id=2,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52e5863cda54487682a4edcc24202c91',ramdisk_id='',reservation_id='r-ng058tj6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1120385592',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:21:54Z,user_data=None,user_id='621fd2b971c543d197a354c38e0d1867',uuid=8fe41968-a219-4a5a-afdb-32eb2082bb40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e2b5832-b357-4012-8bfc-d26009aa91f8", "address": "fa:16:3e:ee:f9:5d", "network": {"id": "beaefb5c-f5e4-47e7-ab68-60131f532ade", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e5863cda54487682a4edcc24202c91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2b5832-b3", "ovs_interfaceid": "2e2b5832-b357-4012-8bfc-d26009aa91f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Converting VIF {"id": "2e2b5832-b357-4012-8bfc-d26009aa91f8", "address": "fa:16:3e:ee:f9:5d", "network": {"id": "beaefb5c-f5e4-47e7-ab68-60131f532ade", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e5863cda54487682a4edcc24202c91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2b5832-b3", "ovs_interfaceid": "2e2b5832-b357-4012-8bfc-d26009aa91f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:f9:5d,bridge_name='br-int',has_traffic_filtering=True,id=2e2b5832-b357-4012-8bfc-d26009aa91f8,network=Network(beaefb5c-f5e4-47e7-ab68-60131f532ade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e2b5832-b3') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.objects.instance [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lazy-loading 'pci_devices' on Instance uuid 8fe41968-a219-4a5a-afdb-32eb2082bb40 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] End _get_guest_xml xml=<domain type="kvm">
Aug 09 18:22:01 user nova-compute[72418]:   <uuid>8fe41968-a219-4a5a-afdb-32eb2082bb40</uuid>
Aug 09 18:22:01 user nova-compute[72418]:   <name>instance-00000002</name>
Aug 09 18:22:01 user nova-compute[72418]:   <memory>524288</memory>
Aug 09 18:22:01 user nova-compute[72418]:   <vcpu>1</vcpu>
Aug 09 18:22:01 user nova-compute[72418]:   <metadata>
Aug 09 18:22:01 user nova-compute[72418]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:22:01 user nova-compute[72418]:       <nova:package version="0.0.0"/>
Aug 09 18:22:01 user nova-compute[72418]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-127597739</nova:name>
Aug 09 18:22:01 user nova-compute[72418]:       <nova:creationTime>2023-08-09 18:22:01</nova:creationTime>
Aug 09 18:22:01 user nova-compute[72418]:       <nova:flavor name="m1.tiny">
Aug 09 18:22:01 user nova-compute[72418]:         <nova:memory>512</nova:memory>
Aug 09 18:22:01 user nova-compute[72418]:         <nova:disk>1</nova:disk>
Aug 09 18:22:01 user nova-compute[72418]:         <nova:swap>0</nova:swap>
Aug 09 18:22:01 user nova-compute[72418]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:22:01 user nova-compute[72418]:         <nova:vcpus>1</nova:vcpus>
Aug 09 18:22:01 user nova-compute[72418]:       </nova:flavor>
Aug 09 18:22:01 user nova-compute[72418]:       <nova:owner>
Aug 09 18:22:01 user nova-compute[72418]:         <nova:user uuid="621fd2b971c543d197a354c38e0d1867">tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member</nova:user>
Aug 09 18:22:01 user nova-compute[72418]:         <nova:project uuid="52e5863cda54487682a4edcc24202c91">tempest-ServerBootFromVolumeStableRescueTest-1120385592</nova:project>
Aug 09 18:22:01 user nova-compute[72418]:       </nova:owner>
Aug 09 18:22:01 user nova-compute[72418]:       <nova:root type="image" uuid="8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e"/>
Aug 09 18:22:01 user nova-compute[72418]:       <nova:ports>
Aug 09 18:22:01 user nova-compute[72418]:         <nova:port uuid="2e2b5832-b357-4012-8bfc-d26009aa91f8">
Aug 09 18:22:01 user nova-compute[72418]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 09 18:22:01 user nova-compute[72418]:         </nova:port>
Aug 09 18:22:01 user nova-compute[72418]:       </nova:ports>
Aug 09 18:22:01 user nova-compute[72418]:     </nova:instance>
Aug 09 18:22:01 user nova-compute[72418]:   </metadata>
Aug 09 18:22:01 user nova-compute[72418]:   <sysinfo type="smbios">
Aug 09 18:22:01 user nova-compute[72418]:     <system>
Aug 09 18:22:01 user nova-compute[72418]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 18:22:01 user nova-compute[72418]:       <entry name="product">OpenStack Nova</entry>
Aug 09 18:22:01 user nova-compute[72418]:       <entry name="version">0.0.0</entry>
Aug 09 18:22:01 user nova-compute[72418]:       <entry name="serial">8fe41968-a219-4a5a-afdb-32eb2082bb40</entry>
Aug 09 18:22:01 user nova-compute[72418]:       <entry name="uuid">8fe41968-a219-4a5a-afdb-32eb2082bb40</entry>
Aug 09 18:22:01 user nova-compute[72418]:       <entry name="family">Virtual Machine</entry>
Aug 09 18:22:01 user nova-compute[72418]:     </system>
Aug 09 18:22:01 user nova-compute[72418]:   </sysinfo>
Aug 09 18:22:01 user nova-compute[72418]:   <os>
Aug 09 18:22:01 user nova-compute[72418]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 18:22:01 user nova-compute[72418]:     <boot dev="hd"/>
Aug 09 18:22:01 user nova-compute[72418]:     <smbios mode="sysinfo"/>
Aug 09 18:22:01 user nova-compute[72418]:   </os>
Aug 09 18:22:01 user nova-compute[72418]:   <features>
Aug 09 18:22:01 user nova-compute[72418]:     <acpi/>
Aug 09 18:22:01 user nova-compute[72418]:     <apic/>
Aug 09 18:22:01 user nova-compute[72418]:     <vmcoreinfo/>
Aug 09 18:22:01 user nova-compute[72418]:   </features>
Aug 09 18:22:01 user nova-compute[72418]:   <clock offset="utc">
Aug 09 18:22:01 user nova-compute[72418]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 18:22:01 user nova-compute[72418]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 18:22:01 user nova-compute[72418]:     <timer name="hpet" present="no"/>
Aug 09 18:22:01 user nova-compute[72418]:   </clock>
Aug 09 18:22:01 user nova-compute[72418]:   <cpu mode="custom" match="exact">
Aug 09 18:22:01 user nova-compute[72418]:     <model>Nehalem</model>
Aug 09 18:22:01 user nova-compute[72418]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 18:22:01 user nova-compute[72418]:   </cpu>
Aug 09 18:22:01 user nova-compute[72418]:   <devices>
Aug 09 18:22:01 user nova-compute[72418]:     <disk type="file" device="disk">
Aug 09 18:22:01 user nova-compute[72418]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 18:22:01 user nova-compute[72418]:       <source file="/opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk"/>
Aug 09 18:22:01 user nova-compute[72418]:       <target dev="vda" bus="virtio"/>
Aug 09 18:22:01 user nova-compute[72418]:     </disk>
Aug 09 18:22:01 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:22:01 user nova-compute[72418]:       <mac address="fa:16:3e:ee:f9:5d"/>
Aug 09 18:22:01 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:22:01 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:22:01 user nova-compute[72418]:       <target dev="tap2e2b5832-b3"/>
Aug 09 18:22:01 user nova-compute[72418]:     </interface>
Aug 09 18:22:01 user nova-compute[72418]:     <serial type="pty">
Aug 09 18:22:01 user nova-compute[72418]:       <log file="/opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/console.log" append="off"/>
Aug 09 18:22:01 user nova-compute[72418]:     </serial>
Aug 09 18:22:01 user nova-compute[72418]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 18:22:01 user nova-compute[72418]:     <video>
Aug 09 18:22:01 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:22:01 user nova-compute[72418]:     </video>
Aug 09 18:22:01 user nova-compute[72418]:     <rng model="virtio">
Aug 09 18:22:01 user nova-compute[72418]:       <backend model="random">/dev/urandom</backend>
Aug 09 18:22:01 user nova-compute[72418]:     </rng>
Aug 09 18:22:01 user nova-compute[72418]:     <controller type="usb" index="0" model="none"/>
Aug 09 18:22:01 user nova-compute[72418]:     <memballoon model="virtio">
Aug 09 18:22:01 user nova-compute[72418]:       <stats period="10"/>
Aug 09 18:22:01 user nova-compute[72418]:     </memballoon>
Aug 09 18:22:01 user nova-compute[72418]:   </devices>
Aug 09 18:22:01 user nova-compute[72418]: </domain>
Aug 09 18:22:01 user nova-compute[72418]:  {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:21:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-127597739',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-127597739',id=2,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52e5863cda54487682a4edcc24202c91',ramdisk_id='',reservation_id='r-ng058tj6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1120385592',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:21:54Z,user_data=None,user_id='621fd2b971c543d197a354c38e0d1867',uuid=8fe41968-a219-4a5a-afdb-32eb2082bb40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e2b5832-b357-4012-8bfc-d26009aa91f8", "address": "fa:16:3e:ee:f9:5d", "network": {"id": "beaefb5c-f5e4-47e7-ab68-60131f532ade", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e5863cda54487682a4edcc24202c91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2b5832-b3", "ovs_interfaceid": "2e2b5832-b357-4012-8bfc-d26009aa91f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Converting VIF {"id": "2e2b5832-b357-4012-8bfc-d26009aa91f8", "address": "fa:16:3e:ee:f9:5d", "network": {"id": "beaefb5c-f5e4-47e7-ab68-60131f532ade", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e5863cda54487682a4edcc24202c91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2b5832-b3", "ovs_interfaceid": "2e2b5832-b357-4012-8bfc-d26009aa91f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:f9:5d,bridge_name='br-int',has_traffic_filtering=True,id=2e2b5832-b357-4012-8bfc-d26009aa91f8,network=Network(beaefb5c-f5e4-47e7-ab68-60131f532ade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e2b5832-b3') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG os_vif [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:f9:5d,bridge_name='br-int',has_traffic_filtering=True,id=2e2b5832-b357-4012-8bfc-d26009aa91f8,network=Network(beaefb5c-f5e4-47e7-ab68-60131f532ade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e2b5832-b3') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.network.neutron [req-f9c44f46-9292-4b96-a44e-75090036860e req-a3dc0706-4dad-4ed2-bee1-3204c6aceb38 service nova] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Updated VIF entry in instance network info cache for port 1487cbc0-54ec-4134-9e08-88f02ff870f5. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG nova.network.neutron [req-f9c44f46-9292-4b96-a44e-75090036860e req-a3dc0706-4dad-4ed2-bee1-3204c6aceb38 service nova] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Updating instance_info_cache with network_info: [{"id": "1487cbc0-54ec-4134-9e08-88f02ff870f5", "address": "fa:16:3e:b3:6b:21", "network": {"id": "15a49d9b-3c0d-449b-9473-29f219960e2c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c68622cd79472ba6ad14a6876aeaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1487cbc0-54", "ovs_interfaceid": "1487cbc0-54ec-4134-9e08-88f02ff870f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-f9c44f46-9292-4b96-a44e-75090036860e req-a3dc0706-4dad-4ed2-bee1-3204c6aceb38 service nova] Releasing lock "refresh_cache-01c46b33-6788-44a5-a43c-88ee4acc4d39" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:22:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:02 user nova-compute[72418]: DEBUG nova.network.neutron [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Updating instance_info_cache with network_info: [{"id": "c58368cc-29db-48a5-ab5d-a56526aba194", "address": "fa:16:3e:2e:8f:f7", "network": {"id": "e51a8e3c-5c3a-4057-bb86-f7a3f3f1f031", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1399538693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cc13d02ace44ca1a9ae7bf264a784cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc58368cc-29", "ovs_interfaceid": "c58368cc-29db-48a5-ab5d-a56526aba194", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:22:02 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Releasing lock "refresh_cache-17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:22:02 user nova-compute[72418]: DEBUG nova.compute.manager [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Instance network_info: |[{"id": "c58368cc-29db-48a5-ab5d-a56526aba194", "address": "fa:16:3e:2e:8f:f7", "network": {"id": "e51a8e3c-5c3a-4057-bb86-f7a3f3f1f031", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1399538693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cc13d02ace44ca1a9ae7bf264a784cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc58368cc-29", "ovs_interfaceid": "c58368cc-29db-48a5-ab5d-a56526aba194", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 18:22:02 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Start _get_guest_xml network_info=[{"id": "c58368cc-29db-48a5-ab5d-a56526aba194", "address": "fa:16:3e:2e:8f:f7", "network": {"id": "e51a8e3c-5c3a-4057-bb86-f7a3f3f1f031", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1399538693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cc13d02ace44ca1a9ae7bf264a784cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc58368cc-29", "ovs_interfaceid": "c58368cc-29db-48a5-ab5d-a56526aba194", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 18:22:02 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:22:02 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:22:02 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 18:22:02 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] CPU controller missing on host. {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 18:22:02 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 18:22:02 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] CPU controller found on host. {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 18:22:02 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72418) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 18:22:02 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T18:17:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 18:22:02 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Flavor limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 18:22:02 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Image limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 18:22:02 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Flavor pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 18:22:02 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Image pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 18:22:02 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 18:22:02 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 18:22:02 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 18:22:02 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Got 1 possible topologies {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 18:22:02 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 18:22:02 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 18:22:02 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:21:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1589364230',display_name='tempest-DeleteServersTestJSON-server-1589364230',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1589364230',id=3,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4cc13d02ace44ca1a9ae7bf264a784cf',ramdisk_id='',reservation_id='r-0ap2tpf3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1562741887',owner_user_name='tempest-DeleteServersTestJSON-1562741887-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:21:54Z,user_data=None,user_id='55f358ec00924ae69a00e3718cbc3f78',uuid=17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c58368cc-29db-48a5-ab5d-a56526aba194", "address": "fa:16:3e:2e:8f:f7", "network": {"id": "e51a8e3c-5c3a-4057-bb86-f7a3f3f1f031", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1399538693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cc13d02ace44ca1a9ae7bf264a784cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc58368cc-29", "ovs_interfaceid": "c58368cc-29db-48a5-ab5d-a56526aba194", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:22:02 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Converting VIF {"id": "c58368cc-29db-48a5-ab5d-a56526aba194", "address": "fa:16:3e:2e:8f:f7", "network": {"id": "e51a8e3c-5c3a-4057-bb86-f7a3f3f1f031", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1399538693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cc13d02ace44ca1a9ae7bf264a784cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc58368cc-29", "ovs_interfaceid": "c58368cc-29db-48a5-ab5d-a56526aba194", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:22:02 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:8f:f7,bridge_name='br-int',has_traffic_filtering=True,id=c58368cc-29db-48a5-ab5d-a56526aba194,network=Network(e51a8e3c-5c3a-4057-bb86-f7a3f3f1f031),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc58368cc-29') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:22:02 user nova-compute[72418]: DEBUG nova.objects.instance [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Lazy-loading 'pci_devices' on Instance uuid 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:22:02 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] End _get_guest_xml xml=<domain type="kvm">
Aug 09 18:22:02 user nova-compute[72418]:   <uuid>17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6</uuid>
Aug 09 18:22:02 user nova-compute[72418]:   <name>instance-00000003</name>
Aug 09 18:22:02 user nova-compute[72418]:   <memory>524288</memory>
Aug 09 18:22:02 user nova-compute[72418]:   <vcpu>1</vcpu>
Aug 09 18:22:02 user nova-compute[72418]:   <metadata>
Aug 09 18:22:02 user nova-compute[72418]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:22:02 user nova-compute[72418]:       <nova:package version="0.0.0"/>
Aug 09 18:22:02 user nova-compute[72418]:       <nova:name>tempest-DeleteServersTestJSON-server-1589364230</nova:name>
Aug 09 18:22:02 user nova-compute[72418]:       <nova:creationTime>2023-08-09 18:22:02</nova:creationTime>
Aug 09 18:22:02 user nova-compute[72418]:       <nova:flavor name="m1.tiny">
Aug 09 18:22:02 user nova-compute[72418]:         <nova:memory>512</nova:memory>
Aug 09 18:22:02 user nova-compute[72418]:         <nova:disk>1</nova:disk>
Aug 09 18:22:02 user nova-compute[72418]:         <nova:swap>0</nova:swap>
Aug 09 18:22:02 user nova-compute[72418]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:22:02 user nova-compute[72418]:         <nova:vcpus>1</nova:vcpus>
Aug 09 18:22:02 user nova-compute[72418]:       </nova:flavor>
Aug 09 18:22:02 user nova-compute[72418]:       <nova:owner>
Aug 09 18:22:02 user nova-compute[72418]:         <nova:user uuid="55f358ec00924ae69a00e3718cbc3f78">tempest-DeleteServersTestJSON-1562741887-project-member</nova:user>
Aug 09 18:22:02 user nova-compute[72418]:         <nova:project uuid="4cc13d02ace44ca1a9ae7bf264a784cf">tempest-DeleteServersTestJSON-1562741887</nova:project>
Aug 09 18:22:02 user nova-compute[72418]:       </nova:owner>
Aug 09 18:22:02 user nova-compute[72418]:       <nova:root type="image" uuid="8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e"/>
Aug 09 18:22:02 user nova-compute[72418]:       <nova:ports>
Aug 09 18:22:02 user nova-compute[72418]:         <nova:port uuid="c58368cc-29db-48a5-ab5d-a56526aba194">
Aug 09 18:22:02 user nova-compute[72418]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 18:22:02 user nova-compute[72418]:         </nova:port>
Aug 09 18:22:02 user nova-compute[72418]:       </nova:ports>
Aug 09 18:22:02 user nova-compute[72418]:     </nova:instance>
Aug 09 18:22:02 user nova-compute[72418]:   </metadata>
Aug 09 18:22:02 user nova-compute[72418]:   <sysinfo type="smbios">
Aug 09 18:22:02 user nova-compute[72418]:     <system>
Aug 09 18:22:02 user nova-compute[72418]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 18:22:02 user nova-compute[72418]:       <entry name="product">OpenStack Nova</entry>
Aug 09 18:22:02 user nova-compute[72418]:       <entry name="version">0.0.0</entry>
Aug 09 18:22:02 user nova-compute[72418]:       <entry name="serial">17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6</entry>
Aug 09 18:22:02 user nova-compute[72418]:       <entry name="uuid">17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6</entry>
Aug 09 18:22:02 user nova-compute[72418]:       <entry name="family">Virtual Machine</entry>
Aug 09 18:22:02 user nova-compute[72418]:     </system>
Aug 09 18:22:02 user nova-compute[72418]:   </sysinfo>
Aug 09 18:22:02 user nova-compute[72418]:   <os>
Aug 09 18:22:02 user nova-compute[72418]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 18:22:02 user nova-compute[72418]:     <boot dev="hd"/>
Aug 09 18:22:02 user nova-compute[72418]:     <smbios mode="sysinfo"/>
Aug 09 18:22:02 user nova-compute[72418]:   </os>
Aug 09 18:22:02 user nova-compute[72418]:   <features>
Aug 09 18:22:02 user nova-compute[72418]:     <acpi/>
Aug 09 18:22:02 user nova-compute[72418]:     <apic/>
Aug 09 18:22:02 user nova-compute[72418]:     <vmcoreinfo/>
Aug 09 18:22:02 user nova-compute[72418]:   </features>
Aug 09 18:22:02 user nova-compute[72418]:   <clock offset="utc">
Aug 09 18:22:02 user nova-compute[72418]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 18:22:02 user nova-compute[72418]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 18:22:02 user nova-compute[72418]:     <timer name="hpet" present="no"/>
Aug 09 18:22:02 user nova-compute[72418]:   </clock>
Aug 09 18:22:02 user nova-compute[72418]:   <cpu mode="custom" match="exact">
Aug 09 18:22:02 user nova-compute[72418]:     <model>Nehalem</model>
Aug 09 18:22:02 user nova-compute[72418]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 18:22:02 user nova-compute[72418]:   </cpu>
Aug 09 18:22:02 user nova-compute[72418]:   <devices>
Aug 09 18:22:02 user nova-compute[72418]:     <disk type="file" device="disk">
Aug 09 18:22:02 user nova-compute[72418]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 18:22:02 user nova-compute[72418]:       <source file="/opt/stack/data/nova/instances/17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6/disk"/>
Aug 09 18:22:02 user nova-compute[72418]:       <target dev="vda" bus="virtio"/>
Aug 09 18:22:02 user nova-compute[72418]:     </disk>
Aug 09 18:22:02 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:22:02 user nova-compute[72418]:       <mac address="fa:16:3e:2e:8f:f7"/>
Aug 09 18:22:02 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:22:02 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:22:02 user nova-compute[72418]:       <target dev="tapc58368cc-29"/>
Aug 09 18:22:02 user nova-compute[72418]:     </interface>
Aug 09 18:22:02 user nova-compute[72418]:     <serial type="pty">
Aug 09 18:22:02 user nova-compute[72418]:       <log file="/opt/stack/data/nova/instances/17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6/console.log" append="off"/>
Aug 09 18:22:02 user nova-compute[72418]:     </serial>
Aug 09 18:22:02 user nova-compute[72418]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 18:22:02 user nova-compute[72418]:     <video>
Aug 09 18:22:02 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:22:02 user nova-compute[72418]:     </video>
Aug 09 18:22:02 user nova-compute[72418]:     <rng model="virtio">
Aug 09 18:22:02 user nova-compute[72418]:       <backend model="random">/dev/urandom</backend>
Aug 09 18:22:02 user nova-compute[72418]:     </rng>
Aug 09 18:22:02 user nova-compute[72418]:     <controller type="usb" index="0" model="none"/>
Aug 09 18:22:02 user nova-compute[72418]:     <memballoon model="virtio">
Aug 09 18:22:02 user nova-compute[72418]:       <stats period="10"/>
Aug 09 18:22:02 user nova-compute[72418]:     </memballoon>
Aug 09 18:22:02 user nova-compute[72418]:   </devices>
Aug 09 18:22:02 user nova-compute[72418]: </domain>
Aug 09 18:22:02 user nova-compute[72418]:  {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 18:22:02 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:21:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1589364230',display_name='tempest-DeleteServersTestJSON-server-1589364230',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1589364230',id=3,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4cc13d02ace44ca1a9ae7bf264a784cf',ramdisk_id='',reservation_id='r-0ap2tpf3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1562741887',owner_user_name='tempest-DeleteServersTestJSON-1562741887-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:21:54Z,user_data=None,user_id='55f358ec00924ae69a00e3718cbc3f78',uuid=17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c58368cc-29db-48a5-ab5d-a56526aba194", "address": "fa:16:3e:2e:8f:f7", "network": {"id": "e51a8e3c-5c3a-4057-bb86-f7a3f3f1f031", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1399538693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cc13d02ace44ca1a9ae7bf264a784cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc58368cc-29", "ovs_interfaceid": "c58368cc-29db-48a5-ab5d-a56526aba194", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:22:02 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Converting VIF {"id": "c58368cc-29db-48a5-ab5d-a56526aba194", "address": "fa:16:3e:2e:8f:f7", "network": {"id": "e51a8e3c-5c3a-4057-bb86-f7a3f3f1f031", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1399538693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cc13d02ace44ca1a9ae7bf264a784cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc58368cc-29", "ovs_interfaceid": "c58368cc-29db-48a5-ab5d-a56526aba194", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:22:02 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:8f:f7,bridge_name='br-int',has_traffic_filtering=True,id=c58368cc-29db-48a5-ab5d-a56526aba194,network=Network(e51a8e3c-5c3a-4057-bb86-f7a3f3f1f031),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc58368cc-29') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:22:02 user nova-compute[72418]: DEBUG os_vif [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:8f:f7,bridge_name='br-int',has_traffic_filtering=True,id=c58368cc-29db-48a5-ab5d-a56526aba194,network=Network(e51a8e3c-5c3a-4057-bb86-f7a3f3f1f031),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc58368cc-29') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:22:02 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:02 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:22:02 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:22:02 user nova-compute[72418]: DEBUG nova.network.neutron [req-43f9904c-3b03-4414-a411-49a594f22606 req-3e78d534-3d5c-4fab-9de1-29dd179ed61d service nova] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Updated VIF entry in instance network info cache for port 2b44ecc4-13c5-43ba-8425-5f42d86bc716. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:22:02 user nova-compute[72418]: DEBUG nova.network.neutron [req-43f9904c-3b03-4414-a411-49a594f22606 req-3e78d534-3d5c-4fab-9de1-29dd179ed61d service nova] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Updating instance_info_cache with network_info: [{"id": "2b44ecc4-13c5-43ba-8425-5f42d86bc716", "address": "fa:16:3e:8d:41:82", "network": {"id": "15a49d9b-3c0d-449b-9473-29f219960e2c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c68622cd79472ba6ad14a6876aeaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b44ecc4-13", "ovs_interfaceid": "2b44ecc4-13c5-43ba-8425-5f42d86bc716", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:22:02 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-43f9904c-3b03-4414-a411-49a594f22606 req-3e78d534-3d5c-4fab-9de1-29dd179ed61d service nova] Releasing lock "refresh_cache-6af7918a-ce90-45ab-93d8-684e1489e891" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:22:02 user sudo[81691]: pam_unix(sudo:session): session closed for user root
Aug 09 18:22:02 user nova-compute[72418]: INFO oslo.privsep.daemon [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Spawned new privsep daemon via rootwrap
Aug 09 18:22:02 user nova-compute[72418]: DEBUG nova.network.neutron [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Successfully updated port: 1ebdd43e-c423-4e1c-9e50-1419f2857ae4 {{(pid=72418) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 18:22:02 user nova-compute[72418]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 09 18:22:02 user nova-compute[72418]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 09 18:22:02 user nova-compute[72418]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 09 18:22:02 user nova-compute[72418]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81694
Aug 09 18:22:02 user nova-compute[72418]: WARNING oslo_privsep.priv_context [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] privsep daemon already running
Aug 09 18:22:02 user nova-compute[72418]: WARNING oslo_privsep.priv_context [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] privsep daemon already running
Aug 09 18:22:02 user nova-compute[72418]: WARNING oslo_privsep.priv_context [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] privsep daemon already running
Aug 09 18:22:02 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Acquiring lock "refresh_cache-479ea4c3-ad7f-4da0-a901-defe46d96065" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:22:02 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Acquired lock "refresh_cache-479ea4c3-ad7f-4da0-a901-defe46d96065" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:22:02 user nova-compute[72418]: DEBUG nova.network.neutron [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:22:02 user nova-compute[72418]: DEBUG nova.network.neutron [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Instance cache missing network info. {{(pid=72418) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 18:22:03 user nova-compute[72418]: DEBUG nova.compute.manager [req-665221fe-f5db-462e-a39f-9d91e3d1a74a req-c14d66c6-ec02-465b-82d4-4a8281a826c2 service nova] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Received event network-changed-1ebdd43e-c423-4e1c-9e50-1419f2857ae4 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:22:03 user nova-compute[72418]: DEBUG nova.compute.manager [req-665221fe-f5db-462e-a39f-9d91e3d1a74a req-c14d66c6-ec02-465b-82d4-4a8281a826c2 service nova] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Refreshing instance network info cache due to event network-changed-1ebdd43e-c423-4e1c-9e50-1419f2857ae4. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:22:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-665221fe-f5db-462e-a39f-9d91e3d1a74a req-c14d66c6-ec02-465b-82d4-4a8281a826c2 service nova] Acquiring lock "refresh_cache-479ea4c3-ad7f-4da0-a901-defe46d96065" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:22:03 user nova-compute[72418]: DEBUG nova.network.neutron [req-a83f4d17-d327-460d-8284-9048afff5080 req-83651fff-b36f-4813-9d1e-3c4db9875442 service nova] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Updated VIF entry in instance network info cache for port 2e2b5832-b357-4012-8bfc-d26009aa91f8. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:22:03 user nova-compute[72418]: DEBUG nova.network.neutron [req-a83f4d17-d327-460d-8284-9048afff5080 req-83651fff-b36f-4813-9d1e-3c4db9875442 service nova] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Updating instance_info_cache with network_info: [{"id": "2e2b5832-b357-4012-8bfc-d26009aa91f8", "address": "fa:16:3e:ee:f9:5d", "network": {"id": "beaefb5c-f5e4-47e7-ab68-60131f532ade", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e5863cda54487682a4edcc24202c91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2b5832-b3", "ovs_interfaceid": "2e2b5832-b357-4012-8bfc-d26009aa91f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:22:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a83f4d17-d327-460d-8284-9048afff5080 req-83651fff-b36f-4813-9d1e-3c4db9875442 service nova] Releasing lock "refresh_cache-8fe41968-a219-4a5a-afdb-32eb2082bb40" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:22:03 user nova-compute[72418]: DEBUG nova.compute.manager [req-a83f4d17-d327-460d-8284-9048afff5080 req-83651fff-b36f-4813-9d1e-3c4db9875442 service nova] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Received event network-changed-c58368cc-29db-48a5-ab5d-a56526aba194 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:22:03 user nova-compute[72418]: DEBUG nova.compute.manager [req-a83f4d17-d327-460d-8284-9048afff5080 req-83651fff-b36f-4813-9d1e-3c4db9875442 service nova] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Refreshing instance network info cache due to event network-changed-c58368cc-29db-48a5-ab5d-a56526aba194. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:22:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a83f4d17-d327-460d-8284-9048afff5080 req-83651fff-b36f-4813-9d1e-3c4db9875442 service nova] Acquiring lock "refresh_cache-17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:22:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a83f4d17-d327-460d-8284-9048afff5080 req-83651fff-b36f-4813-9d1e-3c4db9875442 service nova] Acquired lock "refresh_cache-17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:22:03 user nova-compute[72418]: DEBUG nova.network.neutron [req-a83f4d17-d327-460d-8284-9048afff5080 req-83651fff-b36f-4813-9d1e-3c4db9875442 service nova] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Refreshing network info cache for port c58368cc-29db-48a5-ab5d-a56526aba194 {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:22:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2e2b5832-b3, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:22:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2e2b5832-b3, col_values=(('external_ids', {'iface-id': '2e2b5832-b357-4012-8bfc-d26009aa91f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:f9:5d', 'vm-uuid': '8fe41968-a219-4a5a-afdb-32eb2082bb40'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:22:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:22:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:03 user nova-compute[72418]: INFO os_vif [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:f9:5d,bridge_name='br-int',has_traffic_filtering=True,id=2e2b5832-b357-4012-8bfc-d26009aa91f8,network=Network(beaefb5c-f5e4-47e7-ab68-60131f532ade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e2b5832-b3')
Aug 09 18:22:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1487cbc0-54, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:22:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1487cbc0-54, col_values=(('external_ids', {'iface-id': '1487cbc0-54ec-4134-9e08-88f02ff870f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:6b:21', 'vm-uuid': '01c46b33-6788-44a5-a43c-88ee4acc4d39'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:22:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:22:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:03 user nova-compute[72418]: INFO os_vif [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:6b:21,bridge_name='br-int',has_traffic_filtering=True,id=1487cbc0-54ec-4134-9e08-88f02ff870f5,network=Network(15a49d9b-3c0d-449b-9473-29f219960e2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1487cbc0-54')
Aug 09 18:22:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc58368cc-29, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:22:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc58368cc-29, col_values=(('external_ids', {'iface-id': 'c58368cc-29db-48a5-ab5d-a56526aba194', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:8f:f7', 'vm-uuid': '17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:22:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:22:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:03 user nova-compute[72418]: INFO os_vif [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:8f:f7,bridge_name='br-int',has_traffic_filtering=True,id=c58368cc-29db-48a5-ab5d-a56526aba194,network=Network(e51a8e3c-5c3a-4057-bb86-f7a3f3f1f031),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc58368cc-29')
Aug 09 18:22:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b44ecc4-13, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:22:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2b44ecc4-13, col_values=(('external_ids', {'iface-id': '2b44ecc4-13c5-43ba-8425-5f42d86bc716', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:41:82', 'vm-uuid': '6af7918a-ce90-45ab-93d8-684e1489e891'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:22:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:22:03 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:22:03 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] No VIF found with MAC fa:16:3e:ee:f9:5d, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:22:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:03 user nova-compute[72418]: INFO os_vif [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:41:82,bridge_name='br-int',has_traffic_filtering=True,id=2b44ecc4-13c5-43ba-8425-5f42d86bc716,network=Network(15a49d9b-3c0d-449b-9473-29f219960e2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b44ecc4-13')
Aug 09 18:22:03 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:22:03 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] No VIF found with MAC fa:16:3e:b3:6b:21, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:22:03 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:22:03 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] No VIF found with MAC fa:16:3e:2e:8f:f7, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:22:03 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:22:03 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] No VIF found with MAC fa:16:3e:8d:41:82, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:22:04 user nova-compute[72418]: DEBUG nova.network.neutron [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Updating instance_info_cache with network_info: [{"id": "1ebdd43e-c423-4e1c-9e50-1419f2857ae4", "address": "fa:16:3e:3b:33:c3", "network": {"id": "d72da164-7e30-4eeb-8c28-765454c2b24f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1301909372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e3274c2e3447fcad6d1f16765f4afd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ebdd43e-c4", "ovs_interfaceid": "1ebdd43e-c423-4e1c-9e50-1419f2857ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:22:04 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Releasing lock "refresh_cache-479ea4c3-ad7f-4da0-a901-defe46d96065" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:22:04 user nova-compute[72418]: DEBUG nova.compute.manager [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Instance network_info: |[{"id": "1ebdd43e-c423-4e1c-9e50-1419f2857ae4", "address": "fa:16:3e:3b:33:c3", "network": {"id": "d72da164-7e30-4eeb-8c28-765454c2b24f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1301909372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e3274c2e3447fcad6d1f16765f4afd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ebdd43e-c4", "ovs_interfaceid": "1ebdd43e-c423-4e1c-9e50-1419f2857ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 18:22:04 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-665221fe-f5db-462e-a39f-9d91e3d1a74a req-c14d66c6-ec02-465b-82d4-4a8281a826c2 service nova] Acquired lock "refresh_cache-479ea4c3-ad7f-4da0-a901-defe46d96065" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:22:04 user nova-compute[72418]: DEBUG nova.network.neutron [req-665221fe-f5db-462e-a39f-9d91e3d1a74a req-c14d66c6-ec02-465b-82d4-4a8281a826c2 service nova] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Refreshing network info cache for port 1ebdd43e-c423-4e1c-9e50-1419f2857ae4 {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:22:04 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Start _get_guest_xml network_info=[{"id": "1ebdd43e-c423-4e1c-9e50-1419f2857ae4", "address": "fa:16:3e:3b:33:c3", "network": {"id": "d72da164-7e30-4eeb-8c28-765454c2b24f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1301909372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e3274c2e3447fcad6d1f16765f4afd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ebdd43e-c4", "ovs_interfaceid": "1ebdd43e-c423-4e1c-9e50-1419f2857ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 18:22:04 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:22:04 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:22:04 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 18:22:04 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] CPU controller missing on host. {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 18:22:04 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 18:22:04 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] CPU controller found on host. {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 18:22:04 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72418) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 18:22:04 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T18:17:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 18:22:04 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Flavor limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 18:22:04 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Image limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 18:22:04 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Flavor pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 18:22:04 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Image pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 18:22:04 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 18:22:04 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 18:22:04 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 18:22:04 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Got 1 possible topologies {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 18:22:04 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 18:22:04 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 18:22:04 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:21:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1950373992',display_name='tempest-ServersNegativeTestJSON-server-1950373992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1950373992',id=5,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60e3274c2e3447fcad6d1f16765f4afd',ramdisk_id='',reservation_id='r-vf6jwbyi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1802403477',owner_user_name='tempest-ServersNegativeTestJSON-1802403477-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:21:55Z,user_data=None,user_id='6e1439f58ac640f481a59944ee145f97',uuid=479ea4c3-ad7f-4da0-a901-defe46d96065,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ebdd43e-c423-4e1c-9e50-1419f2857ae4", "address": "fa:16:3e:3b:33:c3", "network": {"id": "d72da164-7e30-4eeb-8c28-765454c2b24f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1301909372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e3274c2e3447fcad6d1f16765f4afd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ebdd43e-c4", "ovs_interfaceid": "1ebdd43e-c423-4e1c-9e50-1419f2857ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:22:04 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Converting VIF {"id": "1ebdd43e-c423-4e1c-9e50-1419f2857ae4", "address": "fa:16:3e:3b:33:c3", "network": {"id": "d72da164-7e30-4eeb-8c28-765454c2b24f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1301909372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e3274c2e3447fcad6d1f16765f4afd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ebdd43e-c4", "ovs_interfaceid": "1ebdd43e-c423-4e1c-9e50-1419f2857ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:22:04 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:33:c3,bridge_name='br-int',has_traffic_filtering=True,id=1ebdd43e-c423-4e1c-9e50-1419f2857ae4,network=Network(d72da164-7e30-4eeb-8c28-765454c2b24f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ebdd43e-c4') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:22:04 user nova-compute[72418]: DEBUG nova.objects.instance [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Lazy-loading 'pci_devices' on Instance uuid 479ea4c3-ad7f-4da0-a901-defe46d96065 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:22:04 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] End _get_guest_xml xml=<domain type="kvm">
Aug 09 18:22:04 user nova-compute[72418]:   <uuid>479ea4c3-ad7f-4da0-a901-defe46d96065</uuid>
Aug 09 18:22:04 user nova-compute[72418]:   <name>instance-00000005</name>
Aug 09 18:22:04 user nova-compute[72418]:   <memory>524288</memory>
Aug 09 18:22:04 user nova-compute[72418]:   <vcpu>1</vcpu>
Aug 09 18:22:04 user nova-compute[72418]:   <metadata>
Aug 09 18:22:04 user nova-compute[72418]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:22:04 user nova-compute[72418]:       <nova:package version="0.0.0"/>
Aug 09 18:22:04 user nova-compute[72418]:       <nova:name>tempest-ServersNegativeTestJSON-server-1950373992</nova:name>
Aug 09 18:22:04 user nova-compute[72418]:       <nova:creationTime>2023-08-09 18:22:04</nova:creationTime>
Aug 09 18:22:04 user nova-compute[72418]:       <nova:flavor name="m1.tiny">
Aug 09 18:22:04 user nova-compute[72418]:         <nova:memory>512</nova:memory>
Aug 09 18:22:04 user nova-compute[72418]:         <nova:disk>1</nova:disk>
Aug 09 18:22:04 user nova-compute[72418]:         <nova:swap>0</nova:swap>
Aug 09 18:22:04 user nova-compute[72418]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:22:04 user nova-compute[72418]:         <nova:vcpus>1</nova:vcpus>
Aug 09 18:22:04 user nova-compute[72418]:       </nova:flavor>
Aug 09 18:22:04 user nova-compute[72418]:       <nova:owner>
Aug 09 18:22:04 user nova-compute[72418]:         <nova:user uuid="6e1439f58ac640f481a59944ee145f97">tempest-ServersNegativeTestJSON-1802403477-project-member</nova:user>
Aug 09 18:22:04 user nova-compute[72418]:         <nova:project uuid="60e3274c2e3447fcad6d1f16765f4afd">tempest-ServersNegativeTestJSON-1802403477</nova:project>
Aug 09 18:22:04 user nova-compute[72418]:       </nova:owner>
Aug 09 18:22:04 user nova-compute[72418]:       <nova:root type="image" uuid="8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e"/>
Aug 09 18:22:04 user nova-compute[72418]:       <nova:ports>
Aug 09 18:22:04 user nova-compute[72418]:         <nova:port uuid="1ebdd43e-c423-4e1c-9e50-1419f2857ae4">
Aug 09 18:22:04 user nova-compute[72418]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 09 18:22:04 user nova-compute[72418]:         </nova:port>
Aug 09 18:22:04 user nova-compute[72418]:       </nova:ports>
Aug 09 18:22:04 user nova-compute[72418]:     </nova:instance>
Aug 09 18:22:04 user nova-compute[72418]:   </metadata>
Aug 09 18:22:04 user nova-compute[72418]:   <sysinfo type="smbios">
Aug 09 18:22:04 user nova-compute[72418]:     <system>
Aug 09 18:22:04 user nova-compute[72418]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 18:22:04 user nova-compute[72418]:       <entry name="product">OpenStack Nova</entry>
Aug 09 18:22:04 user nova-compute[72418]:       <entry name="version">0.0.0</entry>
Aug 09 18:22:04 user nova-compute[72418]:       <entry name="serial">479ea4c3-ad7f-4da0-a901-defe46d96065</entry>
Aug 09 18:22:04 user nova-compute[72418]:       <entry name="uuid">479ea4c3-ad7f-4da0-a901-defe46d96065</entry>
Aug 09 18:22:04 user nova-compute[72418]:       <entry name="family">Virtual Machine</entry>
Aug 09 18:22:04 user nova-compute[72418]:     </system>
Aug 09 18:22:04 user nova-compute[72418]:   </sysinfo>
Aug 09 18:22:04 user nova-compute[72418]:   <os>
Aug 09 18:22:04 user nova-compute[72418]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 18:22:04 user nova-compute[72418]:     <boot dev="hd"/>
Aug 09 18:22:04 user nova-compute[72418]:     <smbios mode="sysinfo"/>
Aug 09 18:22:04 user nova-compute[72418]:   </os>
Aug 09 18:22:04 user nova-compute[72418]:   <features>
Aug 09 18:22:04 user nova-compute[72418]:     <acpi/>
Aug 09 18:22:04 user nova-compute[72418]:     <apic/>
Aug 09 18:22:04 user nova-compute[72418]:     <vmcoreinfo/>
Aug 09 18:22:04 user nova-compute[72418]:   </features>
Aug 09 18:22:04 user nova-compute[72418]:   <clock offset="utc">
Aug 09 18:22:04 user nova-compute[72418]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 18:22:04 user nova-compute[72418]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 18:22:04 user nova-compute[72418]:     <timer name="hpet" present="no"/>
Aug 09 18:22:04 user nova-compute[72418]:   </clock>
Aug 09 18:22:04 user nova-compute[72418]:   <cpu mode="custom" match="exact">
Aug 09 18:22:04 user nova-compute[72418]:     <model>Nehalem</model>
Aug 09 18:22:04 user nova-compute[72418]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 18:22:04 user nova-compute[72418]:   </cpu>
Aug 09 18:22:04 user nova-compute[72418]:   <devices>
Aug 09 18:22:04 user nova-compute[72418]:     <disk type="file" device="disk">
Aug 09 18:22:04 user nova-compute[72418]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 18:22:04 user nova-compute[72418]:       <source file="/opt/stack/data/nova/instances/479ea4c3-ad7f-4da0-a901-defe46d96065/disk"/>
Aug 09 18:22:04 user nova-compute[72418]:       <target dev="vda" bus="virtio"/>
Aug 09 18:22:04 user nova-compute[72418]:     </disk>
Aug 09 18:22:04 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:22:04 user nova-compute[72418]:       <mac address="fa:16:3e:3b:33:c3"/>
Aug 09 18:22:04 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:22:04 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:22:04 user nova-compute[72418]:       <target dev="tap1ebdd43e-c4"/>
Aug 09 18:22:04 user nova-compute[72418]:     </interface>
Aug 09 18:22:04 user nova-compute[72418]:     <serial type="pty">
Aug 09 18:22:04 user nova-compute[72418]:       <log file="/opt/stack/data/nova/instances/479ea4c3-ad7f-4da0-a901-defe46d96065/console.log" append="off"/>
Aug 09 18:22:04 user nova-compute[72418]:     </serial>
Aug 09 18:22:04 user nova-compute[72418]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 18:22:04 user nova-compute[72418]:     <video>
Aug 09 18:22:04 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:22:04 user nova-compute[72418]:     </video>
Aug 09 18:22:04 user nova-compute[72418]:     <rng model="virtio">
Aug 09 18:22:04 user nova-compute[72418]:       <backend model="random">/dev/urandom</backend>
Aug 09 18:22:04 user nova-compute[72418]:     </rng>
Aug 09 18:22:04 user nova-compute[72418]:     <controller type="usb" index="0" model="none"/>
Aug 09 18:22:04 user nova-compute[72418]:     <memballoon model="virtio">
Aug 09 18:22:04 user nova-compute[72418]:       <stats period="10"/>
Aug 09 18:22:04 user nova-compute[72418]:     </memballoon>
Aug 09 18:22:04 user nova-compute[72418]:   </devices>
Aug 09 18:22:04 user nova-compute[72418]: </domain>
Aug 09 18:22:04 user nova-compute[72418]:  {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 18:22:04 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:21:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1950373992',display_name='tempest-ServersNegativeTestJSON-server-1950373992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1950373992',id=5,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60e3274c2e3447fcad6d1f16765f4afd',ramdisk_id='',reservation_id='r-vf6jwbyi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1802403477',owner_user_name='tempest-ServersNegativeTestJSON-1802403477-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:21:55Z,user_data=None,user_id='6e1439f58ac640f481a59944ee145f97',uuid=479ea4c3-ad7f-4da0-a901-defe46d96065,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ebdd43e-c423-4e1c-9e50-1419f2857ae4", "address": "fa:16:3e:3b:33:c3", "network": {"id": "d72da164-7e30-4eeb-8c28-765454c2b24f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1301909372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e3274c2e3447fcad6d1f16765f4afd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ebdd43e-c4", "ovs_interfaceid": "1ebdd43e-c423-4e1c-9e50-1419f2857ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:22:04 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Converting VIF {"id": "1ebdd43e-c423-4e1c-9e50-1419f2857ae4", "address": "fa:16:3e:3b:33:c3", "network": {"id": "d72da164-7e30-4eeb-8c28-765454c2b24f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1301909372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e3274c2e3447fcad6d1f16765f4afd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ebdd43e-c4", "ovs_interfaceid": "1ebdd43e-c423-4e1c-9e50-1419f2857ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:22:04 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:33:c3,bridge_name='br-int',has_traffic_filtering=True,id=1ebdd43e-c423-4e1c-9e50-1419f2857ae4,network=Network(d72da164-7e30-4eeb-8c28-765454c2b24f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ebdd43e-c4') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:22:04 user nova-compute[72418]: DEBUG os_vif [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:33:c3,bridge_name='br-int',has_traffic_filtering=True,id=1ebdd43e-c423-4e1c-9e50-1419f2857ae4,network=Network(d72da164-7e30-4eeb-8c28-765454c2b24f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ebdd43e-c4') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:22:04 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:04 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:22:04 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:22:04 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:04 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ebdd43e-c4, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:22:04 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1ebdd43e-c4, col_values=(('external_ids', {'iface-id': '1ebdd43e-c423-4e1c-9e50-1419f2857ae4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:33:c3', 'vm-uuid': '479ea4c3-ad7f-4da0-a901-defe46d96065'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:22:04 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:22:04 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:04 user nova-compute[72418]: INFO os_vif [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:33:c3,bridge_name='br-int',has_traffic_filtering=True,id=1ebdd43e-c423-4e1c-9e50-1419f2857ae4,network=Network(d72da164-7e30-4eeb-8c28-765454c2b24f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ebdd43e-c4')
Aug 09 18:22:04 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:22:04 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] No VIF found with MAC fa:16:3e:3b:33:c3, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:22:04 user nova-compute[72418]: DEBUG nova.network.neutron [req-a83f4d17-d327-460d-8284-9048afff5080 req-83651fff-b36f-4813-9d1e-3c4db9875442 service nova] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Updated VIF entry in instance network info cache for port c58368cc-29db-48a5-ab5d-a56526aba194. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:22:04 user nova-compute[72418]: DEBUG nova.network.neutron [req-a83f4d17-d327-460d-8284-9048afff5080 req-83651fff-b36f-4813-9d1e-3c4db9875442 service nova] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Updating instance_info_cache with network_info: [{"id": "c58368cc-29db-48a5-ab5d-a56526aba194", "address": "fa:16:3e:2e:8f:f7", "network": {"id": "e51a8e3c-5c3a-4057-bb86-f7a3f3f1f031", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1399538693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cc13d02ace44ca1a9ae7bf264a784cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc58368cc-29", "ovs_interfaceid": "c58368cc-29db-48a5-ab5d-a56526aba194", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:22:04 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a83f4d17-d327-460d-8284-9048afff5080 req-83651fff-b36f-4813-9d1e-3c4db9875442 service nova] Releasing lock "refresh_cache-17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:22:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:06 user nova-compute[72418]: DEBUG nova.network.neutron [req-665221fe-f5db-462e-a39f-9d91e3d1a74a req-c14d66c6-ec02-465b-82d4-4a8281a826c2 service nova] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Updated VIF entry in instance network info cache for port 1ebdd43e-c423-4e1c-9e50-1419f2857ae4. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:22:06 user nova-compute[72418]: DEBUG nova.network.neutron [req-665221fe-f5db-462e-a39f-9d91e3d1a74a req-c14d66c6-ec02-465b-82d4-4a8281a826c2 service nova] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Updating instance_info_cache with network_info: [{"id": "1ebdd43e-c423-4e1c-9e50-1419f2857ae4", "address": "fa:16:3e:3b:33:c3", "network": {"id": "d72da164-7e30-4eeb-8c28-765454c2b24f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1301909372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e3274c2e3447fcad6d1f16765f4afd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ebdd43e-c4", "ovs_interfaceid": "1ebdd43e-c423-4e1c-9e50-1419f2857ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:22:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-665221fe-f5db-462e-a39f-9d91e3d1a74a req-c14d66c6-ec02-465b-82d4-4a8281a826c2 service nova] Releasing lock "refresh_cache-479ea4c3-ad7f-4da0-a901-defe46d96065" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:22:06 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:08 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:08 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:08 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:08 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:08 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:09 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:09 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:09 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:09 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:09 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:09 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:09 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:09 user nova-compute[72418]: DEBUG nova.compute.manager [req-486bbd9e-d40f-4781-84cb-80be87a2dd29 req-a19d5797-dec7-4ea1-9e10-a69f9d5bfe5e service nova] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Received event network-vif-plugged-1ebdd43e-c423-4e1c-9e50-1419f2857ae4 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:22:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-486bbd9e-d40f-4781-84cb-80be87a2dd29 req-a19d5797-dec7-4ea1-9e10-a69f9d5bfe5e service nova] Acquiring lock "479ea4c3-ad7f-4da0-a901-defe46d96065-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:22:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-486bbd9e-d40f-4781-84cb-80be87a2dd29 req-a19d5797-dec7-4ea1-9e10-a69f9d5bfe5e service nova] Lock "479ea4c3-ad7f-4da0-a901-defe46d96065-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:22:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-486bbd9e-d40f-4781-84cb-80be87a2dd29 req-a19d5797-dec7-4ea1-9e10-a69f9d5bfe5e service nova] Lock "479ea4c3-ad7f-4da0-a901-defe46d96065-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:22:09 user nova-compute[72418]: DEBUG nova.compute.manager [req-486bbd9e-d40f-4781-84cb-80be87a2dd29 req-a19d5797-dec7-4ea1-9e10-a69f9d5bfe5e service nova] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] No waiting events found dispatching network-vif-plugged-1ebdd43e-c423-4e1c-9e50-1419f2857ae4 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:22:09 user nova-compute[72418]: WARNING nova.compute.manager [req-486bbd9e-d40f-4781-84cb-80be87a2dd29 req-a19d5797-dec7-4ea1-9e10-a69f9d5bfe5e service nova] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Received unexpected event network-vif-plugged-1ebdd43e-c423-4e1c-9e50-1419f2857ae4 for instance with vm_state building and task_state spawning.
Aug 09 18:22:10 user nova-compute[72418]: DEBUG nova.compute.manager [req-ebda763f-9715-4f81-bc5d-874c2bb3b9dc req-1510c481-c2f9-4659-8c78-491acf06dd59 service nova] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Received event network-vif-plugged-2b44ecc4-13c5-43ba-8425-5f42d86bc716 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:22:10 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-ebda763f-9715-4f81-bc5d-874c2bb3b9dc req-1510c481-c2f9-4659-8c78-491acf06dd59 service nova] Acquiring lock "6af7918a-ce90-45ab-93d8-684e1489e891-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:22:10 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-ebda763f-9715-4f81-bc5d-874c2bb3b9dc req-1510c481-c2f9-4659-8c78-491acf06dd59 service nova] Lock "6af7918a-ce90-45ab-93d8-684e1489e891-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:22:10 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-ebda763f-9715-4f81-bc5d-874c2bb3b9dc req-1510c481-c2f9-4659-8c78-491acf06dd59 service nova] Lock "6af7918a-ce90-45ab-93d8-684e1489e891-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:22:10 user nova-compute[72418]: DEBUG nova.compute.manager [req-ebda763f-9715-4f81-bc5d-874c2bb3b9dc req-1510c481-c2f9-4659-8c78-491acf06dd59 service nova] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] No waiting events found dispatching network-vif-plugged-2b44ecc4-13c5-43ba-8425-5f42d86bc716 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:22:10 user nova-compute[72418]: WARNING nova.compute.manager [req-ebda763f-9715-4f81-bc5d-874c2bb3b9dc req-1510c481-c2f9-4659-8c78-491acf06dd59 service nova] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Received unexpected event network-vif-plugged-2b44ecc4-13c5-43ba-8425-5f42d86bc716 for instance with vm_state building and task_state spawning.
Aug 09 18:22:10 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:10 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:10 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:10 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:10 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:11 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:11 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:11 user nova-compute[72418]: DEBUG nova.compute.manager [req-d2b6f1af-1b47-45f4-8259-9ab163ac70a0 req-4a2de84e-350a-44d4-b4bc-a4a4f9ba538b service nova] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Received event network-vif-plugged-2e2b5832-b357-4012-8bfc-d26009aa91f8 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:22:11 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-d2b6f1af-1b47-45f4-8259-9ab163ac70a0 req-4a2de84e-350a-44d4-b4bc-a4a4f9ba538b service nova] Acquiring lock "8fe41968-a219-4a5a-afdb-32eb2082bb40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:22:11 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-d2b6f1af-1b47-45f4-8259-9ab163ac70a0 req-4a2de84e-350a-44d4-b4bc-a4a4f9ba538b service nova] Lock "8fe41968-a219-4a5a-afdb-32eb2082bb40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:22:11 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-d2b6f1af-1b47-45f4-8259-9ab163ac70a0 req-4a2de84e-350a-44d4-b4bc-a4a4f9ba538b service nova] Lock "8fe41968-a219-4a5a-afdb-32eb2082bb40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:22:11 user nova-compute[72418]: DEBUG nova.compute.manager [req-d2b6f1af-1b47-45f4-8259-9ab163ac70a0 req-4a2de84e-350a-44d4-b4bc-a4a4f9ba538b service nova] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] No waiting events found dispatching network-vif-plugged-2e2b5832-b357-4012-8bfc-d26009aa91f8 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:22:11 user nova-compute[72418]: WARNING nova.compute.manager [req-d2b6f1af-1b47-45f4-8259-9ab163ac70a0 req-4a2de84e-350a-44d4-b4bc-a4a4f9ba538b service nova] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Received unexpected event network-vif-plugged-2e2b5832-b357-4012-8bfc-d26009aa91f8 for instance with vm_state building and task_state spawning.
Aug 09 18:22:11 user nova-compute[72418]: DEBUG nova.compute.manager [req-16790c4f-89fa-44c0-a47f-618e117c5d07 req-a7914fc1-cdde-4a5e-b80e-e81743522d56 service nova] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Received event network-vif-plugged-1ebdd43e-c423-4e1c-9e50-1419f2857ae4 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:22:11 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-16790c4f-89fa-44c0-a47f-618e117c5d07 req-a7914fc1-cdde-4a5e-b80e-e81743522d56 service nova] Acquiring lock "479ea4c3-ad7f-4da0-a901-defe46d96065-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:22:11 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-16790c4f-89fa-44c0-a47f-618e117c5d07 req-a7914fc1-cdde-4a5e-b80e-e81743522d56 service nova] Lock "479ea4c3-ad7f-4da0-a901-defe46d96065-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:22:11 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-16790c4f-89fa-44c0-a47f-618e117c5d07 req-a7914fc1-cdde-4a5e-b80e-e81743522d56 service nova] Lock "479ea4c3-ad7f-4da0-a901-defe46d96065-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:22:11 user nova-compute[72418]: DEBUG nova.compute.manager [req-16790c4f-89fa-44c0-a47f-618e117c5d07 req-a7914fc1-cdde-4a5e-b80e-e81743522d56 service nova] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] No waiting events found dispatching network-vif-plugged-1ebdd43e-c423-4e1c-9e50-1419f2857ae4 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:22:11 user nova-compute[72418]: WARNING nova.compute.manager [req-16790c4f-89fa-44c0-a47f-618e117c5d07 req-a7914fc1-cdde-4a5e-b80e-e81743522d56 service nova] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Received unexpected event network-vif-plugged-1ebdd43e-c423-4e1c-9e50-1419f2857ae4 for instance with vm_state building and task_state spawning.
Aug 09 18:22:11 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Acquiring lock "6084e681-01c4-4a6c-beb3-dcda4a990a51" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:22:11 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Lock "6084e681-01c4-4a6c-beb3-dcda4a990a51" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:22:11 user nova-compute[72418]: DEBUG nova.compute.manager [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Starting instance... {{(pid=72418) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 18:22:11 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:22:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:22:12 user nova-compute[72418]: DEBUG nova.compute.manager [req-944e2547-a946-4946-bf04-3b5e0902beb2 req-d20e575a-ebe6-4f97-93fd-4716fe028d41 service nova] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Received event network-vif-plugged-2b44ecc4-13c5-43ba-8425-5f42d86bc716 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:22:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-944e2547-a946-4946-bf04-3b5e0902beb2 req-d20e575a-ebe6-4f97-93fd-4716fe028d41 service nova] Acquiring lock "6af7918a-ce90-45ab-93d8-684e1489e891-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:22:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-944e2547-a946-4946-bf04-3b5e0902beb2 req-d20e575a-ebe6-4f97-93fd-4716fe028d41 service nova] Lock "6af7918a-ce90-45ab-93d8-684e1489e891-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:22:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-944e2547-a946-4946-bf04-3b5e0902beb2 req-d20e575a-ebe6-4f97-93fd-4716fe028d41 service nova] Lock "6af7918a-ce90-45ab-93d8-684e1489e891-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:22:12 user nova-compute[72418]: DEBUG nova.compute.manager [req-944e2547-a946-4946-bf04-3b5e0902beb2 req-d20e575a-ebe6-4f97-93fd-4716fe028d41 service nova] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] No waiting events found dispatching network-vif-plugged-2b44ecc4-13c5-43ba-8425-5f42d86bc716 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:22:12 user nova-compute[72418]: WARNING nova.compute.manager [req-944e2547-a946-4946-bf04-3b5e0902beb2 req-d20e575a-ebe6-4f97-93fd-4716fe028d41 service nova] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Received unexpected event network-vif-plugged-2b44ecc4-13c5-43ba-8425-5f42d86bc716 for instance with vm_state building and task_state spawning.
Aug 09 18:22:12 user nova-compute[72418]: DEBUG nova.compute.manager [req-944e2547-a946-4946-bf04-3b5e0902beb2 req-d20e575a-ebe6-4f97-93fd-4716fe028d41 service nova] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Received event network-vif-plugged-c58368cc-29db-48a5-ab5d-a56526aba194 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:22:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-944e2547-a946-4946-bf04-3b5e0902beb2 req-d20e575a-ebe6-4f97-93fd-4716fe028d41 service nova] Acquiring lock "17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:22:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-944e2547-a946-4946-bf04-3b5e0902beb2 req-d20e575a-ebe6-4f97-93fd-4716fe028d41 service nova] Lock "17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:22:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-944e2547-a946-4946-bf04-3b5e0902beb2 req-d20e575a-ebe6-4f97-93fd-4716fe028d41 service nova] Lock "17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:22:12 user nova-compute[72418]: DEBUG nova.compute.manager [req-944e2547-a946-4946-bf04-3b5e0902beb2 req-d20e575a-ebe6-4f97-93fd-4716fe028d41 service nova] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] No waiting events found dispatching network-vif-plugged-c58368cc-29db-48a5-ab5d-a56526aba194 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:22:12 user nova-compute[72418]: WARNING nova.compute.manager [req-944e2547-a946-4946-bf04-3b5e0902beb2 req-d20e575a-ebe6-4f97-93fd-4716fe028d41 service nova] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Received unexpected event network-vif-plugged-c58368cc-29db-48a5-ab5d-a56526aba194 for instance with vm_state building and task_state spawning.
Aug 09 18:22:12 user nova-compute[72418]: DEBUG nova.compute.manager [req-944e2547-a946-4946-bf04-3b5e0902beb2 req-d20e575a-ebe6-4f97-93fd-4716fe028d41 service nova] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Received event network-vif-plugged-c58368cc-29db-48a5-ab5d-a56526aba194 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:22:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-944e2547-a946-4946-bf04-3b5e0902beb2 req-d20e575a-ebe6-4f97-93fd-4716fe028d41 service nova] Acquiring lock "17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:22:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-944e2547-a946-4946-bf04-3b5e0902beb2 req-d20e575a-ebe6-4f97-93fd-4716fe028d41 service nova] Lock "17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:22:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-944e2547-a946-4946-bf04-3b5e0902beb2 req-d20e575a-ebe6-4f97-93fd-4716fe028d41 service nova] Lock "17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:22:12 user nova-compute[72418]: DEBUG nova.compute.manager [req-944e2547-a946-4946-bf04-3b5e0902beb2 req-d20e575a-ebe6-4f97-93fd-4716fe028d41 service nova] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] No waiting events found dispatching network-vif-plugged-c58368cc-29db-48a5-ab5d-a56526aba194 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:22:12 user nova-compute[72418]: WARNING nova.compute.manager [req-944e2547-a946-4946-bf04-3b5e0902beb2 req-d20e575a-ebe6-4f97-93fd-4716fe028d41 service nova] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Received unexpected event network-vif-plugged-c58368cc-29db-48a5-ab5d-a56526aba194 for instance with vm_state building and task_state spawning.
Aug 09 18:22:12 user nova-compute[72418]: DEBUG nova.compute.manager [req-944e2547-a946-4946-bf04-3b5e0902beb2 req-d20e575a-ebe6-4f97-93fd-4716fe028d41 service nova] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Received event network-vif-plugged-1487cbc0-54ec-4134-9e08-88f02ff870f5 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:22:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-944e2547-a946-4946-bf04-3b5e0902beb2 req-d20e575a-ebe6-4f97-93fd-4716fe028d41 service nova] Acquiring lock "01c46b33-6788-44a5-a43c-88ee4acc4d39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:22:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-944e2547-a946-4946-bf04-3b5e0902beb2 req-d20e575a-ebe6-4f97-93fd-4716fe028d41 service nova] Lock "01c46b33-6788-44a5-a43c-88ee4acc4d39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:22:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-944e2547-a946-4946-bf04-3b5e0902beb2 req-d20e575a-ebe6-4f97-93fd-4716fe028d41 service nova] Lock "01c46b33-6788-44a5-a43c-88ee4acc4d39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:22:12 user nova-compute[72418]: DEBUG nova.compute.manager [req-944e2547-a946-4946-bf04-3b5e0902beb2 req-d20e575a-ebe6-4f97-93fd-4716fe028d41 service nova] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] No waiting events found dispatching network-vif-plugged-1487cbc0-54ec-4134-9e08-88f02ff870f5 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:22:12 user nova-compute[72418]: WARNING nova.compute.manager [req-944e2547-a946-4946-bf04-3b5e0902beb2 req-d20e575a-ebe6-4f97-93fd-4716fe028d41 service nova] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Received unexpected event network-vif-plugged-1487cbc0-54ec-4134-9e08-88f02ff870f5 for instance with vm_state building and task_state spawning.
Aug 09 18:22:12 user nova-compute[72418]: DEBUG nova.compute.manager [req-944e2547-a946-4946-bf04-3b5e0902beb2 req-d20e575a-ebe6-4f97-93fd-4716fe028d41 service nova] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Received event network-vif-plugged-1487cbc0-54ec-4134-9e08-88f02ff870f5 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:22:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-944e2547-a946-4946-bf04-3b5e0902beb2 req-d20e575a-ebe6-4f97-93fd-4716fe028d41 service nova] Acquiring lock "01c46b33-6788-44a5-a43c-88ee4acc4d39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:22:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-944e2547-a946-4946-bf04-3b5e0902beb2 req-d20e575a-ebe6-4f97-93fd-4716fe028d41 service nova] Lock "01c46b33-6788-44a5-a43c-88ee4acc4d39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:22:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-944e2547-a946-4946-bf04-3b5e0902beb2 req-d20e575a-ebe6-4f97-93fd-4716fe028d41 service nova] Lock "01c46b33-6788-44a5-a43c-88ee4acc4d39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:22:12 user nova-compute[72418]: DEBUG nova.compute.manager [req-944e2547-a946-4946-bf04-3b5e0902beb2 req-d20e575a-ebe6-4f97-93fd-4716fe028d41 service nova] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] No waiting events found dispatching network-vif-plugged-1487cbc0-54ec-4134-9e08-88f02ff870f5 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:22:12 user nova-compute[72418]: WARNING nova.compute.manager [req-944e2547-a946-4946-bf04-3b5e0902beb2 req-d20e575a-ebe6-4f97-93fd-4716fe028d41 service nova] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Received unexpected event network-vif-plugged-1487cbc0-54ec-4134-9e08-88f02ff870f5 for instance with vm_state building and task_state spawning.
Aug 09 18:22:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Acquiring lock "4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:22:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Lock "4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:22:12 user nova-compute[72418]: DEBUG nova.compute.manager [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Starting instance... {{(pid=72418) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 18:22:13 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:22:13 user nova-compute[72418]: DEBUG nova.compute.manager [req-55c063b0-5073-4fda-b886-d439db6aa84f req-776fd7d3-9b36-4e12-beec-800c732017c7 service nova] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Received event network-vif-plugged-2e2b5832-b357-4012-8bfc-d26009aa91f8 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:22:13 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-55c063b0-5073-4fda-b886-d439db6aa84f req-776fd7d3-9b36-4e12-beec-800c732017c7 service nova] Acquiring lock "8fe41968-a219-4a5a-afdb-32eb2082bb40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:22:13 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-55c063b0-5073-4fda-b886-d439db6aa84f req-776fd7d3-9b36-4e12-beec-800c732017c7 service nova] Lock "8fe41968-a219-4a5a-afdb-32eb2082bb40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:22:13 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-55c063b0-5073-4fda-b886-d439db6aa84f req-776fd7d3-9b36-4e12-beec-800c732017c7 service nova] Lock "8fe41968-a219-4a5a-afdb-32eb2082bb40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:22:13 user nova-compute[72418]: DEBUG nova.compute.manager [req-55c063b0-5073-4fda-b886-d439db6aa84f req-776fd7d3-9b36-4e12-beec-800c732017c7 service nova] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] No waiting events found dispatching network-vif-plugged-2e2b5832-b357-4012-8bfc-d26009aa91f8 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:22:13 user nova-compute[72418]: WARNING nova.compute.manager [req-55c063b0-5073-4fda-b886-d439db6aa84f req-776fd7d3-9b36-4e12-beec-800c732017c7 service nova] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Received unexpected event network-vif-plugged-2e2b5832-b357-4012-8bfc-d26009aa91f8 for instance with vm_state building and task_state spawning.
Aug 09 18:22:13 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605333.4932046, 8fe41968-a219-4a5a-afdb-32eb2082bb40 => Resumed> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:22:13 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] VM Resumed (Lifecycle Event)
Aug 09 18:22:13 user nova-compute[72418]: DEBUG nova.compute.manager [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Instance event wait completed in 0 seconds for  {{(pid=72418) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 18:22:13 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Guest created on hypervisor {{(pid=72418) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 18:22:13 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72418) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 18:22:13 user nova-compute[72418]: INFO nova.compute.claims [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Claim successful on node user
Aug 09 18:22:13 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Instance spawned successfully.
Aug 09 18:22:13 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 18:22:13 user nova-compute[72418]: DEBUG nova.compute.manager [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Instance event wait completed in 0 seconds for  {{(pid=72418) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 18:22:13 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Guest created on hypervisor {{(pid=72418) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 18:22:13 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Instance spawned successfully.
Aug 09 18:22:13 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 18:22:13 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Found default for hw_cdrom_bus of ide {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:22:13 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Found default for hw_disk_bus of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:22:13 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Found default for hw_input_bus of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:22:13 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Found default for hw_pointer_model of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:22:13 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Found default for hw_video_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:22:13 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Found default for hw_vif_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:22:13 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:22:13 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:22:13 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Found default for hw_cdrom_bus of ide {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:22:13 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Found default for hw_disk_bus of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:22:13 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Found default for hw_input_bus of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:22:13 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Found default for hw_pointer_model of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:22:13 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Found default for hw_video_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:22:13 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Found default for hw_vif_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:22:13 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:22:13 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605333.5007744, 8fe41968-a219-4a5a-afdb-32eb2082bb40 => Started> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:22:13 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] VM Started (Lifecycle Event)
Aug 09 18:22:13 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:22:13 user nova-compute[72418]: DEBUG nova.compute.manager [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Instance event wait completed in 0 seconds for  {{(pid=72418) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 18:22:13 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Guest created on hypervisor {{(pid=72418) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 18:22:13 user nova-compute[72418]: INFO nova.compute.manager [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Took 18.68 seconds to spawn the instance on the hypervisor.
Aug 09 18:22:13 user nova-compute[72418]: DEBUG nova.compute.manager [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:22:13 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:22:13 user nova-compute[72418]: INFO nova.compute.manager [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Took 19.82 seconds to spawn the instance on the hypervisor.
Aug 09 18:22:13 user nova-compute[72418]: DEBUG nova.compute.manager [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:22:13 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:22:13 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605333.5383158, 479ea4c3-ad7f-4da0-a901-defe46d96065 => Resumed> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:22:13 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] VM Resumed (Lifecycle Event)
Aug 09 18:22:13 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Instance spawned successfully.
Aug 09 18:22:13 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 18:22:13 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:22:14 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:22:14 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Found default for hw_cdrom_bus of ide {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:22:14 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Found default for hw_disk_bus of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:22:14 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Found default for hw_input_bus of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:22:14 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Found default for hw_pointer_model of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:22:14 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Found default for hw_video_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:22:14 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Found default for hw_vif_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:22:14 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:22:14 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605333.5421672, 479ea4c3-ad7f-4da0-a901-defe46d96065 => Started> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:22:14 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] VM Started (Lifecycle Event)
Aug 09 18:22:14 user nova-compute[72418]: DEBUG nova.compute.manager [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Instance event wait completed in 0 seconds for  {{(pid=72418) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 18:22:14 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Guest created on hypervisor {{(pid=72418) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 18:22:14 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Instance spawned successfully.
Aug 09 18:22:14 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 18:22:14 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:22:14 user nova-compute[72418]: INFO nova.compute.manager [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Took 20.11 seconds to build instance.
Aug 09 18:22:14 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Found default for hw_cdrom_bus of ide {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:22:14 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Found default for hw_disk_bus of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:22:14 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Found default for hw_input_bus of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:22:14 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Found default for hw_pointer_model of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:22:14 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Found default for hw_video_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:22:14 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Found default for hw_vif_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:22:14 user nova-compute[72418]: DEBUG nova.compute.manager [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Instance event wait completed in 0 seconds for  {{(pid=72418) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 18:22:14 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Guest created on hypervisor {{(pid=72418) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 18:22:14 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:22:14 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Instance spawned successfully.
Aug 09 18:22:14 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 18:22:14 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-a1f14c05-97ed-4cf6-bda0-25310aa34941 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Lock "479ea4c3-ad7f-4da0-a901-defe46d96065" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.356s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:22:14 user nova-compute[72418]: INFO nova.compute.manager [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Took 19.84 seconds to spawn the instance on the hypervisor.
Aug 09 18:22:14 user nova-compute[72418]: DEBUG nova.compute.manager [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:22:14 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605333.8593376, 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6 => Resumed> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:22:14 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] VM Resumed (Lifecycle Event)
Aug 09 18:22:14 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Found default for hw_cdrom_bus of ide {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:22:14 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Found default for hw_disk_bus of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:22:14 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Found default for hw_input_bus of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:22:14 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Found default for hw_pointer_model of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:22:14 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Found default for hw_video_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:22:14 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Found default for hw_vif_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:22:14 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:14 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:22:14 user nova-compute[72418]: INFO nova.compute.manager [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Took 19.52 seconds to spawn the instance on the hypervisor.
Aug 09 18:22:14 user nova-compute[72418]: DEBUG nova.compute.manager [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:22:14 user nova-compute[72418]: INFO nova.compute.manager [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Took 22.07 seconds to build instance.
Aug 09 18:22:14 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:22:14 user nova-compute[72418]: INFO nova.compute.manager [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Took 21.45 seconds to spawn the instance on the hypervisor.
Aug 09 18:22:14 user nova-compute[72418]: DEBUG nova.compute.manager [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:22:14 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:22:14 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-b60c7a82-203e-4e19-aeca-29dae50a0794 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "8fe41968-a219-4a5a-afdb-32eb2082bb40" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.363s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:22:14 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:22:14 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:22:14 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605333.8790643, 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6 => Started> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:22:14 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] VM Started (Lifecycle Event)
Aug 09 18:22:14 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:22:14 user nova-compute[72418]: INFO nova.compute.manager [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Took 22.21 seconds to build instance.
Aug 09 18:22:14 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:22:14 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.540s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:22:14 user nova-compute[72418]: DEBUG nova.compute.manager [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Start building networks asynchronously for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 18:22:14 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.543s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:22:14 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72418) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 18:22:14 user nova-compute[72418]: INFO nova.compute.claims [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Claim successful on node user
Aug 09 18:22:14 user nova-compute[72418]: INFO nova.compute.manager [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Took 20.64 seconds to build instance.
Aug 09 18:22:14 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605334.0412202, 01c46b33-6788-44a5-a43c-88ee4acc4d39 => Resumed> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:22:14 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] VM Resumed (Lifecycle Event)
Aug 09 18:22:14 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-287ffc87-548c-4379-a344-62ed76d1dfec tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Lock "17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.438s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:22:14 user nova-compute[72418]: INFO nova.compute.manager [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Took 22.66 seconds to build instance.
Aug 09 18:22:14 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-df90bc98-6391-4a20-a7c5-1346cadccd5e tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "01c46b33-6788-44a5-a43c-88ee4acc4d39" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.878s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:22:14 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:22:14 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:22:14 user nova-compute[72418]: DEBUG nova.compute.manager [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Allocating IP information in the background. {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 18:22:14 user nova-compute[72418]: DEBUG nova.network.neutron [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] allocate_for_instance() {{(pid=72418) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 18:22:14 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-5557b6a7-91c0-4350-9e72-24fbe4202259 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "6af7918a-ce90-45ab-93d8-684e1489e891" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.100s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:22:14 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 18:22:14 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605334.0566788, 01c46b33-6788-44a5-a43c-88ee4acc4d39 => Started> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:22:14 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] VM Started (Lifecycle Event)
Aug 09 18:22:14 user nova-compute[72418]: DEBUG nova.compute.manager [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Start building block device mappings for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 18:22:14 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:22:14 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:22:14 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605334.1674864, 6af7918a-ce90-45ab-93d8-684e1489e891 => Resumed> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:22:14 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] VM Resumed (Lifecycle Event)
Aug 09 18:22:14 user nova-compute[72418]: DEBUG nova.policy [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2f8f0724519049c5815be66bc07892ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df6a65ef22db446c9cda523621cda645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72418) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 18:22:15 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:22:15 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:22:15 user nova-compute[72418]: DEBUG nova.compute.manager [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Start spawning the instance on the hypervisor. {{(pid=72418) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 18:22:15 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Creating instance directory {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 18:22:15 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Creating image(s)
Aug 09 18:22:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Acquiring lock "/opt/stack/data/nova/instances/6084e681-01c4-4a6c-beb3-dcda4a990a51/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:22:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Lock "/opt/stack/data/nova/instances/6084e681-01c4-4a6c-beb3-dcda4a990a51/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:22:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Lock "/opt/stack/data/nova/instances/6084e681-01c4-4a6c-beb3-dcda4a990a51/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:22:15 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605334.1679966, 6af7918a-ce90-45ab-93d8-684e1489e891 => Started> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:22:15 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] VM Started (Lifecycle Event)
Aug 09 18:22:15 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:22:15 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:22:15 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:22:15 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.214s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:22:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Acquiring lock "458773cfa7230b717e41c60277832e9f83806d71" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:22:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:22:15 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:22:15 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.196s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:22:15 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/6084e681-01c4-4a6c-beb3-dcda4a990a51/disk 1073741824 {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:22:15 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/6084e681-01c4-4a6c-beb3-dcda4a990a51/disk 1073741824" returned: 0 in 0.111s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:22:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.315s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:22:15 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:22:15 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.285s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:22:15 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6084e681-01c4-4a6c-beb3-dcda4a990a51/disk. size=1073741824 {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 18:22:15 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6084e681-01c4-4a6c-beb3-dcda4a990a51/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:22:16 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:22:16 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:22:16 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6084e681-01c4-4a6c-beb3-dcda4a990a51/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:22:16 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Cannot resize image /opt/stack/data/nova/instances/6084e681-01c4-4a6c-beb3-dcda4a990a51/disk to a smaller size. {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 18:22:16 user nova-compute[72418]: DEBUG nova.objects.instance [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Lazy-loading 'migration_context' on Instance uuid 6084e681-01c4-4a6c-beb3-dcda4a990a51 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:22:16 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.572s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:22:16 user nova-compute[72418]: DEBUG nova.compute.manager [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Start building networks asynchronously for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 18:22:16 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Created local disks {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 18:22:16 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Ensure instance console log exists: /opt/stack/data/nova/instances/6084e681-01c4-4a6c-beb3-dcda4a990a51/console.log {{(pid=72418) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 18:22:16 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:22:16 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:22:16 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:22:16 user nova-compute[72418]: DEBUG nova.compute.manager [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Allocating IP information in the background. {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 18:22:16 user nova-compute[72418]: DEBUG nova.network.neutron [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] allocate_for_instance() {{(pid=72418) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 18:22:16 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 18:22:16 user nova-compute[72418]: DEBUG nova.compute.manager [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Start building block device mappings for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 18:22:16 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:16 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:16 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:16 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:16 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:16 user nova-compute[72418]: DEBUG nova.policy [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3edbabbb69494929a4d671b4113f7753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f09f1028304efd84f2e694efdae063', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72418) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 18:22:16 user nova-compute[72418]: DEBUG nova.compute.manager [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Start spawning the instance on the hypervisor. {{(pid=72418) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 18:22:16 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Creating instance directory {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 18:22:16 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Creating image(s)
Aug 09 18:22:16 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Acquiring lock "/opt/stack/data/nova/instances/4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:22:16 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Lock "/opt/stack/data/nova/instances/4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:22:16 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Lock "/opt/stack/data/nova/instances/4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.019s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:22:16 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:22:16 user nova-compute[72418]: DEBUG nova.network.neutron [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Successfully created port: ae43991a-cb38-4bb3-ae7e-9c72684dcdd9 {{(pid=72418) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 18:22:16 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:17 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.302s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:22:17 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Acquiring lock "458773cfa7230b717e41c60277832e9f83806d71" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:22:17 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:22:17 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:22:17 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.252s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:22:17 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf/disk 1073741824 {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:22:17 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf/disk 1073741824" returned: 0 in 0.093s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:22:17 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.356s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:22:17 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:22:17 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.332s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:22:17 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf/disk. size=1073741824 {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 18:22:17 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:22:17 user nova-compute[72418]: DEBUG nova.network.neutron [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Successfully created port: e6c1511d-0765-4136-854a-e9a673db5071 {{(pid=72418) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 18:22:17 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:22:17 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Cannot resize image /opt/stack/data/nova/instances/4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf/disk to a smaller size. {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 18:22:17 user nova-compute[72418]: DEBUG nova.objects.instance [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Lazy-loading 'migration_context' on Instance uuid 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:22:18 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Created local disks {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 18:22:18 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Ensure instance console log exists: /opt/stack/data/nova/instances/4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf/console.log {{(pid=72418) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 18:22:18 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:22:18 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:22:18 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:22:18 user nova-compute[72418]: DEBUG nova.network.neutron [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Successfully updated port: ae43991a-cb38-4bb3-ae7e-9c72684dcdd9 {{(pid=72418) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 18:22:18 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Acquiring lock "refresh_cache-6084e681-01c4-4a6c-beb3-dcda4a990a51" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:22:18 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Acquired lock "refresh_cache-6084e681-01c4-4a6c-beb3-dcda4a990a51" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:22:18 user nova-compute[72418]: DEBUG nova.network.neutron [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:22:18 user nova-compute[72418]: DEBUG nova.compute.manager [req-d5aaca48-c57b-417a-a667-8a9982da5afe req-3220b5a3-3816-4792-84f9-bbeeee4a21c7 service nova] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Received event network-changed-ae43991a-cb38-4bb3-ae7e-9c72684dcdd9 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:22:18 user nova-compute[72418]: DEBUG nova.compute.manager [req-d5aaca48-c57b-417a-a667-8a9982da5afe req-3220b5a3-3816-4792-84f9-bbeeee4a21c7 service nova] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Refreshing instance network info cache due to event network-changed-ae43991a-cb38-4bb3-ae7e-9c72684dcdd9. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:22:18 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-d5aaca48-c57b-417a-a667-8a9982da5afe req-3220b5a3-3816-4792-84f9-bbeeee4a21c7 service nova] Acquiring lock "refresh_cache-6084e681-01c4-4a6c-beb3-dcda4a990a51" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:22:18 user nova-compute[72418]: DEBUG nova.network.neutron [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Instance cache missing network info. {{(pid=72418) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 18:22:18 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:18 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:18 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:18 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:19 user nova-compute[72418]: DEBUG nova.network.neutron [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Successfully updated port: e6c1511d-0765-4136-854a-e9a673db5071 {{(pid=72418) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 18:22:19 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:19 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Acquiring lock "refresh_cache-4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:22:19 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Acquired lock "refresh_cache-4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:22:19 user nova-compute[72418]: DEBUG nova.network.neutron [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:22:19 user nova-compute[72418]: DEBUG nova.compute.manager [req-92a3b345-7e0c-4965-bf8c-fbbfe0967da4 req-daead274-3083-4877-b4d6-a96d2e70c527 service nova] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Received event network-changed-e6c1511d-0765-4136-854a-e9a673db5071 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:22:19 user nova-compute[72418]: DEBUG nova.compute.manager [req-92a3b345-7e0c-4965-bf8c-fbbfe0967da4 req-daead274-3083-4877-b4d6-a96d2e70c527 service nova] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Refreshing instance network info cache due to event network-changed-e6c1511d-0765-4136-854a-e9a673db5071. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:22:19 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-92a3b345-7e0c-4965-bf8c-fbbfe0967da4 req-daead274-3083-4877-b4d6-a96d2e70c527 service nova] Acquiring lock "refresh_cache-4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:22:19 user nova-compute[72418]: DEBUG nova.network.neutron [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Updating instance_info_cache with network_info: [{"id": "ae43991a-cb38-4bb3-ae7e-9c72684dcdd9", "address": "fa:16:3e:98:e7:5b", "network": {"id": "625ace3e-82b3-4e9c-b5d2-018f7c686cf4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1965184187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df6a65ef22db446c9cda523621cda645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae43991a-cb", "ovs_interfaceid": "ae43991a-cb38-4bb3-ae7e-9c72684dcdd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:22:19 user nova-compute[72418]: DEBUG nova.network.neutron [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Instance cache missing network info. {{(pid=72418) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 18:22:19 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Releasing lock "refresh_cache-6084e681-01c4-4a6c-beb3-dcda4a990a51" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:22:19 user nova-compute[72418]: DEBUG nova.compute.manager [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Instance network_info: |[{"id": "ae43991a-cb38-4bb3-ae7e-9c72684dcdd9", "address": "fa:16:3e:98:e7:5b", "network": {"id": "625ace3e-82b3-4e9c-b5d2-018f7c686cf4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1965184187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df6a65ef22db446c9cda523621cda645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae43991a-cb", "ovs_interfaceid": "ae43991a-cb38-4bb3-ae7e-9c72684dcdd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 18:22:19 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-d5aaca48-c57b-417a-a667-8a9982da5afe req-3220b5a3-3816-4792-84f9-bbeeee4a21c7 service nova] Acquired lock "refresh_cache-6084e681-01c4-4a6c-beb3-dcda4a990a51" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:22:19 user nova-compute[72418]: DEBUG nova.network.neutron [req-d5aaca48-c57b-417a-a667-8a9982da5afe req-3220b5a3-3816-4792-84f9-bbeeee4a21c7 service nova] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Refreshing network info cache for port ae43991a-cb38-4bb3-ae7e-9c72684dcdd9 {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:22:19 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Start _get_guest_xml network_info=[{"id": "ae43991a-cb38-4bb3-ae7e-9c72684dcdd9", "address": "fa:16:3e:98:e7:5b", "network": {"id": "625ace3e-82b3-4e9c-b5d2-018f7c686cf4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1965184187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df6a65ef22db446c9cda523621cda645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae43991a-cb", "ovs_interfaceid": "ae43991a-cb38-4bb3-ae7e-9c72684dcdd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 18:22:19 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:22:19 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:22:19 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 18:22:19 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] CPU controller missing on host. {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 18:22:19 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 18:22:19 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] CPU controller found on host. {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 18:22:19 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72418) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 18:22:19 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T18:17:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 18:22:19 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Flavor limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 18:22:19 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Image limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 18:22:19 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Flavor pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 18:22:19 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Image pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 18:22:19 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 18:22:19 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 18:22:19 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 18:22:19 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Got 1 possible topologies {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 18:22:19 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 18:22:19 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 18:22:19 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:22:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-2056657652',display_name='tempest-VolumesAssistedSnapshotsTest-server-2056657652',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-2056657652',id=6,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZkMB/830LkZPcI2Kt8lUbObKOtLsYhPKqdlcrSeF2qegOTUMYZvlIcs6L4p/aME+midDB396nzO/MwWAlSe09uVZxbuMtHdUxsp2UurvPwN6bPz2nRJLg3Ys3lUjqtbw==',key_name='tempest-keypair-356632525',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df6a65ef22db446c9cda523621cda645',ramdisk_id='',reservation_id='r-s2om02p1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-917954092',owner_user_name='tempest-VolumesAssistedSnapshotsTest-917954092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:22:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f8f0724519049c5815be66bc07892ed',uuid=6084e681-01c4-4a6c-beb3-dcda4a990a51,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae43991a-cb38-4bb3-ae7e-9c72684dcdd9", "address": "fa:16:3e:98:e7:5b", "network": {"id": "625ace3e-82b3-4e9c-b5d2-018f7c686cf4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1965184187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df6a65ef22db446c9cda523621cda645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae43991a-cb", "ovs_interfaceid": "ae43991a-cb38-4bb3-ae7e-9c72684dcdd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:22:19 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Converting VIF {"id": "ae43991a-cb38-4bb3-ae7e-9c72684dcdd9", "address": "fa:16:3e:98:e7:5b", "network": {"id": "625ace3e-82b3-4e9c-b5d2-018f7c686cf4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1965184187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df6a65ef22db446c9cda523621cda645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae43991a-cb", "ovs_interfaceid": "ae43991a-cb38-4bb3-ae7e-9c72684dcdd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:22:19 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:e7:5b,bridge_name='br-int',has_traffic_filtering=True,id=ae43991a-cb38-4bb3-ae7e-9c72684dcdd9,network=Network(625ace3e-82b3-4e9c-b5d2-018f7c686cf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae43991a-cb') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:22:19 user nova-compute[72418]: DEBUG nova.objects.instance [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Lazy-loading 'pci_devices' on Instance uuid 6084e681-01c4-4a6c-beb3-dcda4a990a51 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:22:19 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] End _get_guest_xml xml=<domain type="kvm">
Aug 09 18:22:19 user nova-compute[72418]:   <uuid>6084e681-01c4-4a6c-beb3-dcda4a990a51</uuid>
Aug 09 18:22:19 user nova-compute[72418]:   <name>instance-00000006</name>
Aug 09 18:22:19 user nova-compute[72418]:   <memory>524288</memory>
Aug 09 18:22:19 user nova-compute[72418]:   <vcpu>1</vcpu>
Aug 09 18:22:19 user nova-compute[72418]:   <metadata>
Aug 09 18:22:19 user nova-compute[72418]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:22:19 user nova-compute[72418]:       <nova:package version="0.0.0"/>
Aug 09 18:22:19 user nova-compute[72418]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-2056657652</nova:name>
Aug 09 18:22:19 user nova-compute[72418]:       <nova:creationTime>2023-08-09 18:22:19</nova:creationTime>
Aug 09 18:22:19 user nova-compute[72418]:       <nova:flavor name="m1.tiny">
Aug 09 18:22:19 user nova-compute[72418]:         <nova:memory>512</nova:memory>
Aug 09 18:22:19 user nova-compute[72418]:         <nova:disk>1</nova:disk>
Aug 09 18:22:19 user nova-compute[72418]:         <nova:swap>0</nova:swap>
Aug 09 18:22:19 user nova-compute[72418]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:22:19 user nova-compute[72418]:         <nova:vcpus>1</nova:vcpus>
Aug 09 18:22:19 user nova-compute[72418]:       </nova:flavor>
Aug 09 18:22:19 user nova-compute[72418]:       <nova:owner>
Aug 09 18:22:19 user nova-compute[72418]:         <nova:user uuid="2f8f0724519049c5815be66bc07892ed">tempest-VolumesAssistedSnapshotsTest-917954092-project-member</nova:user>
Aug 09 18:22:19 user nova-compute[72418]:         <nova:project uuid="df6a65ef22db446c9cda523621cda645">tempest-VolumesAssistedSnapshotsTest-917954092</nova:project>
Aug 09 18:22:19 user nova-compute[72418]:       </nova:owner>
Aug 09 18:22:19 user nova-compute[72418]:       <nova:root type="image" uuid="8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e"/>
Aug 09 18:22:19 user nova-compute[72418]:       <nova:ports>
Aug 09 18:22:19 user nova-compute[72418]:         <nova:port uuid="ae43991a-cb38-4bb3-ae7e-9c72684dcdd9">
Aug 09 18:22:19 user nova-compute[72418]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 09 18:22:19 user nova-compute[72418]:         </nova:port>
Aug 09 18:22:19 user nova-compute[72418]:       </nova:ports>
Aug 09 18:22:19 user nova-compute[72418]:     </nova:instance>
Aug 09 18:22:19 user nova-compute[72418]:   </metadata>
Aug 09 18:22:19 user nova-compute[72418]:   <sysinfo type="smbios">
Aug 09 18:22:19 user nova-compute[72418]:     <system>
Aug 09 18:22:19 user nova-compute[72418]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 18:22:19 user nova-compute[72418]:       <entry name="product">OpenStack Nova</entry>
Aug 09 18:22:19 user nova-compute[72418]:       <entry name="version">0.0.0</entry>
Aug 09 18:22:19 user nova-compute[72418]:       <entry name="serial">6084e681-01c4-4a6c-beb3-dcda4a990a51</entry>
Aug 09 18:22:19 user nova-compute[72418]:       <entry name="uuid">6084e681-01c4-4a6c-beb3-dcda4a990a51</entry>
Aug 09 18:22:19 user nova-compute[72418]:       <entry name="family">Virtual Machine</entry>
Aug 09 18:22:19 user nova-compute[72418]:     </system>
Aug 09 18:22:19 user nova-compute[72418]:   </sysinfo>
Aug 09 18:22:19 user nova-compute[72418]:   <os>
Aug 09 18:22:19 user nova-compute[72418]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 18:22:19 user nova-compute[72418]:     <boot dev="hd"/>
Aug 09 18:22:19 user nova-compute[72418]:     <smbios mode="sysinfo"/>
Aug 09 18:22:19 user nova-compute[72418]:   </os>
Aug 09 18:22:19 user nova-compute[72418]:   <features>
Aug 09 18:22:19 user nova-compute[72418]:     <acpi/>
Aug 09 18:22:19 user nova-compute[72418]:     <apic/>
Aug 09 18:22:19 user nova-compute[72418]:     <vmcoreinfo/>
Aug 09 18:22:19 user nova-compute[72418]:   </features>
Aug 09 18:22:19 user nova-compute[72418]:   <clock offset="utc">
Aug 09 18:22:19 user nova-compute[72418]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 18:22:19 user nova-compute[72418]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 18:22:19 user nova-compute[72418]:     <timer name="hpet" present="no"/>
Aug 09 18:22:19 user nova-compute[72418]:   </clock>
Aug 09 18:22:19 user nova-compute[72418]:   <cpu mode="custom" match="exact">
Aug 09 18:22:19 user nova-compute[72418]:     <model>Nehalem</model>
Aug 09 18:22:19 user nova-compute[72418]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 18:22:19 user nova-compute[72418]:   </cpu>
Aug 09 18:22:19 user nova-compute[72418]:   <devices>
Aug 09 18:22:19 user nova-compute[72418]:     <disk type="file" device="disk">
Aug 09 18:22:19 user nova-compute[72418]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 18:22:19 user nova-compute[72418]:       <source file="/opt/stack/data/nova/instances/6084e681-01c4-4a6c-beb3-dcda4a990a51/disk"/>
Aug 09 18:22:19 user nova-compute[72418]:       <target dev="vda" bus="virtio"/>
Aug 09 18:22:19 user nova-compute[72418]:     </disk>
Aug 09 18:22:19 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:22:19 user nova-compute[72418]:       <mac address="fa:16:3e:98:e7:5b"/>
Aug 09 18:22:19 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:22:19 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:22:19 user nova-compute[72418]:       <target dev="tapae43991a-cb"/>
Aug 09 18:22:19 user nova-compute[72418]:     </interface>
Aug 09 18:22:19 user nova-compute[72418]:     <serial type="pty">
Aug 09 18:22:19 user nova-compute[72418]:       <log file="/opt/stack/data/nova/instances/6084e681-01c4-4a6c-beb3-dcda4a990a51/console.log" append="off"/>
Aug 09 18:22:19 user nova-compute[72418]:     </serial>
Aug 09 18:22:19 user nova-compute[72418]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 18:22:19 user nova-compute[72418]:     <video>
Aug 09 18:22:19 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:22:19 user nova-compute[72418]:     </video>
Aug 09 18:22:19 user nova-compute[72418]:     <rng model="virtio">
Aug 09 18:22:19 user nova-compute[72418]:       <backend model="random">/dev/urandom</backend>
Aug 09 18:22:19 user nova-compute[72418]:     </rng>
Aug 09 18:22:19 user nova-compute[72418]:     <controller type="usb" index="0" model="none"/>
Aug 09 18:22:19 user nova-compute[72418]:     <memballoon model="virtio">
Aug 09 18:22:19 user nova-compute[72418]:       <stats period="10"/>
Aug 09 18:22:19 user nova-compute[72418]:     </memballoon>
Aug 09 18:22:19 user nova-compute[72418]:   </devices>
Aug 09 18:22:19 user nova-compute[72418]: </domain>
Aug 09 18:22:19 user nova-compute[72418]:  {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 18:22:19 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:22:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-2056657652',display_name='tempest-VolumesAssistedSnapshotsTest-server-2056657652',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-2056657652',id=6,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZkMB/830LkZPcI2Kt8lUbObKOtLsYhPKqdlcrSeF2qegOTUMYZvlIcs6L4p/aME+midDB396nzO/MwWAlSe09uVZxbuMtHdUxsp2UurvPwN6bPz2nRJLg3Ys3lUjqtbw==',key_name='tempest-keypair-356632525',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df6a65ef22db446c9cda523621cda645',ramdisk_id='',reservation_id='r-s2om02p1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-917954092',owner_user_name='tempest-VolumesAssistedSnapshotsTest-917954092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:22:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f8f0724519049c5815be66bc07892ed',uuid=6084e681-01c4-4a6c-beb3-dcda4a990a51,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae43991a-cb38-4bb3-ae7e-9c72684dcdd9", "address": "fa:16:3e:98:e7:5b", "network": {"id": "625ace3e-82b3-4e9c-b5d2-018f7c686cf4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1965184187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df6a65ef22db446c9cda523621cda645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae43991a-cb", "ovs_interfaceid": "ae43991a-cb38-4bb3-ae7e-9c72684dcdd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:22:19 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Converting VIF {"id": "ae43991a-cb38-4bb3-ae7e-9c72684dcdd9", "address": "fa:16:3e:98:e7:5b", "network": {"id": "625ace3e-82b3-4e9c-b5d2-018f7c686cf4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1965184187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df6a65ef22db446c9cda523621cda645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae43991a-cb", "ovs_interfaceid": "ae43991a-cb38-4bb3-ae7e-9c72684dcdd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:22:19 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:e7:5b,bridge_name='br-int',has_traffic_filtering=True,id=ae43991a-cb38-4bb3-ae7e-9c72684dcdd9,network=Network(625ace3e-82b3-4e9c-b5d2-018f7c686cf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae43991a-cb') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:22:19 user nova-compute[72418]: DEBUG os_vif [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:e7:5b,bridge_name='br-int',has_traffic_filtering=True,id=ae43991a-cb38-4bb3-ae7e-9c72684dcdd9,network=Network(625ace3e-82b3-4e9c-b5d2-018f7c686cf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae43991a-cb') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:22:19 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:19 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:22:19 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:22:19 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:19 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae43991a-cb, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:22:19 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapae43991a-cb, col_values=(('external_ids', {'iface-id': 'ae43991a-cb38-4bb3-ae7e-9c72684dcdd9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:e7:5b', 'vm-uuid': '6084e681-01c4-4a6c-beb3-dcda4a990a51'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:22:19 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:19 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:22:19 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:19 user nova-compute[72418]: INFO os_vif [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:e7:5b,bridge_name='br-int',has_traffic_filtering=True,id=ae43991a-cb38-4bb3-ae7e-9c72684dcdd9,network=Network(625ace3e-82b3-4e9c-b5d2-018f7c686cf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae43991a-cb')
Aug 09 18:22:19 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:19 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:19 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:22:19 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] No VIF found with MAC fa:16:3e:98:e7:5b, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:22:19 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:20 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:20 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:20 user nova-compute[72418]: DEBUG nova.network.neutron [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Updating instance_info_cache with network_info: [{"id": "e6c1511d-0765-4136-854a-e9a673db5071", "address": "fa:16:3e:ca:f9:2b", "network": {"id": "57e1bdad-aad5-47b8-854b-68f3c1375325", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1415993909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f09f1028304efd84f2e694efdae063", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c1511d-07", "ovs_interfaceid": "e6c1511d-0765-4136-854a-e9a673db5071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:22:20 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Releasing lock "refresh_cache-4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:22:20 user nova-compute[72418]: DEBUG nova.compute.manager [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Instance network_info: |[{"id": "e6c1511d-0765-4136-854a-e9a673db5071", "address": "fa:16:3e:ca:f9:2b", "network": {"id": "57e1bdad-aad5-47b8-854b-68f3c1375325", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1415993909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f09f1028304efd84f2e694efdae063", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c1511d-07", "ovs_interfaceid": "e6c1511d-0765-4136-854a-e9a673db5071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 18:22:20 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-92a3b345-7e0c-4965-bf8c-fbbfe0967da4 req-daead274-3083-4877-b4d6-a96d2e70c527 service nova] Acquired lock "refresh_cache-4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:22:20 user nova-compute[72418]: DEBUG nova.network.neutron [req-92a3b345-7e0c-4965-bf8c-fbbfe0967da4 req-daead274-3083-4877-b4d6-a96d2e70c527 service nova] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Refreshing network info cache for port e6c1511d-0765-4136-854a-e9a673db5071 {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:22:20 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Start _get_guest_xml network_info=[{"id": "e6c1511d-0765-4136-854a-e9a673db5071", "address": "fa:16:3e:ca:f9:2b", "network": {"id": "57e1bdad-aad5-47b8-854b-68f3c1375325", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1415993909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f09f1028304efd84f2e694efdae063", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c1511d-07", "ovs_interfaceid": "e6c1511d-0765-4136-854a-e9a673db5071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 18:22:20 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:22:20 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:22:20 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 18:22:20 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] CPU controller missing on host. {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 18:22:20 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 18:22:20 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] CPU controller found on host. {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 18:22:20 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72418) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 18:22:20 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T18:17:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 18:22:20 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Flavor limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 18:22:20 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Image limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 18:22:20 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Flavor pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 18:22:20 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Image pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 18:22:20 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 18:22:20 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 18:22:20 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 18:22:20 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Got 1 possible topologies {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 18:22:20 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 18:22:20 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 18:22:20 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:22:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-968743662',display_name='tempest-VolumesAdminNegativeTest-server-968743662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-968743662',id=7,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQ6zWIitmeu0DLu53Uuort2xj9NFnMCtkMwpHM+WpmwBwNoSmJfS3Fw7RZw4UJ9us1isjM/nSmzX/jdTNP+JBXVyF+0ywXOXRqse7blCLLMzYlEBVVNIjsdzsPKdtZ8TQ==',key_name='tempest-keypair-2131917963',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5f09f1028304efd84f2e694efdae063',ramdisk_id='',reservation_id='r-572wet15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-612744035',owner_user_name='tempest-VolumesAdminNegativeTest-612744035-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:22:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3edbabbb69494929a4d671b4113f7753',uuid=4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6c1511d-0765-4136-854a-e9a673db5071", "address": "fa:16:3e:ca:f9:2b", "network": {"id": "57e1bdad-aad5-47b8-854b-68f3c1375325", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1415993909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f09f1028304efd84f2e694efdae063", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c1511d-07", "ovs_interfaceid": "e6c1511d-0765-4136-854a-e9a673db5071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:22:20 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Converting VIF {"id": "e6c1511d-0765-4136-854a-e9a673db5071", "address": "fa:16:3e:ca:f9:2b", "network": {"id": "57e1bdad-aad5-47b8-854b-68f3c1375325", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1415993909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f09f1028304efd84f2e694efdae063", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c1511d-07", "ovs_interfaceid": "e6c1511d-0765-4136-854a-e9a673db5071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:22:20 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:f9:2b,bridge_name='br-int',has_traffic_filtering=True,id=e6c1511d-0765-4136-854a-e9a673db5071,network=Network(57e1bdad-aad5-47b8-854b-68f3c1375325),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c1511d-07') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:22:20 user nova-compute[72418]: DEBUG nova.objects.instance [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Lazy-loading 'pci_devices' on Instance uuid 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:22:20 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] End _get_guest_xml xml=<domain type="kvm">
Aug 09 18:22:20 user nova-compute[72418]:   <uuid>4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf</uuid>
Aug 09 18:22:20 user nova-compute[72418]:   <name>instance-00000007</name>
Aug 09 18:22:20 user nova-compute[72418]:   <memory>524288</memory>
Aug 09 18:22:20 user nova-compute[72418]:   <vcpu>1</vcpu>
Aug 09 18:22:20 user nova-compute[72418]:   <metadata>
Aug 09 18:22:20 user nova-compute[72418]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:22:20 user nova-compute[72418]:       <nova:package version="0.0.0"/>
Aug 09 18:22:20 user nova-compute[72418]:       <nova:name>tempest-VolumesAdminNegativeTest-server-968743662</nova:name>
Aug 09 18:22:20 user nova-compute[72418]:       <nova:creationTime>2023-08-09 18:22:20</nova:creationTime>
Aug 09 18:22:20 user nova-compute[72418]:       <nova:flavor name="m1.tiny">
Aug 09 18:22:20 user nova-compute[72418]:         <nova:memory>512</nova:memory>
Aug 09 18:22:20 user nova-compute[72418]:         <nova:disk>1</nova:disk>
Aug 09 18:22:20 user nova-compute[72418]:         <nova:swap>0</nova:swap>
Aug 09 18:22:20 user nova-compute[72418]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:22:20 user nova-compute[72418]:         <nova:vcpus>1</nova:vcpus>
Aug 09 18:22:20 user nova-compute[72418]:       </nova:flavor>
Aug 09 18:22:20 user nova-compute[72418]:       <nova:owner>
Aug 09 18:22:20 user nova-compute[72418]:         <nova:user uuid="3edbabbb69494929a4d671b4113f7753">tempest-VolumesAdminNegativeTest-612744035-project-member</nova:user>
Aug 09 18:22:20 user nova-compute[72418]:         <nova:project uuid="b5f09f1028304efd84f2e694efdae063">tempest-VolumesAdminNegativeTest-612744035</nova:project>
Aug 09 18:22:20 user nova-compute[72418]:       </nova:owner>
Aug 09 18:22:20 user nova-compute[72418]:       <nova:root type="image" uuid="8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e"/>
Aug 09 18:22:20 user nova-compute[72418]:       <nova:ports>
Aug 09 18:22:20 user nova-compute[72418]:         <nova:port uuid="e6c1511d-0765-4136-854a-e9a673db5071">
Aug 09 18:22:20 user nova-compute[72418]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 18:22:20 user nova-compute[72418]:         </nova:port>
Aug 09 18:22:20 user nova-compute[72418]:       </nova:ports>
Aug 09 18:22:20 user nova-compute[72418]:     </nova:instance>
Aug 09 18:22:20 user nova-compute[72418]:   </metadata>
Aug 09 18:22:20 user nova-compute[72418]:   <sysinfo type="smbios">
Aug 09 18:22:20 user nova-compute[72418]:     <system>
Aug 09 18:22:20 user nova-compute[72418]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 18:22:20 user nova-compute[72418]:       <entry name="product">OpenStack Nova</entry>
Aug 09 18:22:20 user nova-compute[72418]:       <entry name="version">0.0.0</entry>
Aug 09 18:22:20 user nova-compute[72418]:       <entry name="serial">4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf</entry>
Aug 09 18:22:20 user nova-compute[72418]:       <entry name="uuid">4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf</entry>
Aug 09 18:22:20 user nova-compute[72418]:       <entry name="family">Virtual Machine</entry>
Aug 09 18:22:20 user nova-compute[72418]:     </system>
Aug 09 18:22:20 user nova-compute[72418]:   </sysinfo>
Aug 09 18:22:20 user nova-compute[72418]:   <os>
Aug 09 18:22:20 user nova-compute[72418]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 18:22:20 user nova-compute[72418]:     <boot dev="hd"/>
Aug 09 18:22:20 user nova-compute[72418]:     <smbios mode="sysinfo"/>
Aug 09 18:22:20 user nova-compute[72418]:   </os>
Aug 09 18:22:20 user nova-compute[72418]:   <features>
Aug 09 18:22:20 user nova-compute[72418]:     <acpi/>
Aug 09 18:22:20 user nova-compute[72418]:     <apic/>
Aug 09 18:22:20 user nova-compute[72418]:     <vmcoreinfo/>
Aug 09 18:22:20 user nova-compute[72418]:   </features>
Aug 09 18:22:20 user nova-compute[72418]:   <clock offset="utc">
Aug 09 18:22:20 user nova-compute[72418]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 18:22:20 user nova-compute[72418]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 18:22:20 user nova-compute[72418]:     <timer name="hpet" present="no"/>
Aug 09 18:22:20 user nova-compute[72418]:   </clock>
Aug 09 18:22:20 user nova-compute[72418]:   <cpu mode="custom" match="exact">
Aug 09 18:22:20 user nova-compute[72418]:     <model>Nehalem</model>
Aug 09 18:22:20 user nova-compute[72418]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 18:22:20 user nova-compute[72418]:   </cpu>
Aug 09 18:22:20 user nova-compute[72418]:   <devices>
Aug 09 18:22:20 user nova-compute[72418]:     <disk type="file" device="disk">
Aug 09 18:22:20 user nova-compute[72418]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 18:22:20 user nova-compute[72418]:       <source file="/opt/stack/data/nova/instances/4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf/disk"/>
Aug 09 18:22:20 user nova-compute[72418]:       <target dev="vda" bus="virtio"/>
Aug 09 18:22:20 user nova-compute[72418]:     </disk>
Aug 09 18:22:20 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:22:20 user nova-compute[72418]:       <mac address="fa:16:3e:ca:f9:2b"/>
Aug 09 18:22:20 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:22:20 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:22:20 user nova-compute[72418]:       <target dev="tape6c1511d-07"/>
Aug 09 18:22:20 user nova-compute[72418]:     </interface>
Aug 09 18:22:20 user nova-compute[72418]:     <serial type="pty">
Aug 09 18:22:20 user nova-compute[72418]:       <log file="/opt/stack/data/nova/instances/4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf/console.log" append="off"/>
Aug 09 18:22:20 user nova-compute[72418]:     </serial>
Aug 09 18:22:20 user nova-compute[72418]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 18:22:20 user nova-compute[72418]:     <video>
Aug 09 18:22:20 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:22:20 user nova-compute[72418]:     </video>
Aug 09 18:22:20 user nova-compute[72418]:     <rng model="virtio">
Aug 09 18:22:20 user nova-compute[72418]:       <backend model="random">/dev/urandom</backend>
Aug 09 18:22:20 user nova-compute[72418]:     </rng>
Aug 09 18:22:20 user nova-compute[72418]:     <controller type="usb" index="0" model="none"/>
Aug 09 18:22:20 user nova-compute[72418]:     <memballoon model="virtio">
Aug 09 18:22:20 user nova-compute[72418]:       <stats period="10"/>
Aug 09 18:22:20 user nova-compute[72418]:     </memballoon>
Aug 09 18:22:20 user nova-compute[72418]:   </devices>
Aug 09 18:22:20 user nova-compute[72418]: </domain>
Aug 09 18:22:20 user nova-compute[72418]:  {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 18:22:20 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:22:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-968743662',display_name='tempest-VolumesAdminNegativeTest-server-968743662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-968743662',id=7,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQ6zWIitmeu0DLu53Uuort2xj9NFnMCtkMwpHM+WpmwBwNoSmJfS3Fw7RZw4UJ9us1isjM/nSmzX/jdTNP+JBXVyF+0ywXOXRqse7blCLLMzYlEBVVNIjsdzsPKdtZ8TQ==',key_name='tempest-keypair-2131917963',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5f09f1028304efd84f2e694efdae063',ramdisk_id='',reservation_id='r-572wet15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-612744035',owner_user_name='tempest-VolumesAdminNegativeTest-612744035-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:22:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3edbabbb69494929a4d671b4113f7753',uuid=4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6c1511d-0765-4136-854a-e9a673db5071", "address": "fa:16:3e:ca:f9:2b", "network": {"id": "57e1bdad-aad5-47b8-854b-68f3c1375325", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1415993909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f09f1028304efd84f2e694efdae063", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c1511d-07", "ovs_interfaceid": "e6c1511d-0765-4136-854a-e9a673db5071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:22:20 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Converting VIF {"id": "e6c1511d-0765-4136-854a-e9a673db5071", "address": "fa:16:3e:ca:f9:2b", "network": {"id": "57e1bdad-aad5-47b8-854b-68f3c1375325", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1415993909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f09f1028304efd84f2e694efdae063", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c1511d-07", "ovs_interfaceid": "e6c1511d-0765-4136-854a-e9a673db5071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:22:20 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:f9:2b,bridge_name='br-int',has_traffic_filtering=True,id=e6c1511d-0765-4136-854a-e9a673db5071,network=Network(57e1bdad-aad5-47b8-854b-68f3c1375325),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c1511d-07') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:22:20 user nova-compute[72418]: DEBUG os_vif [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:f9:2b,bridge_name='br-int',has_traffic_filtering=True,id=e6c1511d-0765-4136-854a-e9a673db5071,network=Network(57e1bdad-aad5-47b8-854b-68f3c1375325),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c1511d-07') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:22:20 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:20 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:22:20 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:22:20 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:20 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape6c1511d-07, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:22:20 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape6c1511d-07, col_values=(('external_ids', {'iface-id': 'e6c1511d-0765-4136-854a-e9a673db5071', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:f9:2b', 'vm-uuid': '4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:22:20 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:20 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:22:20 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:20 user nova-compute[72418]: INFO os_vif [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:f9:2b,bridge_name='br-int',has_traffic_filtering=True,id=e6c1511d-0765-4136-854a-e9a673db5071,network=Network(57e1bdad-aad5-47b8-854b-68f3c1375325),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c1511d-07')
Aug 09 18:22:20 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:22:20 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] No VIF found with MAC fa:16:3e:ca:f9:2b, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:22:21 user nova-compute[72418]: DEBUG nova.network.neutron [req-d5aaca48-c57b-417a-a667-8a9982da5afe req-3220b5a3-3816-4792-84f9-bbeeee4a21c7 service nova] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Updated VIF entry in instance network info cache for port ae43991a-cb38-4bb3-ae7e-9c72684dcdd9. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:22:21 user nova-compute[72418]: DEBUG nova.network.neutron [req-d5aaca48-c57b-417a-a667-8a9982da5afe req-3220b5a3-3816-4792-84f9-bbeeee4a21c7 service nova] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Updating instance_info_cache with network_info: [{"id": "ae43991a-cb38-4bb3-ae7e-9c72684dcdd9", "address": "fa:16:3e:98:e7:5b", "network": {"id": "625ace3e-82b3-4e9c-b5d2-018f7c686cf4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1965184187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df6a65ef22db446c9cda523621cda645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae43991a-cb", "ovs_interfaceid": "ae43991a-cb38-4bb3-ae7e-9c72684dcdd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:22:21 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-d5aaca48-c57b-417a-a667-8a9982da5afe req-3220b5a3-3816-4792-84f9-bbeeee4a21c7 service nova] Releasing lock "refresh_cache-6084e681-01c4-4a6c-beb3-dcda4a990a51" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:22:21 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:21 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:21 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:21 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:21 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:21 user nova-compute[72418]: DEBUG nova.network.neutron [req-92a3b345-7e0c-4965-bf8c-fbbfe0967da4 req-daead274-3083-4877-b4d6-a96d2e70c527 service nova] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Updated VIF entry in instance network info cache for port e6c1511d-0765-4136-854a-e9a673db5071. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:22:21 user nova-compute[72418]: DEBUG nova.network.neutron [req-92a3b345-7e0c-4965-bf8c-fbbfe0967da4 req-daead274-3083-4877-b4d6-a96d2e70c527 service nova] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Updating instance_info_cache with network_info: [{"id": "e6c1511d-0765-4136-854a-e9a673db5071", "address": "fa:16:3e:ca:f9:2b", "network": {"id": "57e1bdad-aad5-47b8-854b-68f3c1375325", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1415993909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f09f1028304efd84f2e694efdae063", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c1511d-07", "ovs_interfaceid": "e6c1511d-0765-4136-854a-e9a673db5071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:22:21 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-92a3b345-7e0c-4965-bf8c-fbbfe0967da4 req-daead274-3083-4877-b4d6-a96d2e70c527 service nova] Releasing lock "refresh_cache-4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:22:21 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:22 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:22 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:22 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:22 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:22 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:22 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:23 user nova-compute[72418]: DEBUG nova.compute.manager [req-ef99b56d-1eb4-4821-8f90-3d350edd7025 req-b363f9e1-0ccc-4c29-b634-54dab17bcfa3 service nova] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Received event network-vif-plugged-ae43991a-cb38-4bb3-ae7e-9c72684dcdd9 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:22:23 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-ef99b56d-1eb4-4821-8f90-3d350edd7025 req-b363f9e1-0ccc-4c29-b634-54dab17bcfa3 service nova] Acquiring lock "6084e681-01c4-4a6c-beb3-dcda4a990a51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:22:23 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-ef99b56d-1eb4-4821-8f90-3d350edd7025 req-b363f9e1-0ccc-4c29-b634-54dab17bcfa3 service nova] Lock "6084e681-01c4-4a6c-beb3-dcda4a990a51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:22:23 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-ef99b56d-1eb4-4821-8f90-3d350edd7025 req-b363f9e1-0ccc-4c29-b634-54dab17bcfa3 service nova] Lock "6084e681-01c4-4a6c-beb3-dcda4a990a51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:22:23 user nova-compute[72418]: DEBUG nova.compute.manager [req-ef99b56d-1eb4-4821-8f90-3d350edd7025 req-b363f9e1-0ccc-4c29-b634-54dab17bcfa3 service nova] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] No waiting events found dispatching network-vif-plugged-ae43991a-cb38-4bb3-ae7e-9c72684dcdd9 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:22:23 user nova-compute[72418]: WARNING nova.compute.manager [req-ef99b56d-1eb4-4821-8f90-3d350edd7025 req-b363f9e1-0ccc-4c29-b634-54dab17bcfa3 service nova] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Received unexpected event network-vif-plugged-ae43991a-cb38-4bb3-ae7e-9c72684dcdd9 for instance with vm_state building and task_state spawning.
Aug 09 18:22:23 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:23 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:23 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:23 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:23 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:24 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:24 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:24 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:25 user nova-compute[72418]: DEBUG nova.compute.manager [req-5623e1f9-4258-4147-8778-bec0e80fc882 req-54105e72-c808-4e0c-b188-d629fbbf2d62 service nova] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Received event network-vif-plugged-e6c1511d-0765-4136-854a-e9a673db5071 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:22:25 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-5623e1f9-4258-4147-8778-bec0e80fc882 req-54105e72-c808-4e0c-b188-d629fbbf2d62 service nova] Acquiring lock "4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:22:25 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-5623e1f9-4258-4147-8778-bec0e80fc882 req-54105e72-c808-4e0c-b188-d629fbbf2d62 service nova] Lock "4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:22:25 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-5623e1f9-4258-4147-8778-bec0e80fc882 req-54105e72-c808-4e0c-b188-d629fbbf2d62 service nova] Lock "4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:22:25 user nova-compute[72418]: DEBUG nova.compute.manager [req-5623e1f9-4258-4147-8778-bec0e80fc882 req-54105e72-c808-4e0c-b188-d629fbbf2d62 service nova] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] No waiting events found dispatching network-vif-plugged-e6c1511d-0765-4136-854a-e9a673db5071 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:22:25 user nova-compute[72418]: WARNING nova.compute.manager [req-5623e1f9-4258-4147-8778-bec0e80fc882 req-54105e72-c808-4e0c-b188-d629fbbf2d62 service nova] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Received unexpected event network-vif-plugged-e6c1511d-0765-4136-854a-e9a673db5071 for instance with vm_state building and task_state spawning.
Aug 09 18:22:25 user nova-compute[72418]: DEBUG nova.compute.manager [req-32b2af98-cb75-43b3-9970-1b20c7178cb3 req-c6ac5cbd-09bb-4578-8ca7-08117c8238c0 service nova] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Received event network-vif-plugged-ae43991a-cb38-4bb3-ae7e-9c72684dcdd9 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:22:25 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-32b2af98-cb75-43b3-9970-1b20c7178cb3 req-c6ac5cbd-09bb-4578-8ca7-08117c8238c0 service nova] Acquiring lock "6084e681-01c4-4a6c-beb3-dcda4a990a51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:22:25 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-32b2af98-cb75-43b3-9970-1b20c7178cb3 req-c6ac5cbd-09bb-4578-8ca7-08117c8238c0 service nova] Lock "6084e681-01c4-4a6c-beb3-dcda4a990a51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:22:25 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-32b2af98-cb75-43b3-9970-1b20c7178cb3 req-c6ac5cbd-09bb-4578-8ca7-08117c8238c0 service nova] Lock "6084e681-01c4-4a6c-beb3-dcda4a990a51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:22:25 user nova-compute[72418]: DEBUG nova.compute.manager [req-32b2af98-cb75-43b3-9970-1b20c7178cb3 req-c6ac5cbd-09bb-4578-8ca7-08117c8238c0 service nova] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] No waiting events found dispatching network-vif-plugged-ae43991a-cb38-4bb3-ae7e-9c72684dcdd9 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:22:25 user nova-compute[72418]: WARNING nova.compute.manager [req-32b2af98-cb75-43b3-9970-1b20c7178cb3 req-c6ac5cbd-09bb-4578-8ca7-08117c8238c0 service nova] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Received unexpected event network-vif-plugged-ae43991a-cb38-4bb3-ae7e-9c72684dcdd9 for instance with vm_state building and task_state spawning.
Aug 09 18:22:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:26 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Acquiring lock "dabfdb24-fc0b-4a00-a229-1ece48e27d18" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:22:26 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Lock "dabfdb24-fc0b-4a00-a229-1ece48e27d18" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:22:26 user nova-compute[72418]: DEBUG nova.compute.manager [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Starting instance... {{(pid=72418) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 18:22:26 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:26 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605346.9959266, 6084e681-01c4-4a6c-beb3-dcda4a990a51 => Resumed> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:22:26 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] VM Resumed (Lifecycle Event)
Aug 09 18:22:27 user nova-compute[72418]: DEBUG nova.compute.manager [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Instance event wait completed in 0 seconds for  {{(pid=72418) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 18:22:27 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Guest created on hypervisor {{(pid=72418) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 18:22:27 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Instance spawned successfully.
Aug 09 18:22:27 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 18:22:27 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:22:27 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:22:27 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Found default for hw_cdrom_bus of ide {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:22:27 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Found default for hw_disk_bus of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:22:27 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Found default for hw_input_bus of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:22:27 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Found default for hw_pointer_model of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:22:27 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Found default for hw_video_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:22:27 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Found default for hw_vif_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:22:27 user nova-compute[72418]: DEBUG nova.compute.manager [req-de0275bf-1119-48a5-a254-212f6c7e5507 req-27fd701c-9159-422a-b53d-2dceb4c91f6f service nova] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Received event network-vif-plugged-e6c1511d-0765-4136-854a-e9a673db5071 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:22:27 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-de0275bf-1119-48a5-a254-212f6c7e5507 req-27fd701c-9159-422a-b53d-2dceb4c91f6f service nova] Acquiring lock "4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:22:27 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-de0275bf-1119-48a5-a254-212f6c7e5507 req-27fd701c-9159-422a-b53d-2dceb4c91f6f service nova] Lock "4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:22:27 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-de0275bf-1119-48a5-a254-212f6c7e5507 req-27fd701c-9159-422a-b53d-2dceb4c91f6f service nova] Lock "4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:22:27 user nova-compute[72418]: DEBUG nova.compute.manager [req-de0275bf-1119-48a5-a254-212f6c7e5507 req-27fd701c-9159-422a-b53d-2dceb4c91f6f service nova] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] No waiting events found dispatching network-vif-plugged-e6c1511d-0765-4136-854a-e9a673db5071 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:22:27 user nova-compute[72418]: WARNING nova.compute.manager [req-de0275bf-1119-48a5-a254-212f6c7e5507 req-27fd701c-9159-422a-b53d-2dceb4c91f6f service nova] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Received unexpected event network-vif-plugged-e6c1511d-0765-4136-854a-e9a673db5071 for instance with vm_state building and task_state spawning.
Aug 09 18:22:27 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:22:27 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605346.998431, 6084e681-01c4-4a6c-beb3-dcda4a990a51 => Started> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:22:27 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] VM Started (Lifecycle Event)
Aug 09 18:22:27 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:22:27 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:22:27 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:22:27 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72418) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 18:22:27 user nova-compute[72418]: INFO nova.compute.claims [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Claim successful on node user
Aug 09 18:22:27 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:22:27 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:22:27 user nova-compute[72418]: INFO nova.compute.manager [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Took 12.17 seconds to spawn the instance on the hypervisor.
Aug 09 18:22:27 user nova-compute[72418]: DEBUG nova.compute.manager [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:22:27 user nova-compute[72418]: INFO nova.compute.manager [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Took 15.41 seconds to build instance.
Aug 09 18:22:27 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-6e0a8a6e-a95d-45c5-a72d-0db2d9a7fced tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Lock "6084e681-01c4-4a6c-beb3-dcda4a990a51" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.584s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:22:27 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605347.5141585, 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf => Resumed> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:22:27 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] VM Resumed (Lifecycle Event)
Aug 09 18:22:27 user nova-compute[72418]: DEBUG nova.compute.manager [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Instance event wait completed in 0 seconds for  {{(pid=72418) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 18:22:27 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Guest created on hypervisor {{(pid=72418) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 18:22:27 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Instance spawned successfully.
Aug 09 18:22:27 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 18:22:27 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:22:27 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:22:27 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Found default for hw_cdrom_bus of ide {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:22:27 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Found default for hw_disk_bus of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:22:27 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Found default for hw_input_bus of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:22:27 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Found default for hw_pointer_model of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:22:27 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Found default for hw_video_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:22:27 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Found default for hw_vif_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:22:27 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:22:27 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605347.5193079, 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf => Started> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:22:27 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] VM Started (Lifecycle Event)
Aug 09 18:22:27 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:22:27 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:22:27 user nova-compute[72418]: INFO nova.compute.manager [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Took 11.06 seconds to spawn the instance on the hypervisor.
Aug 09 18:22:27 user nova-compute[72418]: DEBUG nova.compute.manager [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:22:27 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:22:27 user nova-compute[72418]: INFO nova.compute.manager [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Took 14.88 seconds to build instance.
Aug 09 18:22:27 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-dbf36b34-b5e5-4865-9db4-97b896a64239 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Lock "4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.067s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:22:27 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:22:27 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:22:28 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.892s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:22:28 user nova-compute[72418]: DEBUG nova.compute.manager [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Start building networks asynchronously for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 18:22:28 user nova-compute[72418]: DEBUG nova.compute.manager [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Allocating IP information in the background. {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 18:22:28 user nova-compute[72418]: DEBUG nova.network.neutron [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] allocate_for_instance() {{(pid=72418) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 18:22:28 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 18:22:28 user nova-compute[72418]: DEBUG nova.compute.manager [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Start building block device mappings for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 18:22:28 user nova-compute[72418]: DEBUG nova.policy [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2dcffc3323db447c9625f74e82179502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee457e31034445e82a46b87d54ef5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72418) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 18:22:28 user nova-compute[72418]: DEBUG nova.compute.manager [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Start spawning the instance on the hypervisor. {{(pid=72418) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 18:22:28 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Creating instance directory {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 18:22:28 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Creating image(s)
Aug 09 18:22:28 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Acquiring lock "/opt/stack/data/nova/instances/dabfdb24-fc0b-4a00-a229-1ece48e27d18/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:22:28 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Lock "/opt/stack/data/nova/instances/dabfdb24-fc0b-4a00-a229-1ece48e27d18/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:22:28 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Lock "/opt/stack/data/nova/instances/dabfdb24-fc0b-4a00-a229-1ece48e27d18/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:22:28 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:22:28 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.187s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:22:28 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Acquiring lock "458773cfa7230b717e41c60277832e9f83806d71" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:22:28 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:22:28 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:22:28 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.187s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:22:28 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/dabfdb24-fc0b-4a00-a229-1ece48e27d18/disk 1073741824 {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:22:29 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/dabfdb24-fc0b-4a00-a229-1ece48e27d18/disk 1073741824" returned: 0 in 0.082s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:22:29 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:22:29 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:22:29 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.167s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:22:29 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dabfdb24-fc0b-4a00-a229-1ece48e27d18/disk. size=1073741824 {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 18:22:29 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dabfdb24-fc0b-4a00-a229-1ece48e27d18/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:22:29 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dabfdb24-fc0b-4a00-a229-1ece48e27d18/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:22:29 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Cannot resize image /opt/stack/data/nova/instances/dabfdb24-fc0b-4a00-a229-1ece48e27d18/disk to a smaller size. {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 18:22:29 user nova-compute[72418]: DEBUG nova.objects.instance [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Lazy-loading 'migration_context' on Instance uuid dabfdb24-fc0b-4a00-a229-1ece48e27d18 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:22:29 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Created local disks {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 18:22:29 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Ensure instance console log exists: /opt/stack/data/nova/instances/dabfdb24-fc0b-4a00-a229-1ece48e27d18/console.log {{(pid=72418) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 18:22:29 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:22:29 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:22:29 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:22:29 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:29 user nova-compute[72418]: DEBUG nova.network.neutron [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Successfully created port: e53ca69c-b53f-4f5f-b8fa-f8a66b4177f5 {{(pid=72418) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 18:22:30 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:30 user nova-compute[72418]: DEBUG nova.network.neutron [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Successfully updated port: e53ca69c-b53f-4f5f-b8fa-f8a66b4177f5 {{(pid=72418) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 18:22:30 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Acquiring lock "refresh_cache-dabfdb24-fc0b-4a00-a229-1ece48e27d18" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:22:30 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Acquired lock "refresh_cache-dabfdb24-fc0b-4a00-a229-1ece48e27d18" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:22:30 user nova-compute[72418]: DEBUG nova.network.neutron [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:22:30 user nova-compute[72418]: DEBUG nova.compute.manager [req-77db78ea-df0b-4ddd-a027-bc54bd08d3ef req-275cae38-4638-46e6-916b-04f566630f1e service nova] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Received event network-changed-e53ca69c-b53f-4f5f-b8fa-f8a66b4177f5 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:22:30 user nova-compute[72418]: DEBUG nova.compute.manager [req-77db78ea-df0b-4ddd-a027-bc54bd08d3ef req-275cae38-4638-46e6-916b-04f566630f1e service nova] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Refreshing instance network info cache due to event network-changed-e53ca69c-b53f-4f5f-b8fa-f8a66b4177f5. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:22:30 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-77db78ea-df0b-4ddd-a027-bc54bd08d3ef req-275cae38-4638-46e6-916b-04f566630f1e service nova] Acquiring lock "refresh_cache-dabfdb24-fc0b-4a00-a229-1ece48e27d18" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:22:30 user nova-compute[72418]: DEBUG nova.network.neutron [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Instance cache missing network info. {{(pid=72418) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 18:22:31 user nova-compute[72418]: DEBUG nova.network.neutron [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Updating instance_info_cache with network_info: [{"id": "e53ca69c-b53f-4f5f-b8fa-f8a66b4177f5", "address": "fa:16:3e:9a:12:a5", "network": {"id": "6dd2923f-ee1a-4058-abfb-b1fb2b0c8325", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1188534456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cee457e31034445e82a46b87d54ef5f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape53ca69c-b5", "ovs_interfaceid": "e53ca69c-b53f-4f5f-b8fa-f8a66b4177f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:22:31 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Releasing lock "refresh_cache-dabfdb24-fc0b-4a00-a229-1ece48e27d18" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:22:31 user nova-compute[72418]: DEBUG nova.compute.manager [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Instance network_info: |[{"id": "e53ca69c-b53f-4f5f-b8fa-f8a66b4177f5", "address": "fa:16:3e:9a:12:a5", "network": {"id": "6dd2923f-ee1a-4058-abfb-b1fb2b0c8325", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1188534456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cee457e31034445e82a46b87d54ef5f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape53ca69c-b5", "ovs_interfaceid": "e53ca69c-b53f-4f5f-b8fa-f8a66b4177f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 18:22:31 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-77db78ea-df0b-4ddd-a027-bc54bd08d3ef req-275cae38-4638-46e6-916b-04f566630f1e service nova] Acquired lock "refresh_cache-dabfdb24-fc0b-4a00-a229-1ece48e27d18" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:22:31 user nova-compute[72418]: DEBUG nova.network.neutron [req-77db78ea-df0b-4ddd-a027-bc54bd08d3ef req-275cae38-4638-46e6-916b-04f566630f1e service nova] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Refreshing network info cache for port e53ca69c-b53f-4f5f-b8fa-f8a66b4177f5 {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:22:31 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Start _get_guest_xml network_info=[{"id": "e53ca69c-b53f-4f5f-b8fa-f8a66b4177f5", "address": "fa:16:3e:9a:12:a5", "network": {"id": "6dd2923f-ee1a-4058-abfb-b1fb2b0c8325", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1188534456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cee457e31034445e82a46b87d54ef5f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape53ca69c-b5", "ovs_interfaceid": "e53ca69c-b53f-4f5f-b8fa-f8a66b4177f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 18:22:31 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:22:31 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:22:31 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 18:22:31 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] CPU controller missing on host. {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 18:22:31 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 18:22:31 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] CPU controller found on host. {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 18:22:31 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72418) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 18:22:31 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T18:17:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 18:22:31 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Flavor limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 18:22:31 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Image limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 18:22:31 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Flavor pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 18:22:31 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Image pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 18:22:31 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 18:22:31 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 18:22:31 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 18:22:31 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Got 1 possible topologies {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 18:22:31 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 18:22:31 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 18:22:31 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:22:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2118574215',display_name='tempest-TestVolumeSwap-server-2118574215',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2118574215',id=8,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLhr+BmnLQHSSQhY45cpG3EfUYHhI72ddTB+tZqOGD2dBAalfMaaqnCsFe9sV2x8zXBcbLyTVXvjiVIxS/1zOeEtcjduDmbV9Ca2A10KVsXv/iO6d8E0Cx+qF2x7xsc0fA==',key_name='tempest-keypair-18310665',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cee457e31034445e82a46b87d54ef5f4',ramdisk_id='',reservation_id='r-wqaxbpm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-880389199',owner_user_name='tempest-TestVolumeSwap-880389199-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:22:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2dcffc3323db447c9625f74e82179502',uuid=dabfdb24-fc0b-4a00-a229-1ece48e27d18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e53ca69c-b53f-4f5f-b8fa-f8a66b4177f5", "address": "fa:16:3e:9a:12:a5", "network": {"id": "6dd2923f-ee1a-4058-abfb-b1fb2b0c8325", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1188534456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cee457e31034445e82a46b87d54ef5f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape53ca69c-b5", "ovs_interfaceid": "e53ca69c-b53f-4f5f-b8fa-f8a66b4177f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:22:31 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Converting VIF {"id": "e53ca69c-b53f-4f5f-b8fa-f8a66b4177f5", "address": "fa:16:3e:9a:12:a5", "network": {"id": "6dd2923f-ee1a-4058-abfb-b1fb2b0c8325", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1188534456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cee457e31034445e82a46b87d54ef5f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape53ca69c-b5", "ovs_interfaceid": "e53ca69c-b53f-4f5f-b8fa-f8a66b4177f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:22:31 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:12:a5,bridge_name='br-int',has_traffic_filtering=True,id=e53ca69c-b53f-4f5f-b8fa-f8a66b4177f5,network=Network(6dd2923f-ee1a-4058-abfb-b1fb2b0c8325),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape53ca69c-b5') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:22:31 user nova-compute[72418]: DEBUG nova.objects.instance [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Lazy-loading 'pci_devices' on Instance uuid dabfdb24-fc0b-4a00-a229-1ece48e27d18 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:22:31 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] End _get_guest_xml xml=<domain type="kvm">
Aug 09 18:22:31 user nova-compute[72418]:   <uuid>dabfdb24-fc0b-4a00-a229-1ece48e27d18</uuid>
Aug 09 18:22:31 user nova-compute[72418]:   <name>instance-00000008</name>
Aug 09 18:22:31 user nova-compute[72418]:   <memory>524288</memory>
Aug 09 18:22:31 user nova-compute[72418]:   <vcpu>1</vcpu>
Aug 09 18:22:31 user nova-compute[72418]:   <metadata>
Aug 09 18:22:31 user nova-compute[72418]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:22:31 user nova-compute[72418]:       <nova:package version="0.0.0"/>
Aug 09 18:22:31 user nova-compute[72418]:       <nova:name>tempest-TestVolumeSwap-server-2118574215</nova:name>
Aug 09 18:22:31 user nova-compute[72418]:       <nova:creationTime>2023-08-09 18:22:31</nova:creationTime>
Aug 09 18:22:31 user nova-compute[72418]:       <nova:flavor name="m1.tiny">
Aug 09 18:22:31 user nova-compute[72418]:         <nova:memory>512</nova:memory>
Aug 09 18:22:31 user nova-compute[72418]:         <nova:disk>1</nova:disk>
Aug 09 18:22:31 user nova-compute[72418]:         <nova:swap>0</nova:swap>
Aug 09 18:22:31 user nova-compute[72418]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:22:31 user nova-compute[72418]:         <nova:vcpus>1</nova:vcpus>
Aug 09 18:22:31 user nova-compute[72418]:       </nova:flavor>
Aug 09 18:22:31 user nova-compute[72418]:       <nova:owner>
Aug 09 18:22:31 user nova-compute[72418]:         <nova:user uuid="2dcffc3323db447c9625f74e82179502">tempest-TestVolumeSwap-880389199-project-member</nova:user>
Aug 09 18:22:31 user nova-compute[72418]:         <nova:project uuid="cee457e31034445e82a46b87d54ef5f4">tempest-TestVolumeSwap-880389199</nova:project>
Aug 09 18:22:31 user nova-compute[72418]:       </nova:owner>
Aug 09 18:22:31 user nova-compute[72418]:       <nova:root type="image" uuid="8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e"/>
Aug 09 18:22:31 user nova-compute[72418]:       <nova:ports>
Aug 09 18:22:31 user nova-compute[72418]:         <nova:port uuid="e53ca69c-b53f-4f5f-b8fa-f8a66b4177f5">
Aug 09 18:22:31 user nova-compute[72418]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 18:22:31 user nova-compute[72418]:         </nova:port>
Aug 09 18:22:31 user nova-compute[72418]:       </nova:ports>
Aug 09 18:22:31 user nova-compute[72418]:     </nova:instance>
Aug 09 18:22:31 user nova-compute[72418]:   </metadata>
Aug 09 18:22:31 user nova-compute[72418]:   <sysinfo type="smbios">
Aug 09 18:22:31 user nova-compute[72418]:     <system>
Aug 09 18:22:31 user nova-compute[72418]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 18:22:31 user nova-compute[72418]:       <entry name="product">OpenStack Nova</entry>
Aug 09 18:22:31 user nova-compute[72418]:       <entry name="version">0.0.0</entry>
Aug 09 18:22:31 user nova-compute[72418]:       <entry name="serial">dabfdb24-fc0b-4a00-a229-1ece48e27d18</entry>
Aug 09 18:22:31 user nova-compute[72418]:       <entry name="uuid">dabfdb24-fc0b-4a00-a229-1ece48e27d18</entry>
Aug 09 18:22:31 user nova-compute[72418]:       <entry name="family">Virtual Machine</entry>
Aug 09 18:22:31 user nova-compute[72418]:     </system>
Aug 09 18:22:31 user nova-compute[72418]:   </sysinfo>
Aug 09 18:22:31 user nova-compute[72418]:   <os>
Aug 09 18:22:31 user nova-compute[72418]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 18:22:31 user nova-compute[72418]:     <boot dev="hd"/>
Aug 09 18:22:31 user nova-compute[72418]:     <smbios mode="sysinfo"/>
Aug 09 18:22:31 user nova-compute[72418]:   </os>
Aug 09 18:22:31 user nova-compute[72418]:   <features>
Aug 09 18:22:31 user nova-compute[72418]:     <acpi/>
Aug 09 18:22:31 user nova-compute[72418]:     <apic/>
Aug 09 18:22:31 user nova-compute[72418]:     <vmcoreinfo/>
Aug 09 18:22:31 user nova-compute[72418]:   </features>
Aug 09 18:22:31 user nova-compute[72418]:   <clock offset="utc">
Aug 09 18:22:31 user nova-compute[72418]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 18:22:31 user nova-compute[72418]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 18:22:31 user nova-compute[72418]:     <timer name="hpet" present="no"/>
Aug 09 18:22:31 user nova-compute[72418]:   </clock>
Aug 09 18:22:31 user nova-compute[72418]:   <cpu mode="custom" match="exact">
Aug 09 18:22:31 user nova-compute[72418]:     <model>Nehalem</model>
Aug 09 18:22:31 user nova-compute[72418]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 18:22:31 user nova-compute[72418]:   </cpu>
Aug 09 18:22:31 user nova-compute[72418]:   <devices>
Aug 09 18:22:31 user nova-compute[72418]:     <disk type="file" device="disk">
Aug 09 18:22:31 user nova-compute[72418]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 18:22:31 user nova-compute[72418]:       <source file="/opt/stack/data/nova/instances/dabfdb24-fc0b-4a00-a229-1ece48e27d18/disk"/>
Aug 09 18:22:31 user nova-compute[72418]:       <target dev="vda" bus="virtio"/>
Aug 09 18:22:31 user nova-compute[72418]:     </disk>
Aug 09 18:22:31 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:22:31 user nova-compute[72418]:       <mac address="fa:16:3e:9a:12:a5"/>
Aug 09 18:22:31 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:22:31 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:22:31 user nova-compute[72418]:       <target dev="tape53ca69c-b5"/>
Aug 09 18:22:31 user nova-compute[72418]:     </interface>
Aug 09 18:22:31 user nova-compute[72418]:     <serial type="pty">
Aug 09 18:22:31 user nova-compute[72418]:       <log file="/opt/stack/data/nova/instances/dabfdb24-fc0b-4a00-a229-1ece48e27d18/console.log" append="off"/>
Aug 09 18:22:31 user nova-compute[72418]:     </serial>
Aug 09 18:22:31 user nova-compute[72418]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 18:22:31 user nova-compute[72418]:     <video>
Aug 09 18:22:31 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:22:31 user nova-compute[72418]:     </video>
Aug 09 18:22:31 user nova-compute[72418]:     <rng model="virtio">
Aug 09 18:22:31 user nova-compute[72418]:       <backend model="random">/dev/urandom</backend>
Aug 09 18:22:31 user nova-compute[72418]:     </rng>
Aug 09 18:22:31 user nova-compute[72418]:     <controller type="usb" index="0" model="none"/>
Aug 09 18:22:31 user nova-compute[72418]:     <memballoon model="virtio">
Aug 09 18:22:31 user nova-compute[72418]:       <stats period="10"/>
Aug 09 18:22:31 user nova-compute[72418]:     </memballoon>
Aug 09 18:22:31 user nova-compute[72418]:   </devices>
Aug 09 18:22:31 user nova-compute[72418]: </domain>
Aug 09 18:22:31 user nova-compute[72418]:  {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 18:22:31 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:22:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2118574215',display_name='tempest-TestVolumeSwap-server-2118574215',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2118574215',id=8,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLhr+BmnLQHSSQhY45cpG3EfUYHhI72ddTB+tZqOGD2dBAalfMaaqnCsFe9sV2x8zXBcbLyTVXvjiVIxS/1zOeEtcjduDmbV9Ca2A10KVsXv/iO6d8E0Cx+qF2x7xsc0fA==',key_name='tempest-keypair-18310665',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cee457e31034445e82a46b87d54ef5f4',ramdisk_id='',reservation_id='r-wqaxbpm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-880389199',owner_user_name='tempest-TestVolumeSwap-880389199-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:22:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2dcffc3323db447c9625f74e82179502',uuid=dabfdb24-fc0b-4a00-a229-1ece48e27d18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e53ca69c-b53f-4f5f-b8fa-f8a66b4177f5", "address": "fa:16:3e:9a:12:a5", "network": {"id": "6dd2923f-ee1a-4058-abfb-b1fb2b0c8325", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1188534456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cee457e31034445e82a46b87d54ef5f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape53ca69c-b5", "ovs_interfaceid": "e53ca69c-b53f-4f5f-b8fa-f8a66b4177f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:22:31 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Converting VIF {"id": "e53ca69c-b53f-4f5f-b8fa-f8a66b4177f5", "address": "fa:16:3e:9a:12:a5", "network": {"id": "6dd2923f-ee1a-4058-abfb-b1fb2b0c8325", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1188534456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cee457e31034445e82a46b87d54ef5f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape53ca69c-b5", "ovs_interfaceid": "e53ca69c-b53f-4f5f-b8fa-f8a66b4177f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:22:31 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:12:a5,bridge_name='br-int',has_traffic_filtering=True,id=e53ca69c-b53f-4f5f-b8fa-f8a66b4177f5,network=Network(6dd2923f-ee1a-4058-abfb-b1fb2b0c8325),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape53ca69c-b5') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:22:31 user nova-compute[72418]: DEBUG os_vif [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:12:a5,bridge_name='br-int',has_traffic_filtering=True,id=e53ca69c-b53f-4f5f-b8fa-f8a66b4177f5,network=Network(6dd2923f-ee1a-4058-abfb-b1fb2b0c8325),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape53ca69c-b5') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:22:31 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:31 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:22:31 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:22:31 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:31 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape53ca69c-b5, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:22:31 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape53ca69c-b5, col_values=(('external_ids', {'iface-id': 'e53ca69c-b53f-4f5f-b8fa-f8a66b4177f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:12:a5', 'vm-uuid': 'dabfdb24-fc0b-4a00-a229-1ece48e27d18'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:22:31 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:22:31 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:31 user nova-compute[72418]: INFO os_vif [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:12:a5,bridge_name='br-int',has_traffic_filtering=True,id=e53ca69c-b53f-4f5f-b8fa-f8a66b4177f5,network=Network(6dd2923f-ee1a-4058-abfb-b1fb2b0c8325),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape53ca69c-b5')
Aug 09 18:22:31 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:22:31 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] No VIF found with MAC fa:16:3e:9a:12:a5, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:22:31 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:32 user nova-compute[72418]: DEBUG nova.network.neutron [req-77db78ea-df0b-4ddd-a027-bc54bd08d3ef req-275cae38-4638-46e6-916b-04f566630f1e service nova] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Updated VIF entry in instance network info cache for port e53ca69c-b53f-4f5f-b8fa-f8a66b4177f5. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:22:32 user nova-compute[72418]: DEBUG nova.network.neutron [req-77db78ea-df0b-4ddd-a027-bc54bd08d3ef req-275cae38-4638-46e6-916b-04f566630f1e service nova] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Updating instance_info_cache with network_info: [{"id": "e53ca69c-b53f-4f5f-b8fa-f8a66b4177f5", "address": "fa:16:3e:9a:12:a5", "network": {"id": "6dd2923f-ee1a-4058-abfb-b1fb2b0c8325", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1188534456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cee457e31034445e82a46b87d54ef5f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape53ca69c-b5", "ovs_interfaceid": "e53ca69c-b53f-4f5f-b8fa-f8a66b4177f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:22:32 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-77db78ea-df0b-4ddd-a027-bc54bd08d3ef req-275cae38-4638-46e6-916b-04f566630f1e service nova] Releasing lock "refresh_cache-dabfdb24-fc0b-4a00-a229-1ece48e27d18" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:22:33 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:33 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:33 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:34 user nova-compute[72418]: DEBUG nova.compute.manager [req-4c070063-5364-4f78-8269-babbab9ac7a2 req-387db457-3289-4b0a-9224-f0f2f78ae77f service nova] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Received event network-vif-plugged-e53ca69c-b53f-4f5f-b8fa-f8a66b4177f5 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:22:34 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-4c070063-5364-4f78-8269-babbab9ac7a2 req-387db457-3289-4b0a-9224-f0f2f78ae77f service nova] Acquiring lock "dabfdb24-fc0b-4a00-a229-1ece48e27d18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:22:34 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-4c070063-5364-4f78-8269-babbab9ac7a2 req-387db457-3289-4b0a-9224-f0f2f78ae77f service nova] Lock "dabfdb24-fc0b-4a00-a229-1ece48e27d18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:22:34 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-4c070063-5364-4f78-8269-babbab9ac7a2 req-387db457-3289-4b0a-9224-f0f2f78ae77f service nova] Lock "dabfdb24-fc0b-4a00-a229-1ece48e27d18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:22:34 user nova-compute[72418]: DEBUG nova.compute.manager [req-4c070063-5364-4f78-8269-babbab9ac7a2 req-387db457-3289-4b0a-9224-f0f2f78ae77f service nova] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] No waiting events found dispatching network-vif-plugged-e53ca69c-b53f-4f5f-b8fa-f8a66b4177f5 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:22:34 user nova-compute[72418]: WARNING nova.compute.manager [req-4c070063-5364-4f78-8269-babbab9ac7a2 req-387db457-3289-4b0a-9224-f0f2f78ae77f service nova] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Received unexpected event network-vif-plugged-e53ca69c-b53f-4f5f-b8fa-f8a66b4177f5 for instance with vm_state building and task_state spawning.
Aug 09 18:22:34 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:34 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:34 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:34 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:36 user nova-compute[72418]: DEBUG nova.compute.manager [req-b9f32c37-942d-42e2-af9d-aba2e8a82d4b req-d5a1775c-de66-4f61-8565-70a6cd4088ae service nova] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Received event network-vif-plugged-e53ca69c-b53f-4f5f-b8fa-f8a66b4177f5 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:22:36 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-b9f32c37-942d-42e2-af9d-aba2e8a82d4b req-d5a1775c-de66-4f61-8565-70a6cd4088ae service nova] Acquiring lock "dabfdb24-fc0b-4a00-a229-1ece48e27d18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:22:36 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-b9f32c37-942d-42e2-af9d-aba2e8a82d4b req-d5a1775c-de66-4f61-8565-70a6cd4088ae service nova] Lock "dabfdb24-fc0b-4a00-a229-1ece48e27d18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:22:36 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-b9f32c37-942d-42e2-af9d-aba2e8a82d4b req-d5a1775c-de66-4f61-8565-70a6cd4088ae service nova] Lock "dabfdb24-fc0b-4a00-a229-1ece48e27d18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:22:36 user nova-compute[72418]: DEBUG nova.compute.manager [req-b9f32c37-942d-42e2-af9d-aba2e8a82d4b req-d5a1775c-de66-4f61-8565-70a6cd4088ae service nova] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] No waiting events found dispatching network-vif-plugged-e53ca69c-b53f-4f5f-b8fa-f8a66b4177f5 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:22:36 user nova-compute[72418]: WARNING nova.compute.manager [req-b9f32c37-942d-42e2-af9d-aba2e8a82d4b req-d5a1775c-de66-4f61-8565-70a6cd4088ae service nova] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Received unexpected event network-vif-plugged-e53ca69c-b53f-4f5f-b8fa-f8a66b4177f5 for instance with vm_state building and task_state spawning.
Aug 09 18:22:36 user nova-compute[72418]: DEBUG nova.compute.manager [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Instance event wait completed in 0 seconds for  {{(pid=72418) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 18:22:36 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Guest created on hypervisor {{(pid=72418) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 18:22:36 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605356.4287832, dabfdb24-fc0b-4a00-a229-1ece48e27d18 => Resumed> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:22:36 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] VM Resumed (Lifecycle Event)
Aug 09 18:22:36 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Instance spawned successfully.
Aug 09 18:22:36 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 18:22:36 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:22:36 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:22:36 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:36 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Found default for hw_cdrom_bus of ide {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:22:36 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Found default for hw_disk_bus of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:22:36 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Found default for hw_input_bus of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:22:36 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Found default for hw_pointer_model of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:22:36 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Found default for hw_video_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:22:36 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Found default for hw_vif_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:22:36 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:22:36 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605356.429778, dabfdb24-fc0b-4a00-a229-1ece48e27d18 => Started> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:22:36 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] VM Started (Lifecycle Event)
Aug 09 18:22:36 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:22:36 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:22:36 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:22:36 user nova-compute[72418]: INFO nova.compute.manager [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Took 8.11 seconds to spawn the instance on the hypervisor.
Aug 09 18:22:36 user nova-compute[72418]: DEBUG nova.compute.manager [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:22:36 user nova-compute[72418]: INFO nova.compute.manager [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Took 9.65 seconds to build instance.
Aug 09 18:22:36 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-38cc5fe2-644f-449d-a785-c8a2e622b790 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Lock "dabfdb24-fc0b-4a00-a229-1ece48e27d18" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.814s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:22:36 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:39 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Acquiring lock "d9d5d476-484e-49a3-a665-5a2069ea606e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:22:39 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Lock "d9d5d476-484e-49a3-a665-5a2069ea606e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:22:39 user nova-compute[72418]: DEBUG nova.compute.manager [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Starting instance... {{(pid=72418) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 18:22:39 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:22:39 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:22:39 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72418) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 18:22:39 user nova-compute[72418]: INFO nova.compute.claims [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Claim successful on node user
Aug 09 18:22:40 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:22:40 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:22:40 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.545s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:22:40 user nova-compute[72418]: DEBUG nova.compute.manager [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Start building networks asynchronously for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 18:22:40 user nova-compute[72418]: DEBUG nova.compute.manager [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Allocating IP information in the background. {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 18:22:40 user nova-compute[72418]: DEBUG nova.network.neutron [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] allocate_for_instance() {{(pid=72418) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 18:22:40 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 18:22:40 user nova-compute[72418]: DEBUG nova.compute.manager [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Start building block device mappings for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 18:22:40 user nova-compute[72418]: DEBUG nova.policy [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b3a35ad1146840949d0f1cc4780efa2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ada6c609434916beb7b6a1d117a993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72418) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 18:22:40 user nova-compute[72418]: INFO nova.virt.block_device [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Booting with volume 63025fe7-5619-4f33-85cb-044aca432424 at /dev/vda
Aug 09 18:22:40 user nova-compute[72418]: DEBUG os_brick.utils [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:22:40 user nova-compute[72418]: INFO oslo.privsep.daemon [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp44o023oj/privsep.sock']
Aug 09 18:22:40 user sudo[83031]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp44o023oj/privsep.sock
Aug 09 18:22:40 user sudo[83031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 09 18:22:40 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:22:40 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Cleaning up deleted instances {{(pid=72418) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 18:22:40 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] There are 0 instances to clean {{(pid=72418) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 18:22:40 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:22:40 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72418) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 18:22:41 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:22:41 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:41 user nova-compute[72418]: DEBUG nova.network.neutron [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Successfully created port: 2472f1be-ea8f-46b6-a4f3-481f517c7edd {{(pid=72418) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 18:22:41 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:42 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:22:42 user nova-compute[72418]: DEBUG nova.network.neutron [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Successfully updated port: 2472f1be-ea8f-46b6-a4f3-481f517c7edd {{(pid=72418) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 18:22:42 user nova-compute[72418]: DEBUG nova.compute.manager [req-957d9c80-5c39-4958-82a3-803f27c2c1ee req-a649b747-4cc4-4335-a8a0-d3f56118fed3 service nova] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Received event network-changed-2472f1be-ea8f-46b6-a4f3-481f517c7edd {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:22:42 user nova-compute[72418]: DEBUG nova.compute.manager [req-957d9c80-5c39-4958-82a3-803f27c2c1ee req-a649b747-4cc4-4335-a8a0-d3f56118fed3 service nova] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Refreshing instance network info cache due to event network-changed-2472f1be-ea8f-46b6-a4f3-481f517c7edd. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:22:42 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-957d9c80-5c39-4958-82a3-803f27c2c1ee req-a649b747-4cc4-4335-a8a0-d3f56118fed3 service nova] Acquiring lock "refresh_cache-d9d5d476-484e-49a3-a665-5a2069ea606e" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:22:42 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-957d9c80-5c39-4958-82a3-803f27c2c1ee req-a649b747-4cc4-4335-a8a0-d3f56118fed3 service nova] Acquired lock "refresh_cache-d9d5d476-484e-49a3-a665-5a2069ea606e" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:22:42 user nova-compute[72418]: DEBUG nova.network.neutron [req-957d9c80-5c39-4958-82a3-803f27c2c1ee req-a649b747-4cc4-4335-a8a0-d3f56118fed3 service nova] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Refreshing network info cache for port 2472f1be-ea8f-46b6-a4f3-481f517c7edd {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:22:42 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:22:42 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Acquiring lock "refresh_cache-d9d5d476-484e-49a3-a665-5a2069ea606e" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:22:43 user nova-compute[72418]: DEBUG nova.network.neutron [req-957d9c80-5c39-4958-82a3-803f27c2c1ee req-a649b747-4cc4-4335-a8a0-d3f56118fed3 service nova] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Instance cache missing network info. {{(pid=72418) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 18:22:43 user sudo[83031]: pam_unix(sudo:session): session closed for user root
Aug 09 18:22:43 user nova-compute[72418]: INFO oslo.privsep.daemon [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Spawned new privsep daemon via rootwrap
Aug 09 18:22:43 user nova-compute[72418]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 09 18:22:43 user nova-compute[72418]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 09 18:22:43 user nova-compute[72418]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 09 18:22:43 user nova-compute[72418]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83046
Aug 09 18:22:43 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23ed09c-5d2d-4170-a721-f3484fc99d54]: (2,) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:22:43 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:22:43 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:22:43 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7a2553-1f36-4386-b635-ebf92e15b3ce]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ad56b243ad71\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:22:43 user nova-compute[72418]: WARNING os_brick.initiator.connectors.nvmeof [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 09 18:22:43 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:22:43 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:22:43 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb54f5a-dedd-442f-b047-54568dcbc065]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:22:43 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:22:43 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:22:43 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e08eb00-0954-4c36-93fd-67c6ba27d1e9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:22:43 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9c8640-dadd-47ac-87c6-82f473e1ca0d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:22:43 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Running cmd (subprocess): nvme version {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:22:43 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] 'nvme version' failed. Not Retrying. {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:22:43 user nova-compute[72418]: DEBUG nova.network.neutron [req-957d9c80-5c39-4958-82a3-803f27c2c1ee req-a649b747-4cc4-4335-a8a0-d3f56118fed3 service nova] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:22:43 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.nvmeof [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] nvme not present on system {{(pid=72418) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 18:22:43 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:22:43 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:22:43 user nova-compute[72418]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 18:22:43 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[904de3d5-2e07-41b1-8ef7-245ef34d6daf]: (4, '') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:22:43 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72418) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 18:22:43 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 18:22:43 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] LIGHTOS: no hostnqn found. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 18:22:43 user nova-compute[72418]: DEBUG os_brick.utils [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] <== get_connector_properties: return (3183ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ad56b243ad71', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:22:43 user nova-compute[72418]: DEBUG nova.virt.block_device [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Updating existing volume attachment record: 3d30c212-d8d7-425d-9229-265ca5b22058 {{(pid=72418) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 18:22:43 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-957d9c80-5c39-4958-82a3-803f27c2c1ee req-a649b747-4cc4-4335-a8a0-d3f56118fed3 service nova] Releasing lock "refresh_cache-d9d5d476-484e-49a3-a665-5a2069ea606e" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:22:43 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Acquired lock "refresh_cache-d9d5d476-484e-49a3-a665-5a2069ea606e" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:22:43 user nova-compute[72418]: DEBUG nova.network.neutron [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:22:43 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:22:43 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:22:43 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72418) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 18:22:43 user nova-compute[72418]: DEBUG nova.network.neutron [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Instance cache missing network info. {{(pid=72418) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 18:22:44 user nova-compute[72418]: DEBUG nova.network.neutron [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Updating instance_info_cache with network_info: [{"id": "2472f1be-ea8f-46b6-a4f3-481f517c7edd", "address": "fa:16:3e:86:93:dc", "network": {"id": "eddf3956-c192-42b3-b928-5e9cf4f07f5f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1344000484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64ada6c609434916beb7b6a1d117a993", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2472f1be-ea", "ovs_interfaceid": "2472f1be-ea8f-46b6-a4f3-481f517c7edd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:22:44 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Releasing lock "refresh_cache-d9d5d476-484e-49a3-a665-5a2069ea606e" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:22:44 user nova-compute[72418]: DEBUG nova.compute.manager [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Instance network_info: |[{"id": "2472f1be-ea8f-46b6-a4f3-481f517c7edd", "address": "fa:16:3e:86:93:dc", "network": {"id": "eddf3956-c192-42b3-b928-5e9cf4f07f5f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1344000484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64ada6c609434916beb7b6a1d117a993", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2472f1be-ea", "ovs_interfaceid": "2472f1be-ea8f-46b6-a4f3-481f517c7edd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 18:22:44 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:22:44 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:22:45 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:22:46 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:46 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:22:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:22:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:22:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:22:46 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Auditing locally available compute resources for user (node: user) {{(pid=72418) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 18:22:46 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:47 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/479ea4c3-ad7f-4da0-a901-defe46d96065/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:22:47 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/479ea4c3-ad7f-4da0-a901-defe46d96065/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:22:47 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/479ea4c3-ad7f-4da0-a901-defe46d96065/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:22:47 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/479ea4c3-ad7f-4da0-a901-defe46d96065/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:22:47 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dabfdb24-fc0b-4a00-a229-1ece48e27d18/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:22:47 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dabfdb24-fc0b-4a00-a229-1ece48e27d18/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:22:47 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dabfdb24-fc0b-4a00-a229-1ece48e27d18/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:22:47 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dabfdb24-fc0b-4a00-a229-1ece48e27d18/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:22:47 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:22:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:22:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:22:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:22:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:22:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:22:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:22:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:22:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:22:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:22:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:22:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:22:49 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:22:49 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:22:49 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:22:49 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:22:49 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:22:49 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:22:49 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:22:49 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:22:49 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6084e681-01c4-4a6c-beb3-dcda4a990a51/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:22:49 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6084e681-01c4-4a6c-beb3-dcda4a990a51/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:22:49 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6084e681-01c4-4a6c-beb3-dcda4a990a51/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:22:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6084e681-01c4-4a6c-beb3-dcda4a990a51/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:22:50 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:22:50 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:22:50 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Hypervisor/Node resource view: name=user free_ram=7291MB free_disk=25.95836639404297GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72418) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 18:22:50 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:22:50 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:22:50 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 6af7918a-ce90-45ab-93d8-684e1489e891 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:22:50 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 8fe41968-a219-4a5a-afdb-32eb2082bb40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:22:50 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:22:50 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 01c46b33-6788-44a5-a43c-88ee4acc4d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:22:50 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 479ea4c3-ad7f-4da0-a901-defe46d96065 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:22:50 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 6084e681-01c4-4a6c-beb3-dcda4a990a51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:22:50 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:22:50 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance dabfdb24-fc0b-4a00-a229-1ece48e27d18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:22:50 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance d9d5d476-484e-49a3-a665-5a2069ea606e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:22:50 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 18:22:50 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 18:22:50 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Refreshing inventories for resource provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 18:22:51 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Updating ProviderTree inventory for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 18:22:51 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Updating inventory in ProviderTree for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 18:22:51 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Refreshing aggregate associations for resource provider 50628e48-0a01-4c3f-9ff5-2a66453cd194, aggregates: None {{(pid=72418) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 18:22:51 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Refreshing trait associations for resource provider 50628e48-0a01-4c3f-9ff5-2a66453cd194, traits: HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=72418) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 18:22:51 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:22:51 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:22:51 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:51 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Compute_service record updated for user:user {{(pid=72418) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 18:22:51 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.956s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:22:52 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:52 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:22:52 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Starting heal instance info cache {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 18:22:52 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Rebuilding the list of instances to heal {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 18:22:52 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Skipping network cache update for instance because it is Building. {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 09 18:22:52 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "refresh_cache-6af7918a-ce90-45ab-93d8-684e1489e891" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:22:52 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquired lock "refresh_cache-6af7918a-ce90-45ab-93d8-684e1489e891" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:22:52 user nova-compute[72418]: DEBUG nova.network.neutron [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Forcefully refreshing network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 18:22:52 user nova-compute[72418]: DEBUG nova.objects.instance [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lazy-loading 'info_cache' on Instance uuid 6af7918a-ce90-45ab-93d8-684e1489e891 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:22:53 user nova-compute[72418]: DEBUG nova.network.neutron [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Updating instance_info_cache with network_info: [{"id": "2b44ecc4-13c5-43ba-8425-5f42d86bc716", "address": "fa:16:3e:8d:41:82", "network": {"id": "15a49d9b-3c0d-449b-9473-29f219960e2c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c68622cd79472ba6ad14a6876aeaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b44ecc4-13", "ovs_interfaceid": "2b44ecc4-13c5-43ba-8425-5f42d86bc716", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:22:53 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Releasing lock "refresh_cache-6af7918a-ce90-45ab-93d8-684e1489e891" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:22:53 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Updated the network info_cache for instance {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG nova.compute.manager [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Start spawning the instance on the hypervisor. {{(pid=72418) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Creating instance directory {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 18:22:54 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Creating image(s)
Aug 09 18:22:54 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Did not create local disks {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Ensure instance console log exists: /opt/stack/data/nova/instances/d9d5d476-484e-49a3-a665-5a2069ea606e/console.log {{(pid=72418) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Start _get_guest_xml network_info=[{"id": "2472f1be-ea8f-46b6-a4f3-481f517c7edd", "address": "fa:16:3e:86:93:dc", "network": {"id": "eddf3956-c192-42b3-b928-5e9cf4f07f5f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1344000484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64ada6c609434916beb7b6a1d117a993", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2472f1be-ea", "ovs_interfaceid": "2472f1be-ea8f-46b6-a4f3-481f517c7edd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '3d30c212-d8d7-425d-9229-265ca5b22058', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TUdEGbkO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd9d5d476-484e-49a3-a665-5a2069ea606e', 'attached_at': '', 'detached_at': '', 'volume_id': '63025fe7-5619-4f33-85cb-044aca432424', 'serial': '63025fe7-5619-4f33-85cb-044aca432424'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 18:22:54 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:22:54 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:22:54 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] CPU controller missing on host. {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] CPU controller found on host. {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72418) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T18:17:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Flavor limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Image limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Flavor pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Image pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Got 1 possible topologies {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG os_brick.initiator.connector [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Factory for ISCSI on None {{(pid=72418) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Calling os-brick to attach iSCSI Volume {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TUdEGbkO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:22:54 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:22:54 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:22:54 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:22:54 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:22:54 user nova-compute[72418]: INFO os_brick.initiator.connectors.iscsi [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 18:22:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 -p 172.16.0.220:3260 {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc70d43-9b49-411f-9594-186525be70b6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 18:22:54 user nova-compute[72418]:  {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 -p 172.16.0.220:3260 --interface default --op new {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce380c08-680a-4462-9310-da2b0826ed48]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424] added\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424] added
Aug 09 18:22:54 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4397e1-3117-4e38-80c5-f54441fe1bb5]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d07993-54bc-4940-a49b-bf24f5ecfe09]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TUdEGbkO {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TUdEGbkO" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[06cf72fc-7b81-42a7-b5b5-896a57c03c94]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TUdEGbkO'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f265ca1-8e52-4bff-9862-45584e49eca2]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7186ad-2827-4682-9c6c-85adc4caf182]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 18:22:54 user nova-compute[72418]:  {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 18:22:54 user nova-compute[72418]:  {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:22:54 user nova-compute[72418]: WARNING os_brick.initiator.connectors.iscsi [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 18:22:54 user nova-compute[72418]: 
Aug 09 18:22:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 -p 172.16.0.220:3260 --login {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58df908-6840-4a4c-b0e3-3413a2bed4b9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424, portal: 172.16.0.220,3260]
Aug 09 18:22:54 user nova-compute[72418]: Login to [iface: default, target: iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424, portal: 172.16.0.220,3260] successful.
Aug 09 18:22:54 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1469296-9bf9-468d-a6d9-00dd637755ff]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[089f3ddb-04e1-4d45-97cf-3e00bc0edd88]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:22:54 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:22:54 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Connected to 172.16.0.220:3260 {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=72418) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72418) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 18:22:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:22:55 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:22:55 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eabff4e-780b-4a54-9bfa-ead0b64b214a]: (4, ('- - 0', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:22:55 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72418) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 18:22:55 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TUdEGbkO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 18:22:56 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:22:56 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '26438643834633063', 'path': '/dev/sdb'} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:22:56 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438643834633063', 'path': '/dev/sdb'} {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 18:22:56 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:22:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-575459132',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-575459132',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTlpxVeNhPxeJuW8zTxzwBKwT/CA/qFwbFSyGFFQ5WBC/z6rTuUG5Drvoef5DHSqpEg+qFNytmw3WteLGcKSZH4mMFqTcywv5Hy3vANpNfa+6Xl/MY5tiOWNwwb6BRwFw==',key_name='tempest-keypair-546529688',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='64ada6c609434916beb7b6a1d117a993',ramdisk_id='',reservation_id='r-fnsl4oak',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1647763299',owner_user_name='tempest-ServerActionsV293TestJSON-1647763299-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:22:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3a35ad1146840949d0f1cc4780efa2b',uuid=d9d5d476-484e-49a3-a665-5a2069ea606e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2472f1be-ea8f-46b6-a4f3-481f517c7edd", "address": "fa:16:3e:86:93:dc", "network": {"id": "eddf3956-c192-42b3-b928-5e9cf4f07f5f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1344000484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64ada6c609434916beb7b6a1d117a993", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2472f1be-ea", "ovs_interfaceid": "2472f1be-ea8f-46b6-a4f3-481f517c7edd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:22:56 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Converting VIF {"id": "2472f1be-ea8f-46b6-a4f3-481f517c7edd", "address": "fa:16:3e:86:93:dc", "network": {"id": "eddf3956-c192-42b3-b928-5e9cf4f07f5f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1344000484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64ada6c609434916beb7b6a1d117a993", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2472f1be-ea", "ovs_interfaceid": "2472f1be-ea8f-46b6-a4f3-481f517c7edd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:22:56 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:93:dc,bridge_name='br-int',has_traffic_filtering=True,id=2472f1be-ea8f-46b6-a4f3-481f517c7edd,network=Network(eddf3956-c192-42b3-b928-5e9cf4f07f5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2472f1be-ea') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:22:56 user nova-compute[72418]: DEBUG nova.objects.instance [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Lazy-loading 'pci_devices' on Instance uuid d9d5d476-484e-49a3-a665-5a2069ea606e {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:22:56 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] End _get_guest_xml xml=<domain type="kvm">
Aug 09 18:22:56 user nova-compute[72418]:   <uuid>d9d5d476-484e-49a3-a665-5a2069ea606e</uuid>
Aug 09 18:22:56 user nova-compute[72418]:   <name>instance-00000009</name>
Aug 09 18:22:56 user nova-compute[72418]:   <memory>524288</memory>
Aug 09 18:22:56 user nova-compute[72418]:   <vcpu>1</vcpu>
Aug 09 18:22:56 user nova-compute[72418]:   <metadata>
Aug 09 18:22:56 user nova-compute[72418]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:22:56 user nova-compute[72418]:       <nova:package version="0.0.0"/>
Aug 09 18:22:56 user nova-compute[72418]:       <nova:name>tempest-ServerActionsV293TestJSON-server-575459132</nova:name>
Aug 09 18:22:56 user nova-compute[72418]:       <nova:creationTime>2023-08-09 18:22:54</nova:creationTime>
Aug 09 18:22:56 user nova-compute[72418]:       <nova:flavor name="m1.tiny">
Aug 09 18:22:56 user nova-compute[72418]:         <nova:memory>512</nova:memory>
Aug 09 18:22:56 user nova-compute[72418]:         <nova:disk>1</nova:disk>
Aug 09 18:22:56 user nova-compute[72418]:         <nova:swap>0</nova:swap>
Aug 09 18:22:56 user nova-compute[72418]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:22:56 user nova-compute[72418]:         <nova:vcpus>1</nova:vcpus>
Aug 09 18:22:56 user nova-compute[72418]:       </nova:flavor>
Aug 09 18:22:56 user nova-compute[72418]:       <nova:owner>
Aug 09 18:22:56 user nova-compute[72418]:         <nova:user uuid="b3a35ad1146840949d0f1cc4780efa2b">tempest-ServerActionsV293TestJSON-1647763299-project-member</nova:user>
Aug 09 18:22:56 user nova-compute[72418]:         <nova:project uuid="64ada6c609434916beb7b6a1d117a993">tempest-ServerActionsV293TestJSON-1647763299</nova:project>
Aug 09 18:22:56 user nova-compute[72418]:       </nova:owner>
Aug 09 18:22:56 user nova-compute[72418]:       <nova:ports>
Aug 09 18:22:56 user nova-compute[72418]:         <nova:port uuid="2472f1be-ea8f-46b6-a4f3-481f517c7edd">
Aug 09 18:22:56 user nova-compute[72418]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 18:22:56 user nova-compute[72418]:         </nova:port>
Aug 09 18:22:56 user nova-compute[72418]:       </nova:ports>
Aug 09 18:22:56 user nova-compute[72418]:     </nova:instance>
Aug 09 18:22:56 user nova-compute[72418]:   </metadata>
Aug 09 18:22:56 user nova-compute[72418]:   <sysinfo type="smbios">
Aug 09 18:22:56 user nova-compute[72418]:     <system>
Aug 09 18:22:56 user nova-compute[72418]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 18:22:56 user nova-compute[72418]:       <entry name="product">OpenStack Nova</entry>
Aug 09 18:22:56 user nova-compute[72418]:       <entry name="version">0.0.0</entry>
Aug 09 18:22:56 user nova-compute[72418]:       <entry name="serial">d9d5d476-484e-49a3-a665-5a2069ea606e</entry>
Aug 09 18:22:56 user nova-compute[72418]:       <entry name="uuid">d9d5d476-484e-49a3-a665-5a2069ea606e</entry>
Aug 09 18:22:56 user nova-compute[72418]:       <entry name="family">Virtual Machine</entry>
Aug 09 18:22:56 user nova-compute[72418]:     </system>
Aug 09 18:22:56 user nova-compute[72418]:   </sysinfo>
Aug 09 18:22:56 user nova-compute[72418]:   <os>
Aug 09 18:22:56 user nova-compute[72418]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 18:22:56 user nova-compute[72418]:     <boot dev="hd"/>
Aug 09 18:22:56 user nova-compute[72418]:     <smbios mode="sysinfo"/>
Aug 09 18:22:56 user nova-compute[72418]:   </os>
Aug 09 18:22:56 user nova-compute[72418]:   <features>
Aug 09 18:22:56 user nova-compute[72418]:     <acpi/>
Aug 09 18:22:56 user nova-compute[72418]:     <apic/>
Aug 09 18:22:56 user nova-compute[72418]:     <vmcoreinfo/>
Aug 09 18:22:56 user nova-compute[72418]:   </features>
Aug 09 18:22:56 user nova-compute[72418]:   <clock offset="utc">
Aug 09 18:22:56 user nova-compute[72418]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 18:22:56 user nova-compute[72418]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 18:22:56 user nova-compute[72418]:     <timer name="hpet" present="no"/>
Aug 09 18:22:56 user nova-compute[72418]:   </clock>
Aug 09 18:22:56 user nova-compute[72418]:   <cpu mode="custom" match="exact">
Aug 09 18:22:56 user nova-compute[72418]:     <model>Nehalem</model>
Aug 09 18:22:56 user nova-compute[72418]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 18:22:56 user nova-compute[72418]:   </cpu>
Aug 09 18:22:56 user nova-compute[72418]:   <devices>
Aug 09 18:22:56 user nova-compute[72418]:     <disk type="block" device="disk">
Aug 09 18:22:56 user nova-compute[72418]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:22:56 user nova-compute[72418]:       <source dev="/dev/sdb"/>
Aug 09 18:22:56 user nova-compute[72418]:       <target dev="vda" bus="virtio"/>
Aug 09 18:22:56 user nova-compute[72418]:       <serial>63025fe7-5619-4f33-85cb-044aca432424</serial>
Aug 09 18:22:56 user nova-compute[72418]:     </disk>
Aug 09 18:22:56 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:22:56 user nova-compute[72418]:       <mac address="fa:16:3e:86:93:dc"/>
Aug 09 18:22:56 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:22:56 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:22:56 user nova-compute[72418]:       <target dev="tap2472f1be-ea"/>
Aug 09 18:22:56 user nova-compute[72418]:     </interface>
Aug 09 18:22:56 user nova-compute[72418]:     <serial type="pty">
Aug 09 18:22:56 user nova-compute[72418]:       <log file="/opt/stack/data/nova/instances/d9d5d476-484e-49a3-a665-5a2069ea606e/console.log" append="off"/>
Aug 09 18:22:56 user nova-compute[72418]:     </serial>
Aug 09 18:22:56 user nova-compute[72418]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 18:22:56 user nova-compute[72418]:     <video>
Aug 09 18:22:56 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:22:56 user nova-compute[72418]:     </video>
Aug 09 18:22:56 user nova-compute[72418]:     <rng model="virtio">
Aug 09 18:22:56 user nova-compute[72418]:       <backend model="random">/dev/urandom</backend>
Aug 09 18:22:56 user nova-compute[72418]:     </rng>
Aug 09 18:22:56 user nova-compute[72418]:     <controller type="usb" index="0" model="none"/>
Aug 09 18:22:56 user nova-compute[72418]:     <memballoon model="virtio">
Aug 09 18:22:56 user nova-compute[72418]:       <stats period="10"/>
Aug 09 18:22:56 user nova-compute[72418]:     </memballoon>
Aug 09 18:22:56 user nova-compute[72418]:   </devices>
Aug 09 18:22:56 user nova-compute[72418]: </domain>
Aug 09 18:22:56 user nova-compute[72418]:  {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 18:22:56 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:22:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-575459132',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-575459132',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTlpxVeNhPxeJuW8zTxzwBKwT/CA/qFwbFSyGFFQ5WBC/z6rTuUG5Drvoef5DHSqpEg+qFNytmw3WteLGcKSZH4mMFqTcywv5Hy3vANpNfa+6Xl/MY5tiOWNwwb6BRwFw==',key_name='tempest-keypair-546529688',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='64ada6c609434916beb7b6a1d117a993',ramdisk_id='',reservation_id='r-fnsl4oak',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1647763299',owner_user_name='tempest-ServerActionsV293TestJSON-1647763299-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:22:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3a35ad1146840949d0f1cc4780efa2b',uuid=d9d5d476-484e-49a3-a665-5a2069ea606e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2472f1be-ea8f-46b6-a4f3-481f517c7edd", "address": "fa:16:3e:86:93:dc", "network": {"id": "eddf3956-c192-42b3-b928-5e9cf4f07f5f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1344000484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64ada6c609434916beb7b6a1d117a993", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2472f1be-ea", "ovs_interfaceid": "2472f1be-ea8f-46b6-a4f3-481f517c7edd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:22:56 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Converting VIF {"id": "2472f1be-ea8f-46b6-a4f3-481f517c7edd", "address": "fa:16:3e:86:93:dc", "network": {"id": "eddf3956-c192-42b3-b928-5e9cf4f07f5f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1344000484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64ada6c609434916beb7b6a1d117a993", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2472f1be-ea", "ovs_interfaceid": "2472f1be-ea8f-46b6-a4f3-481f517c7edd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:22:56 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:93:dc,bridge_name='br-int',has_traffic_filtering=True,id=2472f1be-ea8f-46b6-a4f3-481f517c7edd,network=Network(eddf3956-c192-42b3-b928-5e9cf4f07f5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2472f1be-ea') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:22:56 user nova-compute[72418]: DEBUG os_vif [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:93:dc,bridge_name='br-int',has_traffic_filtering=True,id=2472f1be-ea8f-46b6-a4f3-481f517c7edd,network=Network(eddf3956-c192-42b3-b928-5e9cf4f07f5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2472f1be-ea') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:22:56 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:56 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:22:56 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:22:56 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:56 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2472f1be-ea, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:22:56 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2472f1be-ea, col_values=(('external_ids', {'iface-id': '2472f1be-ea8f-46b6-a4f3-481f517c7edd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:93:dc', 'vm-uuid': 'd9d5d476-484e-49a3-a665-5a2069ea606e'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:22:56 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:56 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:22:56 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:56 user nova-compute[72418]: INFO os_vif [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:93:dc,bridge_name='br-int',has_traffic_filtering=True,id=2472f1be-ea8f-46b6-a4f3-481f517c7edd,network=Network(eddf3956-c192-42b3-b928-5e9cf4f07f5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2472f1be-ea')
Aug 09 18:22:56 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:22:56 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] No VIF found with MAC fa:16:3e:86:93:dc, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:22:57 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:57 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:57 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:57 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:57 user nova-compute[72418]: DEBUG nova.compute.manager [req-95897e76-be2f-48c1-a3b7-2be847799e3c req-b5346a6c-f35e-4d98-9071-9ed729a623cc service nova] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Received event network-vif-plugged-2472f1be-ea8f-46b6-a4f3-481f517c7edd {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:22:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-95897e76-be2f-48c1-a3b7-2be847799e3c req-b5346a6c-f35e-4d98-9071-9ed729a623cc service nova] Acquiring lock "d9d5d476-484e-49a3-a665-5a2069ea606e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:22:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-95897e76-be2f-48c1-a3b7-2be847799e3c req-b5346a6c-f35e-4d98-9071-9ed729a623cc service nova] Lock "d9d5d476-484e-49a3-a665-5a2069ea606e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:22:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-95897e76-be2f-48c1-a3b7-2be847799e3c req-b5346a6c-f35e-4d98-9071-9ed729a623cc service nova] Lock "d9d5d476-484e-49a3-a665-5a2069ea606e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:22:57 user nova-compute[72418]: DEBUG nova.compute.manager [req-95897e76-be2f-48c1-a3b7-2be847799e3c req-b5346a6c-f35e-4d98-9071-9ed729a623cc service nova] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] No waiting events found dispatching network-vif-plugged-2472f1be-ea8f-46b6-a4f3-481f517c7edd {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:22:57 user nova-compute[72418]: WARNING nova.compute.manager [req-95897e76-be2f-48c1-a3b7-2be847799e3c req-b5346a6c-f35e-4d98-9071-9ed729a623cc service nova] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Received unexpected event network-vif-plugged-2472f1be-ea8f-46b6-a4f3-481f517c7edd for instance with vm_state building and task_state spawning.
Aug 09 18:22:58 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:58 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:58 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:58 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:22:59 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605379.9889426, d9d5d476-484e-49a3-a665-5a2069ea606e => Resumed> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:22:59 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] VM Resumed (Lifecycle Event)
Aug 09 18:23:00 user nova-compute[72418]: DEBUG nova.compute.manager [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Instance event wait completed in 0 seconds for  {{(pid=72418) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 18:23:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Guest created on hypervisor {{(pid=72418) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 18:23:00 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Instance spawned successfully.
Aug 09 18:23:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 18:23:00 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:23:00 user nova-compute[72418]: DEBUG nova.compute.manager [req-49eebe42-912e-4357-9935-af7882433942 req-a59d7996-4da0-46b6-9d59-2a1134579693 service nova] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Received event network-vif-plugged-2472f1be-ea8f-46b6-a4f3-481f517c7edd {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:23:00 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-49eebe42-912e-4357-9935-af7882433942 req-a59d7996-4da0-46b6-9d59-2a1134579693 service nova] Acquiring lock "d9d5d476-484e-49a3-a665-5a2069ea606e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:23:00 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-49eebe42-912e-4357-9935-af7882433942 req-a59d7996-4da0-46b6-9d59-2a1134579693 service nova] Lock "d9d5d476-484e-49a3-a665-5a2069ea606e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:23:00 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-49eebe42-912e-4357-9935-af7882433942 req-a59d7996-4da0-46b6-9d59-2a1134579693 service nova] Lock "d9d5d476-484e-49a3-a665-5a2069ea606e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:23:00 user nova-compute[72418]: DEBUG nova.compute.manager [req-49eebe42-912e-4357-9935-af7882433942 req-a59d7996-4da0-46b6-9d59-2a1134579693 service nova] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] No waiting events found dispatching network-vif-plugged-2472f1be-ea8f-46b6-a4f3-481f517c7edd {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:23:00 user nova-compute[72418]: WARNING nova.compute.manager [req-49eebe42-912e-4357-9935-af7882433942 req-a59d7996-4da0-46b6-9d59-2a1134579693 service nova] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Received unexpected event network-vif-plugged-2472f1be-ea8f-46b6-a4f3-481f517c7edd for instance with vm_state building and task_state spawning.
Aug 09 18:23:00 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:23:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Found default for hw_cdrom_bus of ide {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:23:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Found default for hw_disk_bus of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:23:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Found default for hw_input_bus of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:23:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Found default for hw_pointer_model of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:23:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Found default for hw_video_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:23:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Found default for hw_vif_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:23:00 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:23:00 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605379.9935036, d9d5d476-484e-49a3-a665-5a2069ea606e => Started> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:23:00 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] VM Started (Lifecycle Event)
Aug 09 18:23:00 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:23:00 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:23:00 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:23:00 user nova-compute[72418]: INFO nova.compute.manager [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Took 5.57 seconds to spawn the instance on the hypervisor.
Aug 09 18:23:00 user nova-compute[72418]: DEBUG nova.compute.manager [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:23:00 user nova-compute[72418]: INFO nova.compute.manager [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Took 20.66 seconds to build instance.
Aug 09 18:23:00 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-afc31c7a-9d69-4f4f-8dd3-256a2edac56d tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Lock "d9d5d476-484e-49a3-a665-5a2069ea606e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.787s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:23:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:02 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:06 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Acquiring lock "2b284735-40f6-403f-8c72-a70a4da1ef95" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:23:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:23:06 user nova-compute[72418]: DEBUG nova.compute.manager [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Starting instance... {{(pid=72418) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 18:23:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:23:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:23:06 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72418) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 18:23:06 user nova-compute[72418]: INFO nova.compute.claims [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Claim successful on node user
Aug 09 18:23:06 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:23:06 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:23:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.549s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:23:06 user nova-compute[72418]: DEBUG nova.compute.manager [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Start building networks asynchronously for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 18:23:06 user nova-compute[72418]: DEBUG nova.compute.manager [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Allocating IP information in the background. {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 18:23:06 user nova-compute[72418]: DEBUG nova.network.neutron [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] allocate_for_instance() {{(pid=72418) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 18:23:06 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 18:23:07 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:07 user nova-compute[72418]: DEBUG nova.compute.manager [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Start building block device mappings for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 18:23:07 user nova-compute[72418]: INFO nova.virt.block_device [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Booting with volume 9e1058f2-9030-499b-bb70-208cb531c561 at /dev/vda
Aug 09 18:23:07 user nova-compute[72418]: DEBUG os_brick.utils [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:23:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:07 user nova-compute[72418]: DEBUG nova.policy [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4ebed3edc7b9488bbfa6d11f8441773a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56236651c71b4e3f99128436cdf94710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72418) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 18:23:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:07 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[728612fc-cb72-4a74-8a0d-c55191080119]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ad56b243ad71\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.035s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:07 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[7035d6af-81a6-4d99-b7c4-589be6bf7275]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:07 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[9826f7cb-baf7-4944-b102-2a19f4a3b8bb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:07 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[3565a5c1-5542-4d87-8d97-18715cf2ff40]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Running cmd (subprocess): nvme version {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] 'nvme version' failed. Not Retrying. {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:23:07 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] nvme not present on system {{(pid=72418) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 18:23:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:23:07 user nova-compute[72418]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 18:23:07 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[23172b2f-b7d4-41c9-9be3-bd31965e779a]: (4, '') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:07 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72418) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 18:23:07 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 18:23:07 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] LIGHTOS: no hostnqn found. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 18:23:07 user nova-compute[72418]: DEBUG os_brick.utils [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] <== get_connector_properties: return (182ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ad56b243ad71', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:23:07 user nova-compute[72418]: DEBUG nova.virt.block_device [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Updating existing volume attachment record: 8c9dd1ae-ceeb-4db0-8557-e2cdadc32405 {{(pid=72418) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 18:23:08 user nova-compute[72418]: DEBUG nova.network.neutron [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Successfully created port: f148ea7a-87e0-482f-bd2f-d3fcaa50fd4f {{(pid=72418) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 18:23:08 user nova-compute[72418]: DEBUG nova.network.neutron [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Successfully created port: cb99cdec-40f2-4666-bc12-0c825431db5f {{(pid=72418) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 18:23:09 user nova-compute[72418]: DEBUG nova.network.neutron [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Successfully created port: af01e732-21ed-4815-842e-90e7b3591398 {{(pid=72418) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 18:23:10 user nova-compute[72418]: DEBUG nova.network.neutron [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Successfully created port: 692db581-bf1f-4295-a18d-65ab40120c7a {{(pid=72418) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 18:23:10 user nova-compute[72418]: DEBUG nova.network.neutron [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Successfully created port: 875b1fd5-6595-48dc-83b1-95ebeee70bb2 {{(pid=72418) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 18:23:11 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:12 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:12 user nova-compute[72418]: DEBUG nova.network.neutron [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Successfully updated port: f148ea7a-87e0-482f-bd2f-d3fcaa50fd4f {{(pid=72418) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 18:23:12 user nova-compute[72418]: DEBUG nova.compute.manager [req-a992d845-81db-4f50-9d8e-6889443948be req-a516866a-3e8b-4f04-9254-0ba3d16d50ee service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received event network-changed-f148ea7a-87e0-482f-bd2f-d3fcaa50fd4f {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:23:12 user nova-compute[72418]: DEBUG nova.compute.manager [req-a992d845-81db-4f50-9d8e-6889443948be req-a516866a-3e8b-4f04-9254-0ba3d16d50ee service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Refreshing instance network info cache due to event network-changed-f148ea7a-87e0-482f-bd2f-d3fcaa50fd4f. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:23:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a992d845-81db-4f50-9d8e-6889443948be req-a516866a-3e8b-4f04-9254-0ba3d16d50ee service nova] Acquiring lock "refresh_cache-2b284735-40f6-403f-8c72-a70a4da1ef95" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:23:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a992d845-81db-4f50-9d8e-6889443948be req-a516866a-3e8b-4f04-9254-0ba3d16d50ee service nova] Acquired lock "refresh_cache-2b284735-40f6-403f-8c72-a70a4da1ef95" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:23:12 user nova-compute[72418]: DEBUG nova.network.neutron [req-a992d845-81db-4f50-9d8e-6889443948be req-a516866a-3e8b-4f04-9254-0ba3d16d50ee service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Refreshing network info cache for port f148ea7a-87e0-482f-bd2f-d3fcaa50fd4f {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:23:12 user nova-compute[72418]: DEBUG nova.network.neutron [req-a992d845-81db-4f50-9d8e-6889443948be req-a516866a-3e8b-4f04-9254-0ba3d16d50ee service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Instance cache missing network info. {{(pid=72418) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 18:23:13 user nova-compute[72418]: DEBUG nova.network.neutron [req-a992d845-81db-4f50-9d8e-6889443948be req-a516866a-3e8b-4f04-9254-0ba3d16d50ee service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:23:13 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a992d845-81db-4f50-9d8e-6889443948be req-a516866a-3e8b-4f04-9254-0ba3d16d50ee service nova] Releasing lock "refresh_cache-2b284735-40f6-403f-8c72-a70a4da1ef95" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:23:13 user nova-compute[72418]: DEBUG nova.network.neutron [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Successfully updated port: 92f457ac-3ac1-426a-ac45-854d9e2ca180 {{(pid=72418) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 18:23:14 user nova-compute[72418]: DEBUG nova.network.neutron [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Successfully updated port: a0900115-d746-4910-aafd-a6da02efe287 {{(pid=72418) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 18:23:14 user nova-compute[72418]: DEBUG nova.compute.manager [req-a4d4c38c-a037-419c-8e39-072b7e47d286 req-70b540f0-687a-4127-a459-97906f2be5a8 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received event network-changed-92f457ac-3ac1-426a-ac45-854d9e2ca180 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:23:14 user nova-compute[72418]: DEBUG nova.compute.manager [req-a4d4c38c-a037-419c-8e39-072b7e47d286 req-70b540f0-687a-4127-a459-97906f2be5a8 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Refreshing instance network info cache due to event network-changed-92f457ac-3ac1-426a-ac45-854d9e2ca180. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:23:14 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a4d4c38c-a037-419c-8e39-072b7e47d286 req-70b540f0-687a-4127-a459-97906f2be5a8 service nova] Acquiring lock "refresh_cache-2b284735-40f6-403f-8c72-a70a4da1ef95" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:23:14 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a4d4c38c-a037-419c-8e39-072b7e47d286 req-70b540f0-687a-4127-a459-97906f2be5a8 service nova] Acquired lock "refresh_cache-2b284735-40f6-403f-8c72-a70a4da1ef95" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:23:14 user nova-compute[72418]: DEBUG nova.network.neutron [req-a4d4c38c-a037-419c-8e39-072b7e47d286 req-70b540f0-687a-4127-a459-97906f2be5a8 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Refreshing network info cache for port 92f457ac-3ac1-426a-ac45-854d9e2ca180 {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:23:14 user nova-compute[72418]: DEBUG nova.network.neutron [req-a4d4c38c-a037-419c-8e39-072b7e47d286 req-70b540f0-687a-4127-a459-97906f2be5a8 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Instance cache missing network info. {{(pid=72418) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 18:23:14 user nova-compute[72418]: DEBUG nova.network.neutron [req-a4d4c38c-a037-419c-8e39-072b7e47d286 req-70b540f0-687a-4127-a459-97906f2be5a8 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:23:14 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a4d4c38c-a037-419c-8e39-072b7e47d286 req-70b540f0-687a-4127-a459-97906f2be5a8 service nova] Releasing lock "refresh_cache-2b284735-40f6-403f-8c72-a70a4da1ef95" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:23:14 user nova-compute[72418]: DEBUG nova.compute.manager [req-a4d4c38c-a037-419c-8e39-072b7e47d286 req-70b540f0-687a-4127-a459-97906f2be5a8 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received event network-changed-a0900115-d746-4910-aafd-a6da02efe287 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:23:14 user nova-compute[72418]: DEBUG nova.compute.manager [req-a4d4c38c-a037-419c-8e39-072b7e47d286 req-70b540f0-687a-4127-a459-97906f2be5a8 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Refreshing instance network info cache due to event network-changed-a0900115-d746-4910-aafd-a6da02efe287. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:23:14 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a4d4c38c-a037-419c-8e39-072b7e47d286 req-70b540f0-687a-4127-a459-97906f2be5a8 service nova] Acquiring lock "refresh_cache-2b284735-40f6-403f-8c72-a70a4da1ef95" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:23:14 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a4d4c38c-a037-419c-8e39-072b7e47d286 req-70b540f0-687a-4127-a459-97906f2be5a8 service nova] Acquired lock "refresh_cache-2b284735-40f6-403f-8c72-a70a4da1ef95" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:23:14 user nova-compute[72418]: DEBUG nova.network.neutron [req-a4d4c38c-a037-419c-8e39-072b7e47d286 req-70b540f0-687a-4127-a459-97906f2be5a8 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Refreshing network info cache for port a0900115-d746-4910-aafd-a6da02efe287 {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:23:14 user nova-compute[72418]: DEBUG nova.network.neutron [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Successfully updated port: cb99cdec-40f2-4666-bc12-0c825431db5f {{(pid=72418) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 18:23:15 user nova-compute[72418]: DEBUG nova.network.neutron [req-a4d4c38c-a037-419c-8e39-072b7e47d286 req-70b540f0-687a-4127-a459-97906f2be5a8 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Instance cache missing network info. {{(pid=72418) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 18:23:15 user nova-compute[72418]: DEBUG nova.network.neutron [req-a4d4c38c-a037-419c-8e39-072b7e47d286 req-70b540f0-687a-4127-a459-97906f2be5a8 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:23:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a4d4c38c-a037-419c-8e39-072b7e47d286 req-70b540f0-687a-4127-a459-97906f2be5a8 service nova] Releasing lock "refresh_cache-2b284735-40f6-403f-8c72-a70a4da1ef95" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:23:15 user nova-compute[72418]: DEBUG nova.network.neutron [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Successfully updated port: af01e732-21ed-4815-842e-90e7b3591398 {{(pid=72418) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 18:23:16 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:16 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:16 user nova-compute[72418]: DEBUG nova.network.neutron [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Successfully updated port: 692db581-bf1f-4295-a18d-65ab40120c7a {{(pid=72418) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 18:23:16 user nova-compute[72418]: DEBUG nova.compute.manager [req-96ab0540-59ef-4fb8-a3ab-30095c97b5f8 req-4036fbfc-8876-48c1-b0a9-b1f2e7d74fc0 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received event network-changed-cb99cdec-40f2-4666-bc12-0c825431db5f {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:23:16 user nova-compute[72418]: DEBUG nova.compute.manager [req-96ab0540-59ef-4fb8-a3ab-30095c97b5f8 req-4036fbfc-8876-48c1-b0a9-b1f2e7d74fc0 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Refreshing instance network info cache due to event network-changed-cb99cdec-40f2-4666-bc12-0c825431db5f. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:23:16 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-96ab0540-59ef-4fb8-a3ab-30095c97b5f8 req-4036fbfc-8876-48c1-b0a9-b1f2e7d74fc0 service nova] Acquiring lock "refresh_cache-2b284735-40f6-403f-8c72-a70a4da1ef95" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:23:16 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-96ab0540-59ef-4fb8-a3ab-30095c97b5f8 req-4036fbfc-8876-48c1-b0a9-b1f2e7d74fc0 service nova] Acquired lock "refresh_cache-2b284735-40f6-403f-8c72-a70a4da1ef95" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:23:16 user nova-compute[72418]: DEBUG nova.network.neutron [req-96ab0540-59ef-4fb8-a3ab-30095c97b5f8 req-4036fbfc-8876-48c1-b0a9-b1f2e7d74fc0 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Refreshing network info cache for port cb99cdec-40f2-4666-bc12-0c825431db5f {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:23:16 user nova-compute[72418]: DEBUG nova.network.neutron [req-96ab0540-59ef-4fb8-a3ab-30095c97b5f8 req-4036fbfc-8876-48c1-b0a9-b1f2e7d74fc0 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Instance cache missing network info. {{(pid=72418) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 18:23:16 user nova-compute[72418]: INFO nova.virt.block_device [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Booting with volume 112f7914-2b2f-49cc-9390-76303f64928a at /dev/vdb
Aug 09 18:23:16 user nova-compute[72418]: DEBUG os_brick.utils [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:23:16 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:16 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:16 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0fd5da-15d1-4383-bbb4-6039251b4701]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ad56b243ad71\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:16 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:16 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:16 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b373a5-d957-405e-8a15-672687b8d1db]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:16 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:16 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:16 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22c7e6c-9d80-4cc4-a4b8-c4ffafcbb18c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:16 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ecf9d73-e88e-4d90-80fa-8e9bfe6e6140]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:16 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Running cmd (subprocess): nvme version {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:17 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] 'nvme version' failed. Not Retrying. {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:23:17 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:17 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] nvme not present on system {{(pid=72418) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 18:23:17 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:17 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:23:17 user nova-compute[72418]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 18:23:17 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[f753d1b5-0742-4b51-afb5-fc208c459dfa]: (4, '') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:17 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72418) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 18:23:17 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 18:23:17 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] LIGHTOS: no hostnqn found. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 18:23:17 user nova-compute[72418]: DEBUG os_brick.utils [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ad56b243ad71', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:23:17 user nova-compute[72418]: DEBUG nova.virt.block_device [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Updating existing volume attachment record: c3bd6a6a-9fd3-4ec4-943d-58f69df58df9 {{(pid=72418) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 18:23:17 user nova-compute[72418]: DEBUG nova.network.neutron [req-96ab0540-59ef-4fb8-a3ab-30095c97b5f8 req-4036fbfc-8876-48c1-b0a9-b1f2e7d74fc0 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:23:17 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-96ab0540-59ef-4fb8-a3ab-30095c97b5f8 req-4036fbfc-8876-48c1-b0a9-b1f2e7d74fc0 service nova] Releasing lock "refresh_cache-2b284735-40f6-403f-8c72-a70a4da1ef95" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:23:17 user nova-compute[72418]: DEBUG nova.compute.manager [req-96ab0540-59ef-4fb8-a3ab-30095c97b5f8 req-4036fbfc-8876-48c1-b0a9-b1f2e7d74fc0 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received event network-changed-af01e732-21ed-4815-842e-90e7b3591398 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:23:17 user nova-compute[72418]: DEBUG nova.compute.manager [req-96ab0540-59ef-4fb8-a3ab-30095c97b5f8 req-4036fbfc-8876-48c1-b0a9-b1f2e7d74fc0 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Refreshing instance network info cache due to event network-changed-af01e732-21ed-4815-842e-90e7b3591398. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:23:17 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-96ab0540-59ef-4fb8-a3ab-30095c97b5f8 req-4036fbfc-8876-48c1-b0a9-b1f2e7d74fc0 service nova] Acquiring lock "refresh_cache-2b284735-40f6-403f-8c72-a70a4da1ef95" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:23:17 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-96ab0540-59ef-4fb8-a3ab-30095c97b5f8 req-4036fbfc-8876-48c1-b0a9-b1f2e7d74fc0 service nova] Acquired lock "refresh_cache-2b284735-40f6-403f-8c72-a70a4da1ef95" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:23:17 user nova-compute[72418]: DEBUG nova.network.neutron [req-96ab0540-59ef-4fb8-a3ab-30095c97b5f8 req-4036fbfc-8876-48c1-b0a9-b1f2e7d74fc0 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Refreshing network info cache for port af01e732-21ed-4815-842e-90e7b3591398 {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:23:17 user nova-compute[72418]: DEBUG nova.network.neutron [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Successfully updated port: 875b1fd5-6595-48dc-83b1-95ebeee70bb2 {{(pid=72418) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 18:23:17 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Acquiring lock "refresh_cache-2b284735-40f6-403f-8c72-a70a4da1ef95" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:23:17 user nova-compute[72418]: DEBUG nova.network.neutron [req-96ab0540-59ef-4fb8-a3ab-30095c97b5f8 req-4036fbfc-8876-48c1-b0a9-b1f2e7d74fc0 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Instance cache missing network info. {{(pid=72418) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 18:23:17 user nova-compute[72418]: DEBUG nova.network.neutron [req-96ab0540-59ef-4fb8-a3ab-30095c97b5f8 req-4036fbfc-8876-48c1-b0a9-b1f2e7d74fc0 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:23:17 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-96ab0540-59ef-4fb8-a3ab-30095c97b5f8 req-4036fbfc-8876-48c1-b0a9-b1f2e7d74fc0 service nova] Releasing lock "refresh_cache-2b284735-40f6-403f-8c72-a70a4da1ef95" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:23:17 user nova-compute[72418]: DEBUG nova.compute.manager [req-96ab0540-59ef-4fb8-a3ab-30095c97b5f8 req-4036fbfc-8876-48c1-b0a9-b1f2e7d74fc0 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received event network-changed-692db581-bf1f-4295-a18d-65ab40120c7a {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:23:17 user nova-compute[72418]: DEBUG nova.compute.manager [req-96ab0540-59ef-4fb8-a3ab-30095c97b5f8 req-4036fbfc-8876-48c1-b0a9-b1f2e7d74fc0 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Refreshing instance network info cache due to event network-changed-692db581-bf1f-4295-a18d-65ab40120c7a. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:23:17 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-96ab0540-59ef-4fb8-a3ab-30095c97b5f8 req-4036fbfc-8876-48c1-b0a9-b1f2e7d74fc0 service nova] Acquiring lock "refresh_cache-2b284735-40f6-403f-8c72-a70a4da1ef95" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:23:17 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-96ab0540-59ef-4fb8-a3ab-30095c97b5f8 req-4036fbfc-8876-48c1-b0a9-b1f2e7d74fc0 service nova] Acquired lock "refresh_cache-2b284735-40f6-403f-8c72-a70a4da1ef95" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:23:17 user nova-compute[72418]: DEBUG nova.network.neutron [req-96ab0540-59ef-4fb8-a3ab-30095c97b5f8 req-4036fbfc-8876-48c1-b0a9-b1f2e7d74fc0 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Refreshing network info cache for port 692db581-bf1f-4295-a18d-65ab40120c7a {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:23:17 user nova-compute[72418]: DEBUG nova.network.neutron [req-96ab0540-59ef-4fb8-a3ab-30095c97b5f8 req-4036fbfc-8876-48c1-b0a9-b1f2e7d74fc0 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Instance cache missing network info. {{(pid=72418) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 18:23:18 user nova-compute[72418]: DEBUG nova.network.neutron [req-96ab0540-59ef-4fb8-a3ab-30095c97b5f8 req-4036fbfc-8876-48c1-b0a9-b1f2e7d74fc0 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:23:18 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-96ab0540-59ef-4fb8-a3ab-30095c97b5f8 req-4036fbfc-8876-48c1-b0a9-b1f2e7d74fc0 service nova] Releasing lock "refresh_cache-2b284735-40f6-403f-8c72-a70a4da1ef95" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:23:18 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Acquired lock "refresh_cache-2b284735-40f6-403f-8c72-a70a4da1ef95" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:23:18 user nova-compute[72418]: DEBUG nova.network.neutron [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:23:18 user nova-compute[72418]: DEBUG nova.network.neutron [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Instance cache missing network info. {{(pid=72418) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 18:23:18 user nova-compute[72418]: DEBUG nova.compute.manager [req-a783db1c-a654-4ca9-b50c-bc01826f40bc req-0d7d0bad-cb99-4926-99f2-3618b6e228bc service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received event network-changed-875b1fd5-6595-48dc-83b1-95ebeee70bb2 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:23:18 user nova-compute[72418]: DEBUG nova.compute.manager [req-a783db1c-a654-4ca9-b50c-bc01826f40bc req-0d7d0bad-cb99-4926-99f2-3618b6e228bc service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Refreshing instance network info cache due to event network-changed-875b1fd5-6595-48dc-83b1-95ebeee70bb2. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:23:18 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a783db1c-a654-4ca9-b50c-bc01826f40bc req-0d7d0bad-cb99-4926-99f2-3618b6e228bc service nova] Acquiring lock "refresh_cache-2b284735-40f6-403f-8c72-a70a4da1ef95" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:23:20 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:21 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:21 user nova-compute[72418]: DEBUG nova.network.neutron [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Updating instance_info_cache with network_info: [{"id": "f148ea7a-87e0-482f-bd2f-d3fcaa50fd4f", "address": "fa:16:3e:5c:b3:39", "network": {"id": "1b2af6fe-348e-4d75-9967-f6e70cb5e625", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1372910455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf148ea7a-87", "ovs_interfaceid": "f148ea7a-87e0-482f-bd2f-d3fcaa50fd4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "92f457ac-3ac1-426a-ac45-854d9e2ca180", "address": "fa:16:3e:1e:50:a4", "network": {"id": "a4e74890-7ab4-4e52-8297-5c27f2cb6497", "bridge": "br-int", "label": "tempest-device-tagging-net1-428079376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f457ac-3a", "ovs_interfaceid": "92f457ac-3ac1-426a-ac45-854d9e2ca180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a0900115-d746-4910-aafd-a6da02efe287", "address": "fa:16:3e:fa:8a:82", "network": {"id": "a4e74890-7ab4-4e52-8297-5c27f2cb6497", "bridge": "br-int", "label": "tempest-device-tagging-net1-428079376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0900115-d7", "ovs_interfaceid": "a0900115-d746-4910-aafd-a6da02efe287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cb99cdec-40f2-4666-bc12-0c825431db5f", "address": "fa:16:3e:39:ba:42", "network": {"id": "a4e74890-7ab4-4e52-8297-5c27f2cb6497", "bridge": "br-int", "label": "tempest-device-tagging-net1-428079376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb99cdec-40", "ovs_interfaceid": "cb99cdec-40f2-4666-bc12-0c825431db5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "af01e732-21ed-4815-842e-90e7b3591398", "address": "fa:16:3e:ab:fe:ca", "network": {"id": "a4e74890-7ab4-4e52-8297-5c27f2cb6497", "bridge": "br-int", "label": "tempest-device-tagging-net1-428079376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf01e732-21", "ovs_interfaceid": "af01e732-21ed-4815-842e-90e7b3591398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "692db581-bf1f-4295-a18d-65ab40120c7a", "address": "fa:16:3e:fb:c8:98", "network": {"id": "7f7c8970-9e06-4944-bfac-ac7ea2073cee", "bridge": "br-int", "label": "tempest-device-tagging-net2-2000981143", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap692db581-bf", "ovs_interfaceid": "692db581-bf1f-4295-a18d-65ab40120c7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "875b1fd5-6595-48dc-83b1-95ebeee70bb2", "address": "fa:16:3e:e1:90:74", "network": {"id": "7f7c8970-9e06-4944-bfac-ac7ea2073cee", "bridge": "br-int", "label": "tempest-device-tagging-net2-2000981143", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875b1fd5-65", "ovs_interfaceid": "875b1fd5-6595-48dc-83b1-95ebeee70bb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:23:21 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Releasing lock "refresh_cache-2b284735-40f6-403f-8c72-a70a4da1ef95" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:23:21 user nova-compute[72418]: DEBUG nova.compute.manager [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Instance network_info: |[{"id": "f148ea7a-87e0-482f-bd2f-d3fcaa50fd4f", "address": "fa:16:3e:5c:b3:39", "network": {"id": "1b2af6fe-348e-4d75-9967-f6e70cb5e625", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1372910455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf148ea7a-87", "ovs_interfaceid": "f148ea7a-87e0-482f-bd2f-d3fcaa50fd4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "92f457ac-3ac1-426a-ac45-854d9e2ca180", "address": "fa:16:3e:1e:50:a4", "network": {"id": "a4e74890-7ab4-4e52-8297-5c27f2cb6497", "bridge": "br-int", "label": "tempest-device-tagging-net1-428079376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f457ac-3a", "ovs_interfaceid": "92f457ac-3ac1-426a-ac45-854d9e2ca180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a0900115-d746-4910-aafd-a6da02efe287", "address": "fa:16:3e:fa:8a:82", "network": {"id": "a4e74890-7ab4-4e52-8297-5c27f2cb6497", "bridge": "br-int", "label": "tempest-device-tagging-net1-428079376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0900115-d7", "ovs_interfaceid": "a0900115-d746-4910-aafd-a6da02efe287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cb99cdec-40f2-4666-bc12-0c825431db5f", "address": "fa:16:3e:39:ba:42", "network": {"id": "a4e74890-7ab4-4e52-8297-5c27f2cb6497", "bridge": "br-int", "label": "tempest-device-tagging-net1-428079376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb99cdec-40", "ovs_interfaceid": "cb99cdec-40f2-4666-bc12-0c825431db5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "af01e732-21ed-4815-842e-90e7b3591398", "address": "fa:16:3e:ab:fe:ca", "network": {"id": "a4e74890-7ab4-4e52-8297-5c27f2cb6497", "bridge": "br-int", "label": "tempest-device-tagging-net1-428079376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf01e732-21", "ovs_interfaceid": "af01e732-21ed-4815-842e-90e7b3591398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "692db581-bf1f-4295-a18d-65ab40120c7a", "address": "fa:16:3e:fb:c8:98", "network": {"id": "7f7c8970-9e06-4944-bfac-ac7ea2073cee", "bridge": "br-int", "label": "tempest-device-tagging-net2-2000981143", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap692db581-bf", "ovs_interfaceid": "692db581-bf1f-4295-a18d-65ab40120c7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "875b1fd5-6595-48dc-83b1-95ebeee70bb2", "address": "fa:16:3e:e1:90:74", "network": {"id": "7f7c8970-9e06-4944-bfac-ac7ea2073cee", "bridge": "br-int", "label": "tempest-device-tagging-net2-2000981143", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875b1fd5-65", "ovs_interfaceid": "875b1fd5-6595-48dc-83b1-95ebeee70bb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 18:23:21 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a783db1c-a654-4ca9-b50c-bc01826f40bc req-0d7d0bad-cb99-4926-99f2-3618b6e228bc service nova] Acquired lock "refresh_cache-2b284735-40f6-403f-8c72-a70a4da1ef95" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:23:21 user nova-compute[72418]: DEBUG nova.network.neutron [req-a783db1c-a654-4ca9-b50c-bc01826f40bc req-0d7d0bad-cb99-4926-99f2-3618b6e228bc service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Refreshing network info cache for port 875b1fd5-6595-48dc-83b1-95ebeee70bb2 {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:23:22 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:22 user nova-compute[72418]: DEBUG nova.network.neutron [req-a783db1c-a654-4ca9-b50c-bc01826f40bc req-0d7d0bad-cb99-4926-99f2-3618b6e228bc service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Updated VIF entry in instance network info cache for port 875b1fd5-6595-48dc-83b1-95ebeee70bb2. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:23:22 user nova-compute[72418]: DEBUG nova.network.neutron [req-a783db1c-a654-4ca9-b50c-bc01826f40bc req-0d7d0bad-cb99-4926-99f2-3618b6e228bc service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Updating instance_info_cache with network_info: [{"id": "f148ea7a-87e0-482f-bd2f-d3fcaa50fd4f", "address": "fa:16:3e:5c:b3:39", "network": {"id": "1b2af6fe-348e-4d75-9967-f6e70cb5e625", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1372910455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf148ea7a-87", "ovs_interfaceid": "f148ea7a-87e0-482f-bd2f-d3fcaa50fd4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "92f457ac-3ac1-426a-ac45-854d9e2ca180", "address": "fa:16:3e:1e:50:a4", "network": {"id": "a4e74890-7ab4-4e52-8297-5c27f2cb6497", "bridge": "br-int", "label": "tempest-device-tagging-net1-428079376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f457ac-3a", "ovs_interfaceid": "92f457ac-3ac1-426a-ac45-854d9e2ca180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a0900115-d746-4910-aafd-a6da02efe287", "address": "fa:16:3e:fa:8a:82", "network": {"id": "a4e74890-7ab4-4e52-8297-5c27f2cb6497", "bridge": "br-int", "label": "tempest-device-tagging-net1-428079376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0900115-d7", "ovs_interfaceid": "a0900115-d746-4910-aafd-a6da02efe287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cb99cdec-40f2-4666-bc12-0c825431db5f", "address": "fa:16:3e:39:ba:42", "network": {"id": "a4e74890-7ab4-4e52-8297-5c27f2cb6497", "bridge": "br-int", "label": "tempest-device-tagging-net1-428079376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb99cdec-40", "ovs_interfaceid": "cb99cdec-40f2-4666-bc12-0c825431db5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "af01e732-21ed-4815-842e-90e7b3591398", "address": "fa:16:3e:ab:fe:ca", "network": {"id": "a4e74890-7ab4-4e52-8297-5c27f2cb6497", "bridge": "br-int", "label": "tempest-device-tagging-net1-428079376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf01e732-21", "ovs_interfaceid": "af01e732-21ed-4815-842e-90e7b3591398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "692db581-bf1f-4295-a18d-65ab40120c7a", "address": "fa:16:3e:fb:c8:98", "network": {"id": "7f7c8970-9e06-4944-bfac-ac7ea2073cee", "bridge": "br-int", "label": "tempest-device-tagging-net2-2000981143", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap692db581-bf", "ovs_interfaceid": "692db581-bf1f-4295-a18d-65ab40120c7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "875b1fd5-6595-48dc-83b1-95ebeee70bb2", "address": "fa:16:3e:e1:90:74", "network": {"id": "7f7c8970-9e06-4944-bfac-ac7ea2073cee", "bridge": "br-int", "label": "tempest-device-tagging-net2-2000981143", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875b1fd5-65", "ovs_interfaceid": "875b1fd5-6595-48dc-83b1-95ebeee70bb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:23:22 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a783db1c-a654-4ca9-b50c-bc01826f40bc req-0d7d0bad-cb99-4926-99f2-3618b6e228bc service nova] Releasing lock "refresh_cache-2b284735-40f6-403f-8c72-a70a4da1ef95" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:23:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:25 user nova-compute[72418]: INFO nova.virt.block_device [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Booting with volume ac8573d2-6da6-4c83-b6ab-72de440eefff at /dev/vdc
Aug 09 18:23:25 user nova-compute[72418]: DEBUG os_brick.utils [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:23:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:25 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[372c65a1-2481-45b0-be3c-dcc3972fcb40]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ad56b243ad71\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:25 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[190e6e20-debd-4255-92b4-05635baf3243]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:25 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3de550-84de-407f-92c0-88f6190efa0e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:25 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5691c9b-c859-44ff-8efd-6055ad7e69ce]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Running cmd (subprocess): nvme version {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] 'nvme version' failed. Not Retrying. {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:23:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] nvme not present on system {{(pid=72418) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 18:23:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:23:25 user nova-compute[72418]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 18:23:25 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce39e630-74fd-463e-b816-768168618d11]: (4, '') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72418) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 18:23:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 18:23:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] LIGHTOS: no hostnqn found. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 18:23:25 user nova-compute[72418]: DEBUG os_brick.utils [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ad56b243ad71', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:23:25 user nova-compute[72418]: DEBUG nova.virt.block_device [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Updating existing volume attachment record: fef87dde-b5ea-49b6-a105-f80cc29fa0af {{(pid=72418) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 18:23:26 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:27 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:27 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:30 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Acquiring lock "28dad451-f27e-4c62-8353-e3b89e0196cd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:23:30 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Lock "28dad451-f27e-4c62-8353-e3b89e0196cd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:23:30 user nova-compute[72418]: DEBUG nova.compute.manager [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Starting instance... {{(pid=72418) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 18:23:31 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:23:31 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:23:31 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72418) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 18:23:31 user nova-compute[72418]: INFO nova.compute.claims [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Claim successful on node user
Aug 09 18:23:31 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:31 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:23:31 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:23:31 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.448s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:23:31 user nova-compute[72418]: DEBUG nova.compute.manager [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Start building networks asynchronously for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 18:23:31 user nova-compute[72418]: DEBUG nova.compute.manager [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Allocating IP information in the background. {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 18:23:31 user nova-compute[72418]: DEBUG nova.network.neutron [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] allocate_for_instance() {{(pid=72418) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 18:23:31 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 18:23:31 user nova-compute[72418]: DEBUG nova.compute.manager [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Start building block device mappings for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 18:23:31 user nova-compute[72418]: DEBUG nova.policy [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fa49b18d00ad41c6a2c7d2a9e91b1206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c2418c1ed345928b81431d728f2650', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72418) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 18:23:31 user nova-compute[72418]: DEBUG nova.compute.manager [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Start spawning the instance on the hypervisor. {{(pid=72418) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 18:23:31 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Creating instance directory {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 18:23:31 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Creating image(s)
Aug 09 18:23:31 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Acquiring lock "/opt/stack/data/nova/instances/28dad451-f27e-4c62-8353-e3b89e0196cd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:23:31 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Lock "/opt/stack/data/nova/instances/28dad451-f27e-4c62-8353-e3b89e0196cd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:23:31 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Lock "/opt/stack/data/nova/instances/28dad451-f27e-4c62-8353-e3b89e0196cd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:23:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.144s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:31 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Acquiring lock "458773cfa7230b717e41c60277832e9f83806d71" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:23:31 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:23:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:32 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:32 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.152s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:32 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/28dad451-f27e-4c62-8353-e3b89e0196cd/disk 1073741824 {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:32 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/28dad451-f27e-4c62-8353-e3b89e0196cd/disk 1073741824" returned: 0 in 0.045s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:32 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:23:32 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:32 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.143s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:32 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Checking if we can resize image /opt/stack/data/nova/instances/28dad451-f27e-4c62-8353-e3b89e0196cd/disk. size=1073741824 {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 18:23:32 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28dad451-f27e-4c62-8353-e3b89e0196cd/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:32 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28dad451-f27e-4c62-8353-e3b89e0196cd/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:32 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Cannot resize image /opt/stack/data/nova/instances/28dad451-f27e-4c62-8353-e3b89e0196cd/disk to a smaller size. {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 18:23:32 user nova-compute[72418]: DEBUG nova.objects.instance [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Lazy-loading 'migration_context' on Instance uuid 28dad451-f27e-4c62-8353-e3b89e0196cd {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:23:32 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Created local disks {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 18:23:32 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Ensure instance console log exists: /opt/stack/data/nova/instances/28dad451-f27e-4c62-8353-e3b89e0196cd/console.log {{(pid=72418) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 18:23:32 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:23:32 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:23:32 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:23:32 user nova-compute[72418]: DEBUG nova.network.neutron [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Successfully created port: c634ea3f-4db3-4c0f-ac00-42c822c095ab {{(pid=72418) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 18:23:33 user nova-compute[72418]: DEBUG nova.network.neutron [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Successfully updated port: c634ea3f-4db3-4c0f-ac00-42c822c095ab {{(pid=72418) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 18:23:33 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Acquiring lock "refresh_cache-28dad451-f27e-4c62-8353-e3b89e0196cd" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:23:33 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Acquired lock "refresh_cache-28dad451-f27e-4c62-8353-e3b89e0196cd" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:23:33 user nova-compute[72418]: DEBUG nova.network.neutron [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:23:33 user nova-compute[72418]: DEBUG nova.compute.manager [req-2dbc7e82-6664-4ed8-9d90-88429d133cba req-e172f9f2-18ef-4aad-bd78-6d25c633f5e1 service nova] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Received event network-changed-c634ea3f-4db3-4c0f-ac00-42c822c095ab {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:23:33 user nova-compute[72418]: DEBUG nova.compute.manager [req-2dbc7e82-6664-4ed8-9d90-88429d133cba req-e172f9f2-18ef-4aad-bd78-6d25c633f5e1 service nova] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Refreshing instance network info cache due to event network-changed-c634ea3f-4db3-4c0f-ac00-42c822c095ab. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:23:33 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-2dbc7e82-6664-4ed8-9d90-88429d133cba req-e172f9f2-18ef-4aad-bd78-6d25c633f5e1 service nova] Acquiring lock "refresh_cache-28dad451-f27e-4c62-8353-e3b89e0196cd" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:23:33 user nova-compute[72418]: DEBUG nova.network.neutron [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Instance cache missing network info. {{(pid=72418) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 18:23:33 user nova-compute[72418]: DEBUG nova.network.neutron [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Updating instance_info_cache with network_info: [{"id": "c634ea3f-4db3-4c0f-ac00-42c822c095ab", "address": "fa:16:3e:27:2e:34", "network": {"id": "cdf92d6c-8d60-4947-b73b-38686728c14e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2096407534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9c2418c1ed345928b81431d728f2650", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc634ea3f-4d", "ovs_interfaceid": "c634ea3f-4db3-4c0f-ac00-42c822c095ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:23:33 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Releasing lock "refresh_cache-28dad451-f27e-4c62-8353-e3b89e0196cd" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:23:33 user nova-compute[72418]: DEBUG nova.compute.manager [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Instance network_info: |[{"id": "c634ea3f-4db3-4c0f-ac00-42c822c095ab", "address": "fa:16:3e:27:2e:34", "network": {"id": "cdf92d6c-8d60-4947-b73b-38686728c14e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2096407534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9c2418c1ed345928b81431d728f2650", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc634ea3f-4d", "ovs_interfaceid": "c634ea3f-4db3-4c0f-ac00-42c822c095ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 18:23:33 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-2dbc7e82-6664-4ed8-9d90-88429d133cba req-e172f9f2-18ef-4aad-bd78-6d25c633f5e1 service nova] Acquired lock "refresh_cache-28dad451-f27e-4c62-8353-e3b89e0196cd" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:23:33 user nova-compute[72418]: DEBUG nova.network.neutron [req-2dbc7e82-6664-4ed8-9d90-88429d133cba req-e172f9f2-18ef-4aad-bd78-6d25c633f5e1 service nova] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Refreshing network info cache for port c634ea3f-4db3-4c0f-ac00-42c822c095ab {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:23:33 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Start _get_guest_xml network_info=[{"id": "c634ea3f-4db3-4c0f-ac00-42c822c095ab", "address": "fa:16:3e:27:2e:34", "network": {"id": "cdf92d6c-8d60-4947-b73b-38686728c14e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2096407534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9c2418c1ed345928b81431d728f2650", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc634ea3f-4d", "ovs_interfaceid": "c634ea3f-4db3-4c0f-ac00-42c822c095ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 18:23:33 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:23:33 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:23:33 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 18:23:33 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] CPU controller missing on host. {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 18:23:33 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 18:23:33 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] CPU controller found on host. {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 18:23:33 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72418) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 18:23:33 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T18:17:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 18:23:33 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Flavor limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 18:23:33 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Image limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 18:23:33 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Flavor pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 18:23:33 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Image pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 18:23:33 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 18:23:33 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 18:23:33 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 18:23:33 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Got 1 possible topologies {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 18:23:33 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 18:23:33 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 18:23:33 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:23:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-639325370',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-639325370',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-6393253',id=11,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIoqToZAlYsdBm6NV31jJe8Jx6210KEYutt67Hi68ZFARzjHLDzp/rIi9kVGURo9o44L634qGu1D9iYiMX9U5sCzvsIwQpAbB5vFMWm55ks2DotDjDyEDYhSlt3A/LGN1w==',key_name='tempest-keypair-1921005649',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9c2418c1ed345928b81431d728f2650',ramdisk_id='',reservation_id='r-j0iqfk4p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2001119544',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:23:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa49b18d00ad41c6a2c7d2a9e91b1206',uuid=28dad451-f27e-4c62-8353-e3b89e0196cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c634ea3f-4db3-4c0f-ac00-42c822c095ab", "address": "fa:16:3e:27:2e:34", "network": {"id": "cdf92d6c-8d60-4947-b73b-38686728c14e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2096407534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9c2418c1ed345928b81431d728f2650", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc634ea3f-4d", "ovs_interfaceid": "c634ea3f-4db3-4c0f-ac00-42c822c095ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:23:33 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Converting VIF {"id": "c634ea3f-4db3-4c0f-ac00-42c822c095ab", "address": "fa:16:3e:27:2e:34", "network": {"id": "cdf92d6c-8d60-4947-b73b-38686728c14e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2096407534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9c2418c1ed345928b81431d728f2650", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc634ea3f-4d", "ovs_interfaceid": "c634ea3f-4db3-4c0f-ac00-42c822c095ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:23:33 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:2e:34,bridge_name='br-int',has_traffic_filtering=True,id=c634ea3f-4db3-4c0f-ac00-42c822c095ab,network=Network(cdf92d6c-8d60-4947-b73b-38686728c14e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc634ea3f-4d') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:23:33 user nova-compute[72418]: DEBUG nova.objects.instance [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Lazy-loading 'pci_devices' on Instance uuid 28dad451-f27e-4c62-8353-e3b89e0196cd {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:23:33 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] End _get_guest_xml xml=<domain type="kvm">
Aug 09 18:23:33 user nova-compute[72418]:   <uuid>28dad451-f27e-4c62-8353-e3b89e0196cd</uuid>
Aug 09 18:23:33 user nova-compute[72418]:   <name>instance-0000000b</name>
Aug 09 18:23:33 user nova-compute[72418]:   <memory>524288</memory>
Aug 09 18:23:33 user nova-compute[72418]:   <vcpu>1</vcpu>
Aug 09 18:23:33 user nova-compute[72418]:   <metadata>
Aug 09 18:23:33 user nova-compute[72418]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:23:33 user nova-compute[72418]:       <nova:package version="0.0.0"/>
Aug 09 18:23:33 user nova-compute[72418]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-639325370</nova:name>
Aug 09 18:23:33 user nova-compute[72418]:       <nova:creationTime>2023-08-09 18:23:33</nova:creationTime>
Aug 09 18:23:33 user nova-compute[72418]:       <nova:flavor name="m1.tiny">
Aug 09 18:23:33 user nova-compute[72418]:         <nova:memory>512</nova:memory>
Aug 09 18:23:33 user nova-compute[72418]:         <nova:disk>1</nova:disk>
Aug 09 18:23:33 user nova-compute[72418]:         <nova:swap>0</nova:swap>
Aug 09 18:23:33 user nova-compute[72418]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:23:33 user nova-compute[72418]:         <nova:vcpus>1</nova:vcpus>
Aug 09 18:23:33 user nova-compute[72418]:       </nova:flavor>
Aug 09 18:23:33 user nova-compute[72418]:       <nova:owner>
Aug 09 18:23:33 user nova-compute[72418]:         <nova:user uuid="fa49b18d00ad41c6a2c7d2a9e91b1206">tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member</nova:user>
Aug 09 18:23:33 user nova-compute[72418]:         <nova:project uuid="f9c2418c1ed345928b81431d728f2650">tempest-TestServerVolumeAttachScenarioOldVersion-2001119544</nova:project>
Aug 09 18:23:33 user nova-compute[72418]:       </nova:owner>
Aug 09 18:23:33 user nova-compute[72418]:       <nova:root type="image" uuid="8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e"/>
Aug 09 18:23:33 user nova-compute[72418]:       <nova:ports>
Aug 09 18:23:33 user nova-compute[72418]:         <nova:port uuid="c634ea3f-4db3-4c0f-ac00-42c822c095ab">
Aug 09 18:23:33 user nova-compute[72418]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 18:23:33 user nova-compute[72418]:         </nova:port>
Aug 09 18:23:33 user nova-compute[72418]:       </nova:ports>
Aug 09 18:23:33 user nova-compute[72418]:     </nova:instance>
Aug 09 18:23:33 user nova-compute[72418]:   </metadata>
Aug 09 18:23:33 user nova-compute[72418]:   <sysinfo type="smbios">
Aug 09 18:23:33 user nova-compute[72418]:     <system>
Aug 09 18:23:33 user nova-compute[72418]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 18:23:33 user nova-compute[72418]:       <entry name="product">OpenStack Nova</entry>
Aug 09 18:23:33 user nova-compute[72418]:       <entry name="version">0.0.0</entry>
Aug 09 18:23:33 user nova-compute[72418]:       <entry name="serial">28dad451-f27e-4c62-8353-e3b89e0196cd</entry>
Aug 09 18:23:33 user nova-compute[72418]:       <entry name="uuid">28dad451-f27e-4c62-8353-e3b89e0196cd</entry>
Aug 09 18:23:33 user nova-compute[72418]:       <entry name="family">Virtual Machine</entry>
Aug 09 18:23:33 user nova-compute[72418]:     </system>
Aug 09 18:23:33 user nova-compute[72418]:   </sysinfo>
Aug 09 18:23:33 user nova-compute[72418]:   <os>
Aug 09 18:23:33 user nova-compute[72418]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 18:23:33 user nova-compute[72418]:     <boot dev="hd"/>
Aug 09 18:23:33 user nova-compute[72418]:     <smbios mode="sysinfo"/>
Aug 09 18:23:33 user nova-compute[72418]:   </os>
Aug 09 18:23:33 user nova-compute[72418]:   <features>
Aug 09 18:23:33 user nova-compute[72418]:     <acpi/>
Aug 09 18:23:33 user nova-compute[72418]:     <apic/>
Aug 09 18:23:33 user nova-compute[72418]:     <vmcoreinfo/>
Aug 09 18:23:33 user nova-compute[72418]:   </features>
Aug 09 18:23:33 user nova-compute[72418]:   <clock offset="utc">
Aug 09 18:23:33 user nova-compute[72418]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 18:23:33 user nova-compute[72418]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 18:23:33 user nova-compute[72418]:     <timer name="hpet" present="no"/>
Aug 09 18:23:33 user nova-compute[72418]:   </clock>
Aug 09 18:23:33 user nova-compute[72418]:   <cpu mode="custom" match="exact">
Aug 09 18:23:33 user nova-compute[72418]:     <model>Nehalem</model>
Aug 09 18:23:33 user nova-compute[72418]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 18:23:33 user nova-compute[72418]:   </cpu>
Aug 09 18:23:33 user nova-compute[72418]:   <devices>
Aug 09 18:23:33 user nova-compute[72418]:     <disk type="file" device="disk">
Aug 09 18:23:33 user nova-compute[72418]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 18:23:33 user nova-compute[72418]:       <source file="/opt/stack/data/nova/instances/28dad451-f27e-4c62-8353-e3b89e0196cd/disk"/>
Aug 09 18:23:33 user nova-compute[72418]:       <target dev="vda" bus="virtio"/>
Aug 09 18:23:33 user nova-compute[72418]:     </disk>
Aug 09 18:23:33 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:23:33 user nova-compute[72418]:       <mac address="fa:16:3e:27:2e:34"/>
Aug 09 18:23:33 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:23:33 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:23:33 user nova-compute[72418]:       <target dev="tapc634ea3f-4d"/>
Aug 09 18:23:33 user nova-compute[72418]:     </interface>
Aug 09 18:23:33 user nova-compute[72418]:     <serial type="pty">
Aug 09 18:23:33 user nova-compute[72418]:       <log file="/opt/stack/data/nova/instances/28dad451-f27e-4c62-8353-e3b89e0196cd/console.log" append="off"/>
Aug 09 18:23:33 user nova-compute[72418]:     </serial>
Aug 09 18:23:33 user nova-compute[72418]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 18:23:33 user nova-compute[72418]:     <video>
Aug 09 18:23:33 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:23:33 user nova-compute[72418]:     </video>
Aug 09 18:23:33 user nova-compute[72418]:     <rng model="virtio">
Aug 09 18:23:33 user nova-compute[72418]:       <backend model="random">/dev/urandom</backend>
Aug 09 18:23:33 user nova-compute[72418]:     </rng>
Aug 09 18:23:33 user nova-compute[72418]:     <controller type="usb" index="0" model="none"/>
Aug 09 18:23:33 user nova-compute[72418]:     <memballoon model="virtio">
Aug 09 18:23:33 user nova-compute[72418]:       <stats period="10"/>
Aug 09 18:23:33 user nova-compute[72418]:     </memballoon>
Aug 09 18:23:33 user nova-compute[72418]:   </devices>
Aug 09 18:23:33 user nova-compute[72418]: </domain>
Aug 09 18:23:33 user nova-compute[72418]:  {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 18:23:33 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:23:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-639325370',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-639325370',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-6393253',id=11,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIoqToZAlYsdBm6NV31jJe8Jx6210KEYutt67Hi68ZFARzjHLDzp/rIi9kVGURo9o44L634qGu1D9iYiMX9U5sCzvsIwQpAbB5vFMWm55ks2DotDjDyEDYhSlt3A/LGN1w==',key_name='tempest-keypair-1921005649',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9c2418c1ed345928b81431d728f2650',ramdisk_id='',reservation_id='r-j0iqfk4p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2001119544',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:23:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa49b18d00ad41c6a2c7d2a9e91b1206',uuid=28dad451-f27e-4c62-8353-e3b89e0196cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c634ea3f-4db3-4c0f-ac00-42c822c095ab", "address": "fa:16:3e:27:2e:34", "network": {"id": "cdf92d6c-8d60-4947-b73b-38686728c14e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2096407534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9c2418c1ed345928b81431d728f2650", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc634ea3f-4d", "ovs_interfaceid": "c634ea3f-4db3-4c0f-ac00-42c822c095ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:23:33 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Converting VIF {"id": "c634ea3f-4db3-4c0f-ac00-42c822c095ab", "address": "fa:16:3e:27:2e:34", "network": {"id": "cdf92d6c-8d60-4947-b73b-38686728c14e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2096407534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9c2418c1ed345928b81431d728f2650", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc634ea3f-4d", "ovs_interfaceid": "c634ea3f-4db3-4c0f-ac00-42c822c095ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:23:33 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:2e:34,bridge_name='br-int',has_traffic_filtering=True,id=c634ea3f-4db3-4c0f-ac00-42c822c095ab,network=Network(cdf92d6c-8d60-4947-b73b-38686728c14e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc634ea3f-4d') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:23:33 user nova-compute[72418]: DEBUG os_vif [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:2e:34,bridge_name='br-int',has_traffic_filtering=True,id=c634ea3f-4db3-4c0f-ac00-42c822c095ab,network=Network(cdf92d6c-8d60-4947-b73b-38686728c14e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc634ea3f-4d') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:23:33 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:33 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:23:33 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:23:33 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:33 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc634ea3f-4d, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:23:33 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc634ea3f-4d, col_values=(('external_ids', {'iface-id': 'c634ea3f-4db3-4c0f-ac00-42c822c095ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:2e:34', 'vm-uuid': '28dad451-f27e-4c62-8353-e3b89e0196cd'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:23:33 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:23:33 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:33 user nova-compute[72418]: INFO os_vif [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:2e:34,bridge_name='br-int',has_traffic_filtering=True,id=c634ea3f-4db3-4c0f-ac00-42c822c095ab,network=Network(cdf92d6c-8d60-4947-b73b-38686728c14e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc634ea3f-4d')
Aug 09 18:23:33 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:23:33 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] No VIF found with MAC fa:16:3e:27:2e:34, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:23:34 user nova-compute[72418]: DEBUG nova.network.neutron [req-2dbc7e82-6664-4ed8-9d90-88429d133cba req-e172f9f2-18ef-4aad-bd78-6d25c633f5e1 service nova] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Updated VIF entry in instance network info cache for port c634ea3f-4db3-4c0f-ac00-42c822c095ab. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:23:34 user nova-compute[72418]: DEBUG nova.network.neutron [req-2dbc7e82-6664-4ed8-9d90-88429d133cba req-e172f9f2-18ef-4aad-bd78-6d25c633f5e1 service nova] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Updating instance_info_cache with network_info: [{"id": "c634ea3f-4db3-4c0f-ac00-42c822c095ab", "address": "fa:16:3e:27:2e:34", "network": {"id": "cdf92d6c-8d60-4947-b73b-38686728c14e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2096407534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9c2418c1ed345928b81431d728f2650", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc634ea3f-4d", "ovs_interfaceid": "c634ea3f-4db3-4c0f-ac00-42c822c095ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:23:34 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-2dbc7e82-6664-4ed8-9d90-88429d133cba req-e172f9f2-18ef-4aad-bd78-6d25c633f5e1 service nova] Releasing lock "refresh_cache-28dad451-f27e-4c62-8353-e3b89e0196cd" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG nova.compute.manager [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Start spawning the instance on the hypervisor. {{(pid=72418) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Creating instance directory {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 18:23:35 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Creating image(s)
Aug 09 18:23:35 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Did not create local disks {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Ensure instance console log exists: /opt/stack/data/nova/instances/2b284735-40f6-403f-8c72-a70a4da1ef95/console.log {{(pid=72418) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Start _get_guest_xml network_info=[{"id": "f148ea7a-87e0-482f-bd2f-d3fcaa50fd4f", "address": "fa:16:3e:5c:b3:39", "network": {"id": "1b2af6fe-348e-4d75-9967-f6e70cb5e625", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1372910455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf148ea7a-87", "ovs_interfaceid": "f148ea7a-87e0-482f-bd2f-d3fcaa50fd4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "92f457ac-3ac1-426a-ac45-854d9e2ca180", "address": "fa:16:3e:1e:50:a4", "network": {"id": "a4e74890-7ab4-4e52-8297-5c27f2cb6497", "bridge": "br-int", "label": "tempest-device-tagging-net1-428079376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f457ac-3a", "ovs_interfaceid": "92f457ac-3ac1-426a-ac45-854d9e2ca180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a0900115-d746-4910-aafd-a6da02efe287", "address": "fa:16:3e:fa:8a:82", "network": {"id": "a4e74890-7ab4-4e52-8297-5c27f2cb6497", "bridge": "br-int", "label": "tempest-device-tagging-net1-428079376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0900115-d7", "ovs_interfaceid": "a0900115-d746-4910-aafd-a6da02efe287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cb99cdec-40f2-4666-bc12-0c825431db5f", "address": "fa:16:3e:39:ba:42", "network": {"id": "a4e74890-7ab4-4e52-8297-5c27f2cb6497", "bridge": "br-int", "label": "tempest-device-tagging-net1-428079376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb99cdec-40", "ovs_interfaceid": "cb99cdec-40f2-4666-bc12-0c825431db5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "af01e732-21ed-4815-842e-90e7b3591398", "address": "fa:16:3e:ab:fe:ca", "network": {"id": "a4e74890-7ab4-4e52-8297-5c27f2cb6497", "bridge": "br-int", "label": "tempest-device-tagging-net1-428079376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf01e732-21", "ovs_interfaceid": "af01e732-21ed-4815-842e-90e7b3591398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "692db581-bf1f-4295-a18d-65ab40120c7a", "address": "fa:16:3e:fb:c8:98", "network": {"id": "7f7c8970-9e06-4944-bfac-ac7ea2073cee", "bridge": "br-int", "label": "tempest-device-tagging-net2-2000981143", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap692db581-bf", "ovs_interfaceid": "692db581-bf1f-4295-a18d-65ab40120c7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "875b1fd5-6595-48dc-83b1-95ebeee70bb2", "address": "fa:16:3e:e1:90:74", "network": {"id": "7f7c8970-9e06-4944-bfac-ac7ea2073cee", "bridge": "br-int", "label": "tempest-device-tagging-net2-2000981143", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875b1fd5-65", "ovs_interfaceid": "875b1fd5-6595-48dc-83b1-95ebeee70bb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '8c9dd1ae-ceeb-4db0-8557-e2cdadc32405', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'akgYnryP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2b284735-40f6-403f-8c72-a70a4da1ef95', 'attached_at': '', 'detached_at': '', 'volume_id': '9e1058f2-9030-499b-bb70-208cb531c561', 'serial': '9e1058f2-9030-499b-bb70-208cb531c561'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None}, {'mount_device': '/dev/vdb', 'attachment_id': 'c3bd6a6a-9fd3-4ec4-943d-58f69df58df9', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sgtVQXOc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2b284735-40f6-403f-8c72-a70a4da1ef95', 'attached_at': '', 'detached_at': '', 'volume_id': '112f7914-2b2f-49cc-9390-76303f64928a', 'serial': '112f7914-2b2f-49cc-9390-76303f64928a'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 1, 'device_type': 'disk', 'volume_type': None}, {'mount_device': '/dev/vdc', 'attachment_id': 'fef87dde-b5ea-49b6-a105-f80cc29fa0af', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RxFCqfYU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2b284735-40f6-403f-8c72-a70a4da1ef95', 'attached_at': '', 'detached_at': '', 'volume_id': 'ac8573d2-6da6-4c83-b6ab-72de440eefff', 'serial': 'ac8573d2-6da6-4c83-b6ab-72de440eefff'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 2, 'device_type': 'disk', 'volume_type': None} {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 18:23:35 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:23:35 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:23:35 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] CPU controller missing on host. {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] CPU controller found on host. {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72418) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T18:17:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Flavor limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Image limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Flavor pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Image pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Got 1 possible topologies {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Calling os-brick to attach iSCSI Volume {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'akgYnryP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:23:35 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:23:35 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:23:35 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:23:35 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:23:35 user nova-compute[72418]: INFO os_brick.initiator.connectors.iscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 18:23:35 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 -p 172.16.0.220:3260 {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[abec1296-6389-4ab7-a2ec-b1f220833a1f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 18:23:35 user nova-compute[72418]:  {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 -p 172.16.0.220:3260 --interface default --op new {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a718505f-3c73-4ea1-8ebc-224883724d2c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561] added\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561] added
Aug 09 18:23:35 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[548995b4-2a3f-4f6b-be00-456631d51ee7]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd34f5a5-9f18-475b-b306-dcd4ba0bb0ff]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v akgYnryP {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v akgYnryP" returned: 0 in 0.017s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[e918eba5-65ba-4f7a-b7dc-99a28008b101]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'akgYnryP'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[98519be4-e3e0-4618-a76c-03c60d673d4c]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b65ed4-3a54-4c9f-89e3-25fa5a763974]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:23:35 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:23:35 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 -p 172.16.0.220:3260 --login {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c340ce24-5c3a-4748-b31d-8e421eb053e1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561, portal: 172.16.0.220,3260]
Aug 09 18:23:35 user nova-compute[72418]: Login to [iface: default, target: iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561, portal: 172.16.0.220,3260] successful.
Aug 09 18:23:35 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[6257431b-e5f1-4cad-8565-8eecc1d894d5]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2e12e2-48c9-4e29-80a3-5c1f6405da4d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:23:35 user nova-compute[72418]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)
Aug 09 18:23:35 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:23:35 user nova-compute[72418]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)
Aug 09 18:23:35 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Connected to 172.16.0.220:3260 {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=72418) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72418) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a02f88-b60e-4b50-bf1b-67195f693be2]: (4, ('- - 0', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72418) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'akgYnryP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG nova.compute.manager [req-b1be2471-bf64-46c3-ba1e-fae50cd24518 req-410f24e7-37db-48ab-a6d0-2eb826668134 service nova] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Received event network-vif-plugged-c634ea3f-4db3-4c0f-ac00-42c822c095ab {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-b1be2471-bf64-46c3-ba1e-fae50cd24518 req-410f24e7-37db-48ab-a6d0-2eb826668134 service nova] Acquiring lock "28dad451-f27e-4c62-8353-e3b89e0196cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-b1be2471-bf64-46c3-ba1e-fae50cd24518 req-410f24e7-37db-48ab-a6d0-2eb826668134 service nova] Lock "28dad451-f27e-4c62-8353-e3b89e0196cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-b1be2471-bf64-46c3-ba1e-fae50cd24518 req-410f24e7-37db-48ab-a6d0-2eb826668134 service nova] Lock "28dad451-f27e-4c62-8353-e3b89e0196cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG nova.compute.manager [req-b1be2471-bf64-46c3-ba1e-fae50cd24518 req-410f24e7-37db-48ab-a6d0-2eb826668134 service nova] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] No waiting events found dispatching network-vif-plugged-c634ea3f-4db3-4c0f-ac00-42c822c095ab {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:23:35 user nova-compute[72418]: WARNING nova.compute.manager [req-b1be2471-bf64-46c3-ba1e-fae50cd24518 req-410f24e7-37db-48ab-a6d0-2eb826668134 service nova] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Received unexpected event network-vif-plugged-c634ea3f-4db3-4c0f-ac00-42c822c095ab for instance with vm_state building and task_state spawning.
Aug 09 18:23:35 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:35 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '26364333034623262', 'path': '/dev/sdc'} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364333034623262', 'path': '/dev/sdc'} {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Calling os-brick to attach iSCSI Volume {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sgtVQXOc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:23:36 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:23:36 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:23:36 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:23:36 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:23:36 user nova-compute[72418]: INFO os_brick.initiator.connectors.iscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 18:23:36 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a -p 172.16.0.220:3260 {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b22752a-d14a-4dc6-9e3b-908259c22fa2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 18:23:36 user nova-compute[72418]:  {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a -p 172.16.0.220:3260 --interface default --op new {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1eda841-4f23-4294-95fd-4b8addffc285]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a] added\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a] added
Aug 09 18:23:36 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03e009b-dc00-4858-88ba-bd42d3c7b0d1]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[44744490-5f8b-4557-a5b8-286aa01679c4]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sgtVQXOc {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sgtVQXOc" returned: 0 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[20116fca-b986-467a-bca4-38a10718b04c]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sgtVQXOc'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28b60b2-0066-4254-8a1a-20577995c2ea]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[971dedf0-9fbd-443f-bc3c-ec8fec740090]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:23:36 user nova-compute[72418]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)
Aug 09 18:23:36 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:23:36 user nova-compute[72418]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)
Aug 09 18:23:36 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a -p 172.16.0.220:3260 --login {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a989466a-b51d-45fd-bbbf-73ec027998be]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a, portal: 172.16.0.220,3260]
Aug 09 18:23:36 user nova-compute[72418]: Login to [iface: default, target: iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a, portal: 172.16.0.220,3260] successful.
Aug 09 18:23:36 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[490ab393-f015-4089-bb50-c29543134c43]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26476f7-6d84-46af-97fd-5688e277e2d8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:23:36 user nova-compute[72418]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)
Aug 09 18:23:36 user nova-compute[72418]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)
Aug 09 18:23:36 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:23:36 user nova-compute[72418]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)
Aug 09 18:23:36 user nova-compute[72418]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)
Aug 09 18:23:36 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Connected to 172.16.0.220:3260 {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=72418) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72418) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad9f81f-0e16-4bc1-ba98-ec334777ff9a]: (4, ('- - 0', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72418) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 18:23:36 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sgtVQXOc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 18:23:37 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:37 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605417.5946898, 28dad451-f27e-4c62-8353-e3b89e0196cd => Resumed> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:23:37 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] VM Resumed (Lifecycle Event)
Aug 09 18:23:37 user nova-compute[72418]: DEBUG nova.compute.manager [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Instance event wait completed in 0 seconds for  {{(pid=72418) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 18:23:37 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Guest created on hypervisor {{(pid=72418) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 18:23:37 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Instance spawned successfully.
Aug 09 18:23:37 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 18:23:37 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:23:37 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:23:37 user nova-compute[72418]: DEBUG nova.compute.manager [req-94c50fe2-7254-4817-95ef-51786da1d626 req-f4add7f7-74f5-4e7e-81ca-1ff0e211242f service nova] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Received event network-vif-plugged-c634ea3f-4db3-4c0f-ac00-42c822c095ab {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:23:37 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-94c50fe2-7254-4817-95ef-51786da1d626 req-f4add7f7-74f5-4e7e-81ca-1ff0e211242f service nova] Acquiring lock "28dad451-f27e-4c62-8353-e3b89e0196cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:23:37 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-94c50fe2-7254-4817-95ef-51786da1d626 req-f4add7f7-74f5-4e7e-81ca-1ff0e211242f service nova] Lock "28dad451-f27e-4c62-8353-e3b89e0196cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:23:37 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-94c50fe2-7254-4817-95ef-51786da1d626 req-f4add7f7-74f5-4e7e-81ca-1ff0e211242f service nova] Lock "28dad451-f27e-4c62-8353-e3b89e0196cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:23:37 user nova-compute[72418]: DEBUG nova.compute.manager [req-94c50fe2-7254-4817-95ef-51786da1d626 req-f4add7f7-74f5-4e7e-81ca-1ff0e211242f service nova] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] No waiting events found dispatching network-vif-plugged-c634ea3f-4db3-4c0f-ac00-42c822c095ab {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:23:37 user nova-compute[72418]: WARNING nova.compute.manager [req-94c50fe2-7254-4817-95ef-51786da1d626 req-f4add7f7-74f5-4e7e-81ca-1ff0e211242f service nova] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Received unexpected event network-vif-plugged-c634ea3f-4db3-4c0f-ac00-42c822c095ab for instance with vm_state building and task_state spawning.
Aug 09 18:23:37 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Found default for hw_cdrom_bus of ide {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:23:37 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Found default for hw_disk_bus of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:23:37 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Found default for hw_input_bus of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:23:37 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Found default for hw_pointer_model of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:23:37 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Found default for hw_video_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:23:37 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Found default for hw_vif_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:23:37 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:23:37 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605417.5962393, 28dad451-f27e-4c62-8353-e3b89e0196cd => Started> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:23:37 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] VM Started (Lifecycle Event)
Aug 09 18:23:37 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:23:37 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:23:37 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:23:37 user nova-compute[72418]: INFO nova.compute.manager [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Took 5.97 seconds to spawn the instance on the hypervisor.
Aug 09 18:23:37 user nova-compute[72418]: DEBUG nova.compute.manager [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:23:37 user nova-compute[72418]: INFO nova.compute.manager [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Took 6.78 seconds to build instance.
Aug 09 18:23:37 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:23:37 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23130356561376539', 'path': '/dev/sdd'} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:23:37 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130356561376539', 'path': '/dev/sdd'} {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 18:23:37 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-323ddacf-e40e-47f3-9ae5-19fdeb034551 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Lock "28dad451-f27e-4c62-8353-e3b89e0196cd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.979s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:23:37 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Calling os-brick to attach iSCSI Volume {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 18:23:37 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RxFCqfYU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:23:37 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:23:37 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:23:37 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:23:37 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:23:37 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:23:37 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:23:37 user nova-compute[72418]: INFO os_brick.initiator.connectors.iscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 18:23:37 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff -p 172.16.0.220:3260 {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:37 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:37 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e679d9-aa1d-4f6c-a617-3cbb0b4195f3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:37 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 18:23:37 user nova-compute[72418]:  {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:23:37 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff -p 172.16.0.220:3260 --interface default --op new {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:37 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:37 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9749df-a08f-45e5-8e98-701cd24a15dd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff] added\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:37 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff] added
Aug 09 18:23:37 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:23:37 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:38 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:38 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[435c12de-9887-45d0-ab17-13daba02a766]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:38 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:23:38 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:38 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:38 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d5818a-0f73-42c2-90b3-10b92ab3c1ce]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:38 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:23:38 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RxFCqfYU {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:38 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RxFCqfYU" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:38 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[13cc3064-6850-47e2-92bc-1e22645c1072]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:38 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RxFCqfYU'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:23:38 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:38 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:38 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[8725e1b3-8cae-4081-ad08-9e4bf8aea1da]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:38 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:23:38 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:38 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:38 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[04bc92aa-b6a5-4c9a-9905-2c1e28385414]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:38 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:23:38 user nova-compute[72418]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)
Aug 09 18:23:38 user nova-compute[72418]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)
Aug 09 18:23:38 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:23:38 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:23:38 user nova-compute[72418]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)
Aug 09 18:23:38 user nova-compute[72418]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)
Aug 09 18:23:38 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:23:38 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff -p 172.16.0.220:3260 --login {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:38 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:38 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[008576de-3095-4fcc-83c4-4f1a97e5edcc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:38 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff, portal: 172.16.0.220,3260]
Aug 09 18:23:38 user nova-compute[72418]: Login to [iface: default, target: iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff, portal: 172.16.0.220,3260] successful.
Aug 09 18:23:38 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:23:38 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:38 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:38 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[452790dc-96e8-40a7-94ea-377022cd6a7f]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:38 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:23:38 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:38 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:38 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[5147f079-b898-42b7-885a-92a611e1e098]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:38 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:23:38 user nova-compute[72418]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)
Aug 09 18:23:38 user nova-compute[72418]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)
Aug 09 18:23:38 user nova-compute[72418]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)
Aug 09 18:23:38 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:23:38 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:23:38 user nova-compute[72418]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)
Aug 09 18:23:38 user nova-compute[72418]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)
Aug 09 18:23:38 user nova-compute[72418]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)
Aug 09 18:23:38 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:23:38 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:23:38 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Connected to 172.16.0.220:3260 {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 18:23:38 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=72418) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 18:23:38 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72418) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 18:23:38 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:38 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:38 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7504d2c-6994-4eea-a36c-af3fa09b43d5]: (4, ('- - 0', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:38 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72418) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 18:23:38 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RxFCqfYU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 18:23:38 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23831316433393535', 'path': '/dev/sde'} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831316433393535', 'path': '/dev/sde'} {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T18:23:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-68181259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-68181259',id=10,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEje+5G8l0zUFPb9efwBnHt0ZCgCM3Tx0KnXOqSoP3aJ2QZUzCV1jaoIRZpidY8jgKBIJGhaAf4cFXsD98WOVIAvSJDOu2fqOlZNRQf70eApwdMsLd5pz1Ic1XdRFAlkw==',key_name='tempest-keypair-508730491',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56236651c71b4e3f99128436cdf94710',ramdisk_id='',reservation_id='r-kuvfi2b9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-766454510',owner_user_name='tempest-TaggedBootDevicesTest-766454510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:23:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ebed3edc7b9488bbfa6d11f8441773a',uuid=2b284735-40f6-403f-8c72-a70a4da1ef95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f148ea7a-87e0-482f-bd2f-d3fcaa50fd4f", "address": "fa:16:3e:5c:b3:39", "network": {"id": "1b2af6fe-348e-4d75-9967-f6e70cb5e625", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1372910455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf148ea7a-87", "ovs_interfaceid": "f148ea7a-87e0-482f-bd2f-d3fcaa50fd4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Converting VIF {"id": "f148ea7a-87e0-482f-bd2f-d3fcaa50fd4f", "address": "fa:16:3e:5c:b3:39", "network": {"id": "1b2af6fe-348e-4d75-9967-f6e70cb5e625", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1372910455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf148ea7a-87", "ovs_interfaceid": "f148ea7a-87e0-482f-bd2f-d3fcaa50fd4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:b3:39,bridge_name='br-int',has_traffic_filtering=True,id=f148ea7a-87e0-482f-bd2f-d3fcaa50fd4f,network=Network(1b2af6fe-348e-4d75-9967-f6e70cb5e625),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf148ea7a-87') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T18:23:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-68181259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-68181259',id=10,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEje+5G8l0zUFPb9efwBnHt0ZCgCM3Tx0KnXOqSoP3aJ2QZUzCV1jaoIRZpidY8jgKBIJGhaAf4cFXsD98WOVIAvSJDOu2fqOlZNRQf70eApwdMsLd5pz1Ic1XdRFAlkw==',key_name='tempest-keypair-508730491',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56236651c71b4e3f99128436cdf94710',ramdisk_id='',reservation_id='r-kuvfi2b9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-766454510',owner_user_name='tempest-TaggedBootDevicesTest-766454510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:23:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ebed3edc7b9488bbfa6d11f8441773a',uuid=2b284735-40f6-403f-8c72-a70a4da1ef95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92f457ac-3ac1-426a-ac45-854d9e2ca180", "address": "fa:16:3e:1e:50:a4", "network": {"id": "a4e74890-7ab4-4e52-8297-5c27f2cb6497", "bridge": "br-int", "label": "tempest-device-tagging-net1-428079376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f457ac-3a", "ovs_interfaceid": "92f457ac-3ac1-426a-ac45-854d9e2ca180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Converting VIF {"id": "92f457ac-3ac1-426a-ac45-854d9e2ca180", "address": "fa:16:3e:1e:50:a4", "network": {"id": "a4e74890-7ab4-4e52-8297-5c27f2cb6497", "bridge": "br-int", "label": "tempest-device-tagging-net1-428079376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f457ac-3a", "ovs_interfaceid": "92f457ac-3ac1-426a-ac45-854d9e2ca180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:50:a4,bridge_name='br-int',has_traffic_filtering=True,id=92f457ac-3ac1-426a-ac45-854d9e2ca180,network=Network(a4e74890-7ab4-4e52-8297-5c27f2cb6497),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap92f457ac-3a') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T18:23:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-68181259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-68181259',id=10,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEje+5G8l0zUFPb9efwBnHt0ZCgCM3Tx0KnXOqSoP3aJ2QZUzCV1jaoIRZpidY8jgKBIJGhaAf4cFXsD98WOVIAvSJDOu2fqOlZNRQf70eApwdMsLd5pz1Ic1XdRFAlkw==',key_name='tempest-keypair-508730491',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56236651c71b4e3f99128436cdf94710',ramdisk_id='',reservation_id='r-kuvfi2b9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-766454510',owner_user_name='tempest-TaggedBootDevicesTest-766454510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:23:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ebed3edc7b9488bbfa6d11f8441773a',uuid=2b284735-40f6-403f-8c72-a70a4da1ef95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0900115-d746-4910-aafd-a6da02efe287", "address": "fa:16:3e:fa:8a:82", "network": {"id": "a4e74890-7ab4-4e52-8297-5c27f2cb6497", "bridge": "br-int", "label": "tempest-device-tagging-net1-428079376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0900115-d7", "ovs_interfaceid": "a0900115-d746-4910-aafd-a6da02efe287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Converting VIF {"id": "a0900115-d746-4910-aafd-a6da02efe287", "address": "fa:16:3e:fa:8a:82", "network": {"id": "a4e74890-7ab4-4e52-8297-5c27f2cb6497", "bridge": "br-int", "label": "tempest-device-tagging-net1-428079376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0900115-d7", "ovs_interfaceid": "a0900115-d746-4910-aafd-a6da02efe287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:8a:82,bridge_name='br-int',has_traffic_filtering=True,id=a0900115-d746-4910-aafd-a6da02efe287,network=Network(a4e74890-7ab4-4e52-8297-5c27f2cb6497),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa0900115-d7') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T18:23:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-68181259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-68181259',id=10,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEje+5G8l0zUFPb9efwBnHt0ZCgCM3Tx0KnXOqSoP3aJ2QZUzCV1jaoIRZpidY8jgKBIJGhaAf4cFXsD98WOVIAvSJDOu2fqOlZNRQf70eApwdMsLd5pz1Ic1XdRFAlkw==',key_name='tempest-keypair-508730491',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56236651c71b4e3f99128436cdf94710',ramdisk_id='',reservation_id='r-kuvfi2b9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-766454510',owner_user_name='tempest-TaggedBootDevicesTest-766454510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:23:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ebed3edc7b9488bbfa6d11f8441773a',uuid=2b284735-40f6-403f-8c72-a70a4da1ef95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb99cdec-40f2-4666-bc12-0c825431db5f", "address": "fa:16:3e:39:ba:42", "network": {"id": "a4e74890-7ab4-4e52-8297-5c27f2cb6497", "bridge": "br-int", "label": "tempest-device-tagging-net1-428079376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb99cdec-40", "ovs_interfaceid": "cb99cdec-40f2-4666-bc12-0c825431db5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Converting VIF {"id": "cb99cdec-40f2-4666-bc12-0c825431db5f", "address": "fa:16:3e:39:ba:42", "network": {"id": "a4e74890-7ab4-4e52-8297-5c27f2cb6497", "bridge": "br-int", "label": "tempest-device-tagging-net1-428079376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb99cdec-40", "ovs_interfaceid": "cb99cdec-40f2-4666-bc12-0c825431db5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:ba:42,bridge_name='br-int',has_traffic_filtering=True,id=cb99cdec-40f2-4666-bc12-0c825431db5f,network=Network(a4e74890-7ab4-4e52-8297-5c27f2cb6497),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb99cdec-40') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T18:23:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-68181259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-68181259',id=10,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEje+5G8l0zUFPb9efwBnHt0ZCgCM3Tx0KnXOqSoP3aJ2QZUzCV1jaoIRZpidY8jgKBIJGhaAf4cFXsD98WOVIAvSJDOu2fqOlZNRQf70eApwdMsLd5pz1Ic1XdRFAlkw==',key_name='tempest-keypair-508730491',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56236651c71b4e3f99128436cdf94710',ramdisk_id='',reservation_id='r-kuvfi2b9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-766454510',owner_user_name='tempest-TaggedBootDevicesTest-766454510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:23:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ebed3edc7b9488bbfa6d11f8441773a',uuid=2b284735-40f6-403f-8c72-a70a4da1ef95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af01e732-21ed-4815-842e-90e7b3591398", "address": "fa:16:3e:ab:fe:ca", "network": {"id": "a4e74890-7ab4-4e52-8297-5c27f2cb6497", "bridge": "br-int", "label": "tempest-device-tagging-net1-428079376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf01e732-21", "ovs_interfaceid": "af01e732-21ed-4815-842e-90e7b3591398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Converting VIF {"id": "af01e732-21ed-4815-842e-90e7b3591398", "address": "fa:16:3e:ab:fe:ca", "network": {"id": "a4e74890-7ab4-4e52-8297-5c27f2cb6497", "bridge": "br-int", "label": "tempest-device-tagging-net1-428079376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf01e732-21", "ovs_interfaceid": "af01e732-21ed-4815-842e-90e7b3591398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:fe:ca,bridge_name='br-int',has_traffic_filtering=True,id=af01e732-21ed-4815-842e-90e7b3591398,network=Network(a4e74890-7ab4-4e52-8297-5c27f2cb6497),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf01e732-21') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T18:23:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-68181259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-68181259',id=10,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEje+5G8l0zUFPb9efwBnHt0ZCgCM3Tx0KnXOqSoP3aJ2QZUzCV1jaoIRZpidY8jgKBIJGhaAf4cFXsD98WOVIAvSJDOu2fqOlZNRQf70eApwdMsLd5pz1Ic1XdRFAlkw==',key_name='tempest-keypair-508730491',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56236651c71b4e3f99128436cdf94710',ramdisk_id='',reservation_id='r-kuvfi2b9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-766454510',owner_user_name='tempest-TaggedBootDevicesTest-766454510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:23:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ebed3edc7b9488bbfa6d11f8441773a',uuid=2b284735-40f6-403f-8c72-a70a4da1ef95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "692db581-bf1f-4295-a18d-65ab40120c7a", "address": "fa:16:3e:fb:c8:98", "network": {"id": "7f7c8970-9e06-4944-bfac-ac7ea2073cee", "bridge": "br-int", "label": "tempest-device-tagging-net2-2000981143", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap692db581-bf", "ovs_interfaceid": "692db581-bf1f-4295-a18d-65ab40120c7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Converting VIF {"id": "692db581-bf1f-4295-a18d-65ab40120c7a", "address": "fa:16:3e:fb:c8:98", "network": {"id": "7f7c8970-9e06-4944-bfac-ac7ea2073cee", "bridge": "br-int", "label": "tempest-device-tagging-net2-2000981143", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap692db581-bf", "ovs_interfaceid": "692db581-bf1f-4295-a18d-65ab40120c7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:c8:98,bridge_name='br-int',has_traffic_filtering=True,id=692db581-bf1f-4295-a18d-65ab40120c7a,network=Network(7f7c8970-9e06-4944-bfac-ac7ea2073cee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap692db581-bf') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T18:23:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-68181259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-68181259',id=10,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEje+5G8l0zUFPb9efwBnHt0ZCgCM3Tx0KnXOqSoP3aJ2QZUzCV1jaoIRZpidY8jgKBIJGhaAf4cFXsD98WOVIAvSJDOu2fqOlZNRQf70eApwdMsLd5pz1Ic1XdRFAlkw==',key_name='tempest-keypair-508730491',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56236651c71b4e3f99128436cdf94710',ramdisk_id='',reservation_id='r-kuvfi2b9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-766454510',owner_user_name='tempest-TaggedBootDevicesTest-766454510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:23:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ebed3edc7b9488bbfa6d11f8441773a',uuid=2b284735-40f6-403f-8c72-a70a4da1ef95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "875b1fd5-6595-48dc-83b1-95ebeee70bb2", "address": "fa:16:3e:e1:90:74", "network": {"id": "7f7c8970-9e06-4944-bfac-ac7ea2073cee", "bridge": "br-int", "label": "tempest-device-tagging-net2-2000981143", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875b1fd5-65", "ovs_interfaceid": "875b1fd5-6595-48dc-83b1-95ebeee70bb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Converting VIF {"id": "875b1fd5-6595-48dc-83b1-95ebeee70bb2", "address": "fa:16:3e:e1:90:74", "network": {"id": "7f7c8970-9e06-4944-bfac-ac7ea2073cee", "bridge": "br-int", "label": "tempest-device-tagging-net2-2000981143", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875b1fd5-65", "ovs_interfaceid": "875b1fd5-6595-48dc-83b1-95ebeee70bb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:90:74,bridge_name='br-int',has_traffic_filtering=True,id=875b1fd5-6595-48dc-83b1-95ebeee70bb2,network=Network(7f7c8970-9e06-4944-bfac-ac7ea2073cee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap875b1fd5-65') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG nova.objects.instance [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Lazy-loading 'pci_devices' on Instance uuid 2b284735-40f6-403f-8c72-a70a4da1ef95 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] End _get_guest_xml xml=<domain type="kvm">
Aug 09 18:23:39 user nova-compute[72418]:   <uuid>2b284735-40f6-403f-8c72-a70a4da1ef95</uuid>
Aug 09 18:23:39 user nova-compute[72418]:   <name>instance-0000000a</name>
Aug 09 18:23:39 user nova-compute[72418]:   <memory>524288</memory>
Aug 09 18:23:39 user nova-compute[72418]:   <vcpu>1</vcpu>
Aug 09 18:23:39 user nova-compute[72418]:   <metadata>
Aug 09 18:23:39 user nova-compute[72418]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:23:39 user nova-compute[72418]:       <nova:package version="0.0.0"/>
Aug 09 18:23:39 user nova-compute[72418]:       <nova:name>tempest-device-tagging-server-68181259</nova:name>
Aug 09 18:23:39 user nova-compute[72418]:       <nova:creationTime>2023-08-09 18:23:35</nova:creationTime>
Aug 09 18:23:39 user nova-compute[72418]:       <nova:flavor name="m1.tiny">
Aug 09 18:23:39 user nova-compute[72418]:         <nova:memory>512</nova:memory>
Aug 09 18:23:39 user nova-compute[72418]:         <nova:disk>1</nova:disk>
Aug 09 18:23:39 user nova-compute[72418]:         <nova:swap>0</nova:swap>
Aug 09 18:23:39 user nova-compute[72418]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:23:39 user nova-compute[72418]:         <nova:vcpus>1</nova:vcpus>
Aug 09 18:23:39 user nova-compute[72418]:       </nova:flavor>
Aug 09 18:23:39 user nova-compute[72418]:       <nova:owner>
Aug 09 18:23:39 user nova-compute[72418]:         <nova:user uuid="4ebed3edc7b9488bbfa6d11f8441773a">tempest-TaggedBootDevicesTest-766454510-project-member</nova:user>
Aug 09 18:23:39 user nova-compute[72418]:         <nova:project uuid="56236651c71b4e3f99128436cdf94710">tempest-TaggedBootDevicesTest-766454510</nova:project>
Aug 09 18:23:39 user nova-compute[72418]:       </nova:owner>
Aug 09 18:23:39 user nova-compute[72418]:       <nova:root type="image" uuid="8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e"/>
Aug 09 18:23:39 user nova-compute[72418]:       <nova:ports>
Aug 09 18:23:39 user nova-compute[72418]:         <nova:port uuid="f148ea7a-87e0-482f-bd2f-d3fcaa50fd4f">
Aug 09 18:23:39 user nova-compute[72418]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 18:23:39 user nova-compute[72418]:         </nova:port>
Aug 09 18:23:39 user nova-compute[72418]:         <nova:port uuid="92f457ac-3ac1-426a-ac45-854d9e2ca180">
Aug 09 18:23:39 user nova-compute[72418]:           <nova:ip type="fixed" address="10.1.1.83" ipVersion="4"/>
Aug 09 18:23:39 user nova-compute[72418]:         </nova:port>
Aug 09 18:23:39 user nova-compute[72418]:         <nova:port uuid="a0900115-d746-4910-aafd-a6da02efe287">
Aug 09 18:23:39 user nova-compute[72418]:           <nova:ip type="fixed" address="10.1.1.41" ipVersion="4"/>
Aug 09 18:23:39 user nova-compute[72418]:         </nova:port>
Aug 09 18:23:39 user nova-compute[72418]:         <nova:port uuid="cb99cdec-40f2-4666-bc12-0c825431db5f">
Aug 09 18:23:39 user nova-compute[72418]:           <nova:ip type="fixed" address="10.1.1.123" ipVersion="4"/>
Aug 09 18:23:39 user nova-compute[72418]:         </nova:port>
Aug 09 18:23:39 user nova-compute[72418]:         <nova:port uuid="af01e732-21ed-4815-842e-90e7b3591398">
Aug 09 18:23:39 user nova-compute[72418]:           <nova:ip type="fixed" address="10.1.1.32" ipVersion="4"/>
Aug 09 18:23:39 user nova-compute[72418]:         </nova:port>
Aug 09 18:23:39 user nova-compute[72418]:         <nova:port uuid="692db581-bf1f-4295-a18d-65ab40120c7a">
Aug 09 18:23:39 user nova-compute[72418]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 09 18:23:39 user nova-compute[72418]:         </nova:port>
Aug 09 18:23:39 user nova-compute[72418]:         <nova:port uuid="875b1fd5-6595-48dc-83b1-95ebeee70bb2">
Aug 09 18:23:39 user nova-compute[72418]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 09 18:23:39 user nova-compute[72418]:         </nova:port>
Aug 09 18:23:39 user nova-compute[72418]:       </nova:ports>
Aug 09 18:23:39 user nova-compute[72418]:     </nova:instance>
Aug 09 18:23:39 user nova-compute[72418]:   </metadata>
Aug 09 18:23:39 user nova-compute[72418]:   <sysinfo type="smbios">
Aug 09 18:23:39 user nova-compute[72418]:     <system>
Aug 09 18:23:39 user nova-compute[72418]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 18:23:39 user nova-compute[72418]:       <entry name="product">OpenStack Nova</entry>
Aug 09 18:23:39 user nova-compute[72418]:       <entry name="version">0.0.0</entry>
Aug 09 18:23:39 user nova-compute[72418]:       <entry name="serial">2b284735-40f6-403f-8c72-a70a4da1ef95</entry>
Aug 09 18:23:39 user nova-compute[72418]:       <entry name="uuid">2b284735-40f6-403f-8c72-a70a4da1ef95</entry>
Aug 09 18:23:39 user nova-compute[72418]:       <entry name="family">Virtual Machine</entry>
Aug 09 18:23:39 user nova-compute[72418]:     </system>
Aug 09 18:23:39 user nova-compute[72418]:   </sysinfo>
Aug 09 18:23:39 user nova-compute[72418]:   <os>
Aug 09 18:23:39 user nova-compute[72418]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 18:23:39 user nova-compute[72418]:     <boot dev="hd"/>
Aug 09 18:23:39 user nova-compute[72418]:     <smbios mode="sysinfo"/>
Aug 09 18:23:39 user nova-compute[72418]:   </os>
Aug 09 18:23:39 user nova-compute[72418]:   <features>
Aug 09 18:23:39 user nova-compute[72418]:     <acpi/>
Aug 09 18:23:39 user nova-compute[72418]:     <apic/>
Aug 09 18:23:39 user nova-compute[72418]:     <vmcoreinfo/>
Aug 09 18:23:39 user nova-compute[72418]:   </features>
Aug 09 18:23:39 user nova-compute[72418]:   <clock offset="utc">
Aug 09 18:23:39 user nova-compute[72418]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 18:23:39 user nova-compute[72418]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 18:23:39 user nova-compute[72418]:     <timer name="hpet" present="no"/>
Aug 09 18:23:39 user nova-compute[72418]:   </clock>
Aug 09 18:23:39 user nova-compute[72418]:   <cpu mode="custom" match="exact">
Aug 09 18:23:39 user nova-compute[72418]:     <model>Nehalem</model>
Aug 09 18:23:39 user nova-compute[72418]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 18:23:39 user nova-compute[72418]:   </cpu>
Aug 09 18:23:39 user nova-compute[72418]:   <devices>
Aug 09 18:23:39 user nova-compute[72418]:     <disk type="file" device="cdrom">
Aug 09 18:23:39 user nova-compute[72418]:       <driver name="qemu" type="raw" cache="none"/>
Aug 09 18:23:39 user nova-compute[72418]:       <source file="/opt/stack/data/nova/instances/2b284735-40f6-403f-8c72-a70a4da1ef95/disk.config"/>
Aug 09 18:23:39 user nova-compute[72418]:       <target dev="hda" bus="ide"/>
Aug 09 18:23:39 user nova-compute[72418]:     </disk>
Aug 09 18:23:39 user nova-compute[72418]:     <disk type="block" device="disk">
Aug 09 18:23:39 user nova-compute[72418]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:23:39 user nova-compute[72418]:       <source dev="/dev/sdc"/>
Aug 09 18:23:39 user nova-compute[72418]:       <target dev="vda" bus="virtio"/>
Aug 09 18:23:39 user nova-compute[72418]:       <serial>9e1058f2-9030-499b-bb70-208cb531c561</serial>
Aug 09 18:23:39 user nova-compute[72418]:     </disk>
Aug 09 18:23:39 user nova-compute[72418]:     <disk type="block" device="disk">
Aug 09 18:23:39 user nova-compute[72418]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:23:39 user nova-compute[72418]:       <source dev="/dev/sdd"/>
Aug 09 18:23:39 user nova-compute[72418]:       <target dev="vdb" bus="virtio"/>
Aug 09 18:23:39 user nova-compute[72418]:       <serial>112f7914-2b2f-49cc-9390-76303f64928a</serial>
Aug 09 18:23:39 user nova-compute[72418]:     </disk>
Aug 09 18:23:39 user nova-compute[72418]:     <disk type="block" device="disk">
Aug 09 18:23:39 user nova-compute[72418]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:23:39 user nova-compute[72418]:       <source dev="/dev/sde"/>
Aug 09 18:23:39 user nova-compute[72418]:       <target dev="vdc" bus="virtio"/>
Aug 09 18:23:39 user nova-compute[72418]:       <serial>ac8573d2-6da6-4c83-b6ab-72de440eefff</serial>
Aug 09 18:23:39 user nova-compute[72418]:     </disk>
Aug 09 18:23:39 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:23:39 user nova-compute[72418]:       <mac address="fa:16:3e:5c:b3:39"/>
Aug 09 18:23:39 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:23:39 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:23:39 user nova-compute[72418]:       <target dev="tapf148ea7a-87"/>
Aug 09 18:23:39 user nova-compute[72418]:     </interface>
Aug 09 18:23:39 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:23:39 user nova-compute[72418]:       <mac address="fa:16:3e:1e:50:a4"/>
Aug 09 18:23:39 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:23:39 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:23:39 user nova-compute[72418]:       <target dev="tap92f457ac-3a"/>
Aug 09 18:23:39 user nova-compute[72418]:     </interface>
Aug 09 18:23:39 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:23:39 user nova-compute[72418]:       <mac address="fa:16:3e:fa:8a:82"/>
Aug 09 18:23:39 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:23:39 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:23:39 user nova-compute[72418]:       <target dev="tapa0900115-d7"/>
Aug 09 18:23:39 user nova-compute[72418]:     </interface>
Aug 09 18:23:39 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:23:39 user nova-compute[72418]:       <mac address="fa:16:3e:39:ba:42"/>
Aug 09 18:23:39 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:23:39 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:23:39 user nova-compute[72418]:       <target dev="tapcb99cdec-40"/>
Aug 09 18:23:39 user nova-compute[72418]:     </interface>
Aug 09 18:23:39 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:23:39 user nova-compute[72418]:       <mac address="fa:16:3e:ab:fe:ca"/>
Aug 09 18:23:39 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:23:39 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:23:39 user nova-compute[72418]:       <target dev="tapaf01e732-21"/>
Aug 09 18:23:39 user nova-compute[72418]:     </interface>
Aug 09 18:23:39 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:23:39 user nova-compute[72418]:       <mac address="fa:16:3e:fb:c8:98"/>
Aug 09 18:23:39 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:23:39 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:23:39 user nova-compute[72418]:       <target dev="tap692db581-bf"/>
Aug 09 18:23:39 user nova-compute[72418]:     </interface>
Aug 09 18:23:39 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:23:39 user nova-compute[72418]:       <mac address="fa:16:3e:e1:90:74"/>
Aug 09 18:23:39 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:23:39 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:23:39 user nova-compute[72418]:       <target dev="tap875b1fd5-65"/>
Aug 09 18:23:39 user nova-compute[72418]:     </interface>
Aug 09 18:23:39 user nova-compute[72418]:     <serial type="pty">
Aug 09 18:23:39 user nova-compute[72418]:       <log file="/opt/stack/data/nova/instances/2b284735-40f6-403f-8c72-a70a4da1ef95/console.log" append="off"/>
Aug 09 18:23:39 user nova-compute[72418]:     </serial>
Aug 09 18:23:39 user nova-compute[72418]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 18:23:39 user nova-compute[72418]:     <video>
Aug 09 18:23:39 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:23:39 user nova-compute[72418]:     </video>
Aug 09 18:23:39 user nova-compute[72418]:     <rng model="virtio">
Aug 09 18:23:39 user nova-compute[72418]:       <backend model="random">/dev/urandom</backend>
Aug 09 18:23:39 user nova-compute[72418]:     </rng>
Aug 09 18:23:39 user nova-compute[72418]:     <controller type="usb" index="0" model="none"/>
Aug 09 18:23:39 user nova-compute[72418]:     <memballoon model="virtio">
Aug 09 18:23:39 user nova-compute[72418]:       <stats period="10"/>
Aug 09 18:23:39 user nova-compute[72418]:     </memballoon>
Aug 09 18:23:39 user nova-compute[72418]:   </devices>
Aug 09 18:23:39 user nova-compute[72418]: </domain>
Aug 09 18:23:39 user nova-compute[72418]:  {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T18:23:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-68181259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-68181259',id=10,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEje+5G8l0zUFPb9efwBnHt0ZCgCM3Tx0KnXOqSoP3aJ2QZUzCV1jaoIRZpidY8jgKBIJGhaAf4cFXsD98WOVIAvSJDOu2fqOlZNRQf70eApwdMsLd5pz1Ic1XdRFAlkw==',key_name='tempest-keypair-508730491',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56236651c71b4e3f99128436cdf94710',ramdisk_id='',reservation_id='r-kuvfi2b9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-766454510',owner_user_name='tempest-TaggedBootDevicesTest-766454510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:23:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ebed3edc7b9488bbfa6d11f8441773a',uuid=2b284735-40f6-403f-8c72-a70a4da1ef95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f148ea7a-87e0-482f-bd2f-d3fcaa50fd4f", "address": "fa:16:3e:5c:b3:39", "network": {"id": "1b2af6fe-348e-4d75-9967-f6e70cb5e625", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1372910455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf148ea7a-87", "ovs_interfaceid": "f148ea7a-87e0-482f-bd2f-d3fcaa50fd4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Converting VIF {"id": "f148ea7a-87e0-482f-bd2f-d3fcaa50fd4f", "address": "fa:16:3e:5c:b3:39", "network": {"id": "1b2af6fe-348e-4d75-9967-f6e70cb5e625", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1372910455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf148ea7a-87", "ovs_interfaceid": "f148ea7a-87e0-482f-bd2f-d3fcaa50fd4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:b3:39,bridge_name='br-int',has_traffic_filtering=True,id=f148ea7a-87e0-482f-bd2f-d3fcaa50fd4f,network=Network(1b2af6fe-348e-4d75-9967-f6e70cb5e625),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf148ea7a-87') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG os_vif [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:b3:39,bridge_name='br-int',has_traffic_filtering=True,id=f148ea7a-87e0-482f-bd2f-d3fcaa50fd4f,network=Network(1b2af6fe-348e-4d75-9967-f6e70cb5e625),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf148ea7a-87') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf148ea7a-87, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf148ea7a-87, col_values=(('external_ids', {'iface-id': 'f148ea7a-87e0-482f-bd2f-d3fcaa50fd4f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:b3:39', 'vm-uuid': '2b284735-40f6-403f-8c72-a70a4da1ef95'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:39 user nova-compute[72418]: INFO os_vif [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:b3:39,bridge_name='br-int',has_traffic_filtering=True,id=f148ea7a-87e0-482f-bd2f-d3fcaa50fd4f,network=Network(1b2af6fe-348e-4d75-9967-f6e70cb5e625),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf148ea7a-87')
Aug 09 18:23:39 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T18:23:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-68181259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-68181259',id=10,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEje+5G8l0zUFPb9efwBnHt0ZCgCM3Tx0KnXOqSoP3aJ2QZUzCV1jaoIRZpidY8jgKBIJGhaAf4cFXsD98WOVIAvSJDOu2fqOlZNRQf70eApwdMsLd5pz1Ic1XdRFAlkw==',key_name='tempest-keypair-508730491',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56236651c71b4e3f99128436cdf94710',ramdisk_id='',reservation_id='r-kuvfi2b9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-766454510',owner_user_name='tempest-TaggedBootDevicesTest-766454510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:23:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ebed3edc7b9488bbfa6d11f8441773a',uuid=2b284735-40f6-403f-8c72-a70a4da1ef95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92f457ac-3ac1-426a-ac45-854d9e2ca180", "address": "fa:16:3e:1e:50:a4", "network": {"id": "a4e74890-7ab4-4e52-8297-5c27f2cb6497", "bridge": "br-int", "label": "tempest-device-tagging-net1-428079376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f457ac-3a", "ovs_interfaceid": "92f457ac-3ac1-426a-ac45-854d9e2ca180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Converting VIF {"id": "92f457ac-3ac1-426a-ac45-854d9e2ca180", "address": "fa:16:3e:1e:50:a4", "network": {"id": "a4e74890-7ab4-4e52-8297-5c27f2cb6497", "bridge": "br-int", "label": "tempest-device-tagging-net1-428079376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f457ac-3a", "ovs_interfaceid": "92f457ac-3ac1-426a-ac45-854d9e2ca180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:50:a4,bridge_name='br-int',has_traffic_filtering=True,id=92f457ac-3ac1-426a-ac45-854d9e2ca180,network=Network(a4e74890-7ab4-4e52-8297-5c27f2cb6497),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap92f457ac-3a') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG os_vif [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:50:a4,bridge_name='br-int',has_traffic_filtering=True,id=92f457ac-3ac1-426a-ac45-854d9e2ca180,network=Network(a4e74890-7ab4-4e52-8297-5c27f2cb6497),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap92f457ac-3a') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap92f457ac-3a, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap92f457ac-3a, col_values=(('external_ids', {'iface-id': '92f457ac-3ac1-426a-ac45-854d9e2ca180', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:50:a4', 'vm-uuid': '2b284735-40f6-403f-8c72-a70a4da1ef95'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:39 user nova-compute[72418]: INFO os_vif [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:50:a4,bridge_name='br-int',has_traffic_filtering=True,id=92f457ac-3ac1-426a-ac45-854d9e2ca180,network=Network(a4e74890-7ab4-4e52-8297-5c27f2cb6497),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap92f457ac-3a')
Aug 09 18:23:39 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T18:23:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-68181259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-68181259',id=10,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEje+5G8l0zUFPb9efwBnHt0ZCgCM3Tx0KnXOqSoP3aJ2QZUzCV1jaoIRZpidY8jgKBIJGhaAf4cFXsD98WOVIAvSJDOu2fqOlZNRQf70eApwdMsLd5pz1Ic1XdRFAlkw==',key_name='tempest-keypair-508730491',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56236651c71b4e3f99128436cdf94710',ramdisk_id='',reservation_id='r-kuvfi2b9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-766454510',owner_user_name='tempest-TaggedBootDevicesTest-766454510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:23:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ebed3edc7b9488bbfa6d11f8441773a',uuid=2b284735-40f6-403f-8c72-a70a4da1ef95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0900115-d746-4910-aafd-a6da02efe287", "address": "fa:16:3e:fa:8a:82", "network": {"id": "a4e74890-7ab4-4e52-8297-5c27f2cb6497", "bridge": "br-int", "label": "tempest-device-tagging-net1-428079376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0900115-d7", "ovs_interfaceid": "a0900115-d746-4910-aafd-a6da02efe287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Converting VIF {"id": "a0900115-d746-4910-aafd-a6da02efe287", "address": "fa:16:3e:fa:8a:82", "network": {"id": "a4e74890-7ab4-4e52-8297-5c27f2cb6497", "bridge": "br-int", "label": "tempest-device-tagging-net1-428079376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0900115-d7", "ovs_interfaceid": "a0900115-d746-4910-aafd-a6da02efe287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:8a:82,bridge_name='br-int',has_traffic_filtering=True,id=a0900115-d746-4910-aafd-a6da02efe287,network=Network(a4e74890-7ab4-4e52-8297-5c27f2cb6497),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa0900115-d7') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG os_vif [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:8a:82,bridge_name='br-int',has_traffic_filtering=True,id=a0900115-d746-4910-aafd-a6da02efe287,network=Network(a4e74890-7ab4-4e52-8297-5c27f2cb6497),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa0900115-d7') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa0900115-d7, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa0900115-d7, col_values=(('external_ids', {'iface-id': 'a0900115-d746-4910-aafd-a6da02efe287', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:8a:82', 'vm-uuid': '2b284735-40f6-403f-8c72-a70a4da1ef95'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:39 user nova-compute[72418]: INFO os_vif [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:8a:82,bridge_name='br-int',has_traffic_filtering=True,id=a0900115-d746-4910-aafd-a6da02efe287,network=Network(a4e74890-7ab4-4e52-8297-5c27f2cb6497),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa0900115-d7')
Aug 09 18:23:39 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T18:23:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-68181259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-68181259',id=10,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEje+5G8l0zUFPb9efwBnHt0ZCgCM3Tx0KnXOqSoP3aJ2QZUzCV1jaoIRZpidY8jgKBIJGhaAf4cFXsD98WOVIAvSJDOu2fqOlZNRQf70eApwdMsLd5pz1Ic1XdRFAlkw==',key_name='tempest-keypair-508730491',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56236651c71b4e3f99128436cdf94710',ramdisk_id='',reservation_id='r-kuvfi2b9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-766454510',owner_user_name='tempest-TaggedBootDevicesTest-766454510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:23:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ebed3edc7b9488bbfa6d11f8441773a',uuid=2b284735-40f6-403f-8c72-a70a4da1ef95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb99cdec-40f2-4666-bc12-0c825431db5f", "address": "fa:16:3e:39:ba:42", "network": {"id": "a4e74890-7ab4-4e52-8297-5c27f2cb6497", "bridge": "br-int", "label": "tempest-device-tagging-net1-428079376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb99cdec-40", "ovs_interfaceid": "cb99cdec-40f2-4666-bc12-0c825431db5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Converting VIF {"id": "cb99cdec-40f2-4666-bc12-0c825431db5f", "address": "fa:16:3e:39:ba:42", "network": {"id": "a4e74890-7ab4-4e52-8297-5c27f2cb6497", "bridge": "br-int", "label": "tempest-device-tagging-net1-428079376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb99cdec-40", "ovs_interfaceid": "cb99cdec-40f2-4666-bc12-0c825431db5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:ba:42,bridge_name='br-int',has_traffic_filtering=True,id=cb99cdec-40f2-4666-bc12-0c825431db5f,network=Network(a4e74890-7ab4-4e52-8297-5c27f2cb6497),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb99cdec-40') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG os_vif [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:ba:42,bridge_name='br-int',has_traffic_filtering=True,id=cb99cdec-40f2-4666-bc12-0c825431db5f,network=Network(a4e74890-7ab4-4e52-8297-5c27f2cb6497),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb99cdec-40') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb99cdec-40, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcb99cdec-40, col_values=(('external_ids', {'iface-id': 'cb99cdec-40f2-4666-bc12-0c825431db5f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:ba:42', 'vm-uuid': '2b284735-40f6-403f-8c72-a70a4da1ef95'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:39 user nova-compute[72418]: INFO os_vif [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:ba:42,bridge_name='br-int',has_traffic_filtering=True,id=cb99cdec-40f2-4666-bc12-0c825431db5f,network=Network(a4e74890-7ab4-4e52-8297-5c27f2cb6497),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb99cdec-40')
Aug 09 18:23:39 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T18:23:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-68181259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-68181259',id=10,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEje+5G8l0zUFPb9efwBnHt0ZCgCM3Tx0KnXOqSoP3aJ2QZUzCV1jaoIRZpidY8jgKBIJGhaAf4cFXsD98WOVIAvSJDOu2fqOlZNRQf70eApwdMsLd5pz1Ic1XdRFAlkw==',key_name='tempest-keypair-508730491',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56236651c71b4e3f99128436cdf94710',ramdisk_id='',reservation_id='r-kuvfi2b9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-766454510',owner_user_name='tempest-TaggedBootDevicesTest-766454510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:23:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ebed3edc7b9488bbfa6d11f8441773a',uuid=2b284735-40f6-403f-8c72-a70a4da1ef95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af01e732-21ed-4815-842e-90e7b3591398", "address": "fa:16:3e:ab:fe:ca", "network": {"id": "a4e74890-7ab4-4e52-8297-5c27f2cb6497", "bridge": "br-int", "label": "tempest-device-tagging-net1-428079376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf01e732-21", "ovs_interfaceid": "af01e732-21ed-4815-842e-90e7b3591398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Converting VIF {"id": "af01e732-21ed-4815-842e-90e7b3591398", "address": "fa:16:3e:ab:fe:ca", "network": {"id": "a4e74890-7ab4-4e52-8297-5c27f2cb6497", "bridge": "br-int", "label": "tempest-device-tagging-net1-428079376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf01e732-21", "ovs_interfaceid": "af01e732-21ed-4815-842e-90e7b3591398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:fe:ca,bridge_name='br-int',has_traffic_filtering=True,id=af01e732-21ed-4815-842e-90e7b3591398,network=Network(a4e74890-7ab4-4e52-8297-5c27f2cb6497),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf01e732-21') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG os_vif [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:fe:ca,bridge_name='br-int',has_traffic_filtering=True,id=af01e732-21ed-4815-842e-90e7b3591398,network=Network(a4e74890-7ab4-4e52-8297-5c27f2cb6497),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf01e732-21') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf01e732-21, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaf01e732-21, col_values=(('external_ids', {'iface-id': 'af01e732-21ed-4815-842e-90e7b3591398', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:fe:ca', 'vm-uuid': '2b284735-40f6-403f-8c72-a70a4da1ef95'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:39 user nova-compute[72418]: INFO os_vif [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:fe:ca,bridge_name='br-int',has_traffic_filtering=True,id=af01e732-21ed-4815-842e-90e7b3591398,network=Network(a4e74890-7ab4-4e52-8297-5c27f2cb6497),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf01e732-21')
Aug 09 18:23:39 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T18:23:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-68181259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-68181259',id=10,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEje+5G8l0zUFPb9efwBnHt0ZCgCM3Tx0KnXOqSoP3aJ2QZUzCV1jaoIRZpidY8jgKBIJGhaAf4cFXsD98WOVIAvSJDOu2fqOlZNRQf70eApwdMsLd5pz1Ic1XdRFAlkw==',key_name='tempest-keypair-508730491',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56236651c71b4e3f99128436cdf94710',ramdisk_id='',reservation_id='r-kuvfi2b9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-766454510',owner_user_name='tempest-TaggedBootDevicesTest-766454510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:23:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ebed3edc7b9488bbfa6d11f8441773a',uuid=2b284735-40f6-403f-8c72-a70a4da1ef95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "692db581-bf1f-4295-a18d-65ab40120c7a", "address": "fa:16:3e:fb:c8:98", "network": {"id": "7f7c8970-9e06-4944-bfac-ac7ea2073cee", "bridge": "br-int", "label": "tempest-device-tagging-net2-2000981143", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap692db581-bf", "ovs_interfaceid": "692db581-bf1f-4295-a18d-65ab40120c7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Converting VIF {"id": "692db581-bf1f-4295-a18d-65ab40120c7a", "address": "fa:16:3e:fb:c8:98", "network": {"id": "7f7c8970-9e06-4944-bfac-ac7ea2073cee", "bridge": "br-int", "label": "tempest-device-tagging-net2-2000981143", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap692db581-bf", "ovs_interfaceid": "692db581-bf1f-4295-a18d-65ab40120c7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:c8:98,bridge_name='br-int',has_traffic_filtering=True,id=692db581-bf1f-4295-a18d-65ab40120c7a,network=Network(7f7c8970-9e06-4944-bfac-ac7ea2073cee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap692db581-bf') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG os_vif [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:c8:98,bridge_name='br-int',has_traffic_filtering=True,id=692db581-bf1f-4295-a18d-65ab40120c7a,network=Network(7f7c8970-9e06-4944-bfac-ac7ea2073cee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap692db581-bf') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap692db581-bf, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap692db581-bf, col_values=(('external_ids', {'iface-id': '692db581-bf1f-4295-a18d-65ab40120c7a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:c8:98', 'vm-uuid': '2b284735-40f6-403f-8c72-a70a4da1ef95'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:39 user nova-compute[72418]: INFO os_vif [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:c8:98,bridge_name='br-int',has_traffic_filtering=True,id=692db581-bf1f-4295-a18d-65ab40120c7a,network=Network(7f7c8970-9e06-4944-bfac-ac7ea2073cee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap692db581-bf')
Aug 09 18:23:39 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T18:23:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-68181259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-68181259',id=10,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEje+5G8l0zUFPb9efwBnHt0ZCgCM3Tx0KnXOqSoP3aJ2QZUzCV1jaoIRZpidY8jgKBIJGhaAf4cFXsD98WOVIAvSJDOu2fqOlZNRQf70eApwdMsLd5pz1Ic1XdRFAlkw==',key_name='tempest-keypair-508730491',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56236651c71b4e3f99128436cdf94710',ramdisk_id='',reservation_id='r-kuvfi2b9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-766454510',owner_user_name='tempest-TaggedBootDevicesTest-766454510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:23:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ebed3edc7b9488bbfa6d11f8441773a',uuid=2b284735-40f6-403f-8c72-a70a4da1ef95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "875b1fd5-6595-48dc-83b1-95ebeee70bb2", "address": "fa:16:3e:e1:90:74", "network": {"id": "7f7c8970-9e06-4944-bfac-ac7ea2073cee", "bridge": "br-int", "label": "tempest-device-tagging-net2-2000981143", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875b1fd5-65", "ovs_interfaceid": "875b1fd5-6595-48dc-83b1-95ebeee70bb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Converting VIF {"id": "875b1fd5-6595-48dc-83b1-95ebeee70bb2", "address": "fa:16:3e:e1:90:74", "network": {"id": "7f7c8970-9e06-4944-bfac-ac7ea2073cee", "bridge": "br-int", "label": "tempest-device-tagging-net2-2000981143", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875b1fd5-65", "ovs_interfaceid": "875b1fd5-6595-48dc-83b1-95ebeee70bb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:90:74,bridge_name='br-int',has_traffic_filtering=True,id=875b1fd5-6595-48dc-83b1-95ebeee70bb2,network=Network(7f7c8970-9e06-4944-bfac-ac7ea2073cee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap875b1fd5-65') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG os_vif [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:90:74,bridge_name='br-int',has_traffic_filtering=True,id=875b1fd5-6595-48dc-83b1-95ebeee70bb2,network=Network(7f7c8970-9e06-4944-bfac-ac7ea2073cee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap875b1fd5-65') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap875b1fd5-65, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap875b1fd5-65, col_values=(('external_ids', {'iface-id': '875b1fd5-6595-48dc-83b1-95ebeee70bb2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:90:74', 'vm-uuid': '2b284735-40f6-403f-8c72-a70a4da1ef95'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:39 user nova-compute[72418]: INFO os_vif [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:90:74,bridge_name='br-int',has_traffic_filtering=True,id=875b1fd5-6595-48dc-83b1-95ebeee70bb2,network=Network(7f7c8970-9e06-4944-bfac-ac7ea2073cee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap875b1fd5-65')
Aug 09 18:23:39 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] No BDM found with device name hda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] No VIF found with MAC fa:16:3e:5c:b3:39, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:23:39 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] No VIF found with MAC fa:16:3e:ab:fe:ca, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:23:39 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Using config drive
Aug 09 18:23:39 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Creating config drive at /opt/stack/data/nova/instances/2b284735-40f6-403f-8c72-a70a4da1ef95/disk.config
Aug 09 18:23:39 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2b284735-40f6-403f-8c72-a70a4da1ef95/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpx09hci1r {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2b284735-40f6-403f-8c72-a70a4da1ef95/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpx09hci1r" returned: 0 in 0.054s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:41 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:41 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:41 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:41 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:42 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:42 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:42 user nova-compute[72418]: DEBUG nova.compute.manager [req-df2a25e7-0e60-4dc0-b384-8e0eb237543d req-f13d565c-3405-442c-a508-9fc9ebbc5744 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received event network-vif-plugged-f148ea7a-87e0-482f-bd2f-d3fcaa50fd4f {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:23:42 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-df2a25e7-0e60-4dc0-b384-8e0eb237543d req-f13d565c-3405-442c-a508-9fc9ebbc5744 service nova] Acquiring lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:23:42 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-df2a25e7-0e60-4dc0-b384-8e0eb237543d req-f13d565c-3405-442c-a508-9fc9ebbc5744 service nova] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:23:42 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-df2a25e7-0e60-4dc0-b384-8e0eb237543d req-f13d565c-3405-442c-a508-9fc9ebbc5744 service nova] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:23:42 user nova-compute[72418]: DEBUG nova.compute.manager [req-df2a25e7-0e60-4dc0-b384-8e0eb237543d req-f13d565c-3405-442c-a508-9fc9ebbc5744 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] No waiting events found dispatching network-vif-plugged-f148ea7a-87e0-482f-bd2f-d3fcaa50fd4f {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:23:42 user nova-compute[72418]: WARNING nova.compute.manager [req-df2a25e7-0e60-4dc0-b384-8e0eb237543d req-f13d565c-3405-442c-a508-9fc9ebbc5744 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received unexpected event network-vif-plugged-f148ea7a-87e0-482f-bd2f-d3fcaa50fd4f for instance with vm_state building and task_state spawning.
Aug 09 18:23:42 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:42 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:42 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:42 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:42 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:42 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:42 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:42 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:42 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:23:42 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:43 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:43 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:43 user nova-compute[72418]: DEBUG nova.compute.manager [req-f52a577c-0f02-4e47-b60f-38613ddfe763 req-d7d12586-8408-41e2-aa67-4e608ce70e61 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received event network-vif-plugged-cb99cdec-40f2-4666-bc12-0c825431db5f {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:23:43 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-f52a577c-0f02-4e47-b60f-38613ddfe763 req-d7d12586-8408-41e2-aa67-4e608ce70e61 service nova] Acquiring lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:23:43 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-f52a577c-0f02-4e47-b60f-38613ddfe763 req-d7d12586-8408-41e2-aa67-4e608ce70e61 service nova] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:23:43 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-f52a577c-0f02-4e47-b60f-38613ddfe763 req-d7d12586-8408-41e2-aa67-4e608ce70e61 service nova] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:23:43 user nova-compute[72418]: DEBUG nova.compute.manager [req-f52a577c-0f02-4e47-b60f-38613ddfe763 req-d7d12586-8408-41e2-aa67-4e608ce70e61 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] No waiting events found dispatching network-vif-plugged-cb99cdec-40f2-4666-bc12-0c825431db5f {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:23:43 user nova-compute[72418]: WARNING nova.compute.manager [req-f52a577c-0f02-4e47-b60f-38613ddfe763 req-d7d12586-8408-41e2-aa67-4e608ce70e61 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received unexpected event network-vif-plugged-cb99cdec-40f2-4666-bc12-0c825431db5f for instance with vm_state building and task_state spawning.
Aug 09 18:23:43 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:43 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:43 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:43 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:43 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:43 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:43 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:43 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:23:43 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:23:43 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:43 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:44 user nova-compute[72418]: INFO nova.compute.manager [None req-229a0aed-3832-4bda-b5cd-96705da51f9b tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Rescuing
Aug 09 18:23:44 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-229a0aed-3832-4bda-b5cd-96705da51f9b tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Acquiring lock "refresh_cache-01c46b33-6788-44a5-a43c-88ee4acc4d39" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:23:44 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-229a0aed-3832-4bda-b5cd-96705da51f9b tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Acquired lock "refresh_cache-01c46b33-6788-44a5-a43c-88ee4acc4d39" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:23:44 user nova-compute[72418]: DEBUG nova.network.neutron [None req-229a0aed-3832-4bda-b5cd-96705da51f9b tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:23:44 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:44 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:44 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:44 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:44 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:44 user nova-compute[72418]: DEBUG nova.compute.manager [req-bbf79617-666e-4990-b10b-7b10cfe09c85 req-fa4e97df-ea21-48c1-ac95-f8502786d37e service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received event network-vif-plugged-f148ea7a-87e0-482f-bd2f-d3fcaa50fd4f {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:23:44 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-bbf79617-666e-4990-b10b-7b10cfe09c85 req-fa4e97df-ea21-48c1-ac95-f8502786d37e service nova] Acquiring lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:23:44 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-bbf79617-666e-4990-b10b-7b10cfe09c85 req-fa4e97df-ea21-48c1-ac95-f8502786d37e service nova] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:23:44 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-bbf79617-666e-4990-b10b-7b10cfe09c85 req-fa4e97df-ea21-48c1-ac95-f8502786d37e service nova] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:23:44 user nova-compute[72418]: DEBUG nova.compute.manager [req-bbf79617-666e-4990-b10b-7b10cfe09c85 req-fa4e97df-ea21-48c1-ac95-f8502786d37e service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] No waiting events found dispatching network-vif-plugged-f148ea7a-87e0-482f-bd2f-d3fcaa50fd4f {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:23:44 user nova-compute[72418]: WARNING nova.compute.manager [req-bbf79617-666e-4990-b10b-7b10cfe09c85 req-fa4e97df-ea21-48c1-ac95-f8502786d37e service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received unexpected event network-vif-plugged-f148ea7a-87e0-482f-bd2f-d3fcaa50fd4f for instance with vm_state building and task_state spawning.
Aug 09 18:23:44 user nova-compute[72418]: DEBUG nova.compute.manager [req-bbf79617-666e-4990-b10b-7b10cfe09c85 req-fa4e97df-ea21-48c1-ac95-f8502786d37e service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received event network-vif-plugged-92f457ac-3ac1-426a-ac45-854d9e2ca180 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:23:44 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-bbf79617-666e-4990-b10b-7b10cfe09c85 req-fa4e97df-ea21-48c1-ac95-f8502786d37e service nova] Acquiring lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:23:44 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-bbf79617-666e-4990-b10b-7b10cfe09c85 req-fa4e97df-ea21-48c1-ac95-f8502786d37e service nova] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:23:44 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-bbf79617-666e-4990-b10b-7b10cfe09c85 req-fa4e97df-ea21-48c1-ac95-f8502786d37e service nova] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:23:44 user nova-compute[72418]: DEBUG nova.compute.manager [req-bbf79617-666e-4990-b10b-7b10cfe09c85 req-fa4e97df-ea21-48c1-ac95-f8502786d37e service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] No waiting events found dispatching network-vif-plugged-92f457ac-3ac1-426a-ac45-854d9e2ca180 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:23:44 user nova-compute[72418]: WARNING nova.compute.manager [req-bbf79617-666e-4990-b10b-7b10cfe09c85 req-fa4e97df-ea21-48c1-ac95-f8502786d37e service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received unexpected event network-vif-plugged-92f457ac-3ac1-426a-ac45-854d9e2ca180 for instance with vm_state building and task_state spawning.
Aug 09 18:23:44 user nova-compute[72418]: DEBUG nova.compute.manager [req-bbf79617-666e-4990-b10b-7b10cfe09c85 req-fa4e97df-ea21-48c1-ac95-f8502786d37e service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received event network-vif-plugged-92f457ac-3ac1-426a-ac45-854d9e2ca180 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:23:44 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-bbf79617-666e-4990-b10b-7b10cfe09c85 req-fa4e97df-ea21-48c1-ac95-f8502786d37e service nova] Acquiring lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:23:44 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-bbf79617-666e-4990-b10b-7b10cfe09c85 req-fa4e97df-ea21-48c1-ac95-f8502786d37e service nova] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:23:44 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-bbf79617-666e-4990-b10b-7b10cfe09c85 req-fa4e97df-ea21-48c1-ac95-f8502786d37e service nova] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:23:44 user nova-compute[72418]: DEBUG nova.compute.manager [req-bbf79617-666e-4990-b10b-7b10cfe09c85 req-fa4e97df-ea21-48c1-ac95-f8502786d37e service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] No waiting events found dispatching network-vif-plugged-92f457ac-3ac1-426a-ac45-854d9e2ca180 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:23:44 user nova-compute[72418]: WARNING nova.compute.manager [req-bbf79617-666e-4990-b10b-7b10cfe09c85 req-fa4e97df-ea21-48c1-ac95-f8502786d37e service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received unexpected event network-vif-plugged-92f457ac-3ac1-426a-ac45-854d9e2ca180 for instance with vm_state building and task_state spawning.
Aug 09 18:23:44 user nova-compute[72418]: DEBUG nova.compute.manager [req-bbf79617-666e-4990-b10b-7b10cfe09c85 req-fa4e97df-ea21-48c1-ac95-f8502786d37e service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received event network-vif-plugged-a0900115-d746-4910-aafd-a6da02efe287 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:23:44 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-bbf79617-666e-4990-b10b-7b10cfe09c85 req-fa4e97df-ea21-48c1-ac95-f8502786d37e service nova] Acquiring lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:23:44 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-bbf79617-666e-4990-b10b-7b10cfe09c85 req-fa4e97df-ea21-48c1-ac95-f8502786d37e service nova] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:23:44 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-bbf79617-666e-4990-b10b-7b10cfe09c85 req-fa4e97df-ea21-48c1-ac95-f8502786d37e service nova] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:23:44 user nova-compute[72418]: DEBUG nova.compute.manager [req-bbf79617-666e-4990-b10b-7b10cfe09c85 req-fa4e97df-ea21-48c1-ac95-f8502786d37e service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] No waiting events found dispatching network-vif-plugged-a0900115-d746-4910-aafd-a6da02efe287 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:23:44 user nova-compute[72418]: WARNING nova.compute.manager [req-bbf79617-666e-4990-b10b-7b10cfe09c85 req-fa4e97df-ea21-48c1-ac95-f8502786d37e service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received unexpected event network-vif-plugged-a0900115-d746-4910-aafd-a6da02efe287 for instance with vm_state building and task_state spawning.
Aug 09 18:23:44 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:44 user nova-compute[72418]: DEBUG nova.compute.manager [None req-b1622bcf-d0cc-4382-8dfb-486790a4d5c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:23:44 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:44 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:44 user nova-compute[72418]: DEBUG nova.network.neutron [None req-229a0aed-3832-4bda-b5cd-96705da51f9b tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Updating instance_info_cache with network_info: [{"id": "1487cbc0-54ec-4134-9e08-88f02ff870f5", "address": "fa:16:3e:b3:6b:21", "network": {"id": "15a49d9b-3c0d-449b-9473-29f219960e2c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c68622cd79472ba6ad14a6876aeaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1487cbc0-54", "ovs_interfaceid": "1487cbc0-54ec-4134-9e08-88f02ff870f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:23:44 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-229a0aed-3832-4bda-b5cd-96705da51f9b tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Releasing lock "refresh_cache-01c46b33-6788-44a5-a43c-88ee4acc4d39" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:23:44 user nova-compute[72418]: INFO nova.compute.manager [None req-b1622bcf-d0cc-4382-8dfb-486790a4d5c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] instance snapshotting
Aug 09 18:23:45 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-b1622bcf-d0cc-4382-8dfb-486790a4d5c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Beginning live snapshot process
Aug 09 18:23:45 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:45 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:45 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:45 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:45 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-b1622bcf-d0cc-4382-8dfb-486790a4d5c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json -f qcow2 {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:45 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-b1622bcf-d0cc-4382-8dfb-486790a4d5c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json -f qcow2" returned: 0 in 0.238s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:45 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-b1622bcf-d0cc-4382-8dfb-486790a4d5c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json -f qcow2 {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:45 user nova-compute[72418]: DEBUG nova.compute.manager [req-ff704277-83bf-4274-b4ed-32f04da310e9 req-a1f07f30-0e09-4158-b383-80be88c44dd1 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received event network-vif-plugged-cb99cdec-40f2-4666-bc12-0c825431db5f {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:23:45 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-ff704277-83bf-4274-b4ed-32f04da310e9 req-a1f07f30-0e09-4158-b383-80be88c44dd1 service nova] Acquiring lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:23:45 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-ff704277-83bf-4274-b4ed-32f04da310e9 req-a1f07f30-0e09-4158-b383-80be88c44dd1 service nova] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:23:45 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-ff704277-83bf-4274-b4ed-32f04da310e9 req-a1f07f30-0e09-4158-b383-80be88c44dd1 service nova] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:23:45 user nova-compute[72418]: DEBUG nova.compute.manager [req-ff704277-83bf-4274-b4ed-32f04da310e9 req-a1f07f30-0e09-4158-b383-80be88c44dd1 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] No waiting events found dispatching network-vif-plugged-cb99cdec-40f2-4666-bc12-0c825431db5f {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:23:45 user nova-compute[72418]: WARNING nova.compute.manager [req-ff704277-83bf-4274-b4ed-32f04da310e9 req-a1f07f30-0e09-4158-b383-80be88c44dd1 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received unexpected event network-vif-plugged-cb99cdec-40f2-4666-bc12-0c825431db5f for instance with vm_state building and task_state spawning.
Aug 09 18:23:45 user nova-compute[72418]: DEBUG nova.compute.manager [req-ff704277-83bf-4274-b4ed-32f04da310e9 req-a1f07f30-0e09-4158-b383-80be88c44dd1 service nova] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Received event network-vif-unplugged-1487cbc0-54ec-4134-9e08-88f02ff870f5 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:23:45 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-ff704277-83bf-4274-b4ed-32f04da310e9 req-a1f07f30-0e09-4158-b383-80be88c44dd1 service nova] Acquiring lock "01c46b33-6788-44a5-a43c-88ee4acc4d39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:23:45 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-ff704277-83bf-4274-b4ed-32f04da310e9 req-a1f07f30-0e09-4158-b383-80be88c44dd1 service nova] Lock "01c46b33-6788-44a5-a43c-88ee4acc4d39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:23:45 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-ff704277-83bf-4274-b4ed-32f04da310e9 req-a1f07f30-0e09-4158-b383-80be88c44dd1 service nova] Lock "01c46b33-6788-44a5-a43c-88ee4acc4d39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:23:45 user nova-compute[72418]: DEBUG nova.compute.manager [req-ff704277-83bf-4274-b4ed-32f04da310e9 req-a1f07f30-0e09-4158-b383-80be88c44dd1 service nova] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] No waiting events found dispatching network-vif-unplugged-1487cbc0-54ec-4134-9e08-88f02ff870f5 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:23:45 user nova-compute[72418]: WARNING nova.compute.manager [req-ff704277-83bf-4274-b4ed-32f04da310e9 req-a1f07f30-0e09-4158-b383-80be88c44dd1 service nova] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Received unexpected event network-vif-unplugged-1487cbc0-54ec-4134-9e08-88f02ff870f5 for instance with vm_state active and task_state rescuing.
Aug 09 18:23:45 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-b1622bcf-d0cc-4382-8dfb-486790a4d5c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json -f qcow2" returned: 0 in 0.178s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:45 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-b1622bcf-d0cc-4382-8dfb-486790a4d5c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:45 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:23:45 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:23:45 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:23:45 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:23:45 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72418) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 18:23:45 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Instance destroyed successfully.
Aug 09 18:23:45 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-b1622bcf-d0cc-4382-8dfb-486790a4d5c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.234s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:45 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-b1622bcf-d0cc-4382-8dfb-486790a4d5c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpj640dzxg/25564414fe944b3e963ef1bab2057e88.delta 1073741824 {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:46 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-229a0aed-3832-4bda-b5cd-96705da51f9b tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Attempting rescue
Aug 09 18:23:46 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-229a0aed-3832-4bda-b5cd-96705da51f9b tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72418) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-229a0aed-3832-4bda-b5cd-96705da51f9b tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Instance directory exists: not creating {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 18:23:46 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-229a0aed-3832-4bda-b5cd-96705da51f9b tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Creating image(s)
Aug 09 18:23:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-229a0aed-3832-4bda-b5cd-96705da51f9b tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Acquiring lock "/opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-229a0aed-3832-4bda-b5cd-96705da51f9b tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "/opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-229a0aed-3832-4bda-b5cd-96705da51f9b tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "/opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG nova.objects.instance [None req-229a0aed-3832-4bda-b5cd-96705da51f9b tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lazy-loading 'trusted_certs' on Instance uuid 01c46b33-6788-44a5-a43c-88ee4acc4d39 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-b1622bcf-d0cc-4382-8dfb-486790a4d5c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpj640dzxg/25564414fe944b3e963ef1bab2057e88.delta 1073741824" returned: 0 in 0.077s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:46 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-b1622bcf-d0cc-4382-8dfb-486790a4d5c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 09 18:23:46 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-b1622bcf-d0cc-4382-8dfb-486790a4d5c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Checking UEFI support for host arch (x86_64) {{(pid=72418) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 09 18:23:46 user nova-compute[72418]: INFO nova.virt.libvirt.host [None req-b1622bcf-d0cc-4382-8dfb-486790a4d5c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] UEFI support detected
Aug 09 18:23:46 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-229a0aed-3832-4bda-b5cd-96705da51f9b tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Acquiring lock "458773cfa7230b717e41c60277832e9f83806d71" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-229a0aed-3832-4bda-b5cd-96705da51f9b tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-229a0aed-3832-4bda-b5cd-96705da51f9b tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Acquiring lock "aab087ae-c46e-46c8-baa0-d754dc29947f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Lock "aab087ae-c46e-46c8-baa0-d754dc29947f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG nova.compute.manager [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Starting instance... {{(pid=72418) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-229a0aed-3832-4bda-b5cd-96705da51f9b tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.224s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-229a0aed-3832-4bda-b5cd-96705da51f9b tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-229a0aed-3832-4bda-b5cd-96705da51f9b tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue" returned: 0 in 0.069s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-229a0aed-3832-4bda-b5cd-96705da51f9b tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.299s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG nova.objects.instance [None req-229a0aed-3832-4bda-b5cd-96705da51f9b tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lazy-loading 'migration_context' on Instance uuid 01c46b33-6788-44a5-a43c-88ee4acc4d39 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-229a0aed-3832-4bda-b5cd-96705da51f9b tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Created local disks {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-229a0aed-3832-4bda-b5cd-96705da51f9b tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Start _get_guest_xml network_info=[{"id": "1487cbc0-54ec-4134-9e08-88f02ff870f5", "address": "fa:16:3e:b3:6b:21", "network": {"id": "15a49d9b-3c0d-449b-9473-29f219960e2c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "vif_mac": "fa:16:3e:b3:6b:21"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c68622cd79472ba6ad14a6876aeaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1487cbc0-54", "ovs_interfaceid": "1487cbc0-54ec-4134-9e08-88f02ff870f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG nova.objects.instance [None req-229a0aed-3832-4bda-b5cd-96705da51f9b tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lazy-loading 'resources' on Instance uuid 01c46b33-6788-44a5-a43c-88ee4acc4d39 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72418) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 18:23:46 user nova-compute[72418]: INFO nova.compute.claims [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Claim successful on node user
Aug 09 18:23:46 user nova-compute[72418]: DEBUG nova.objects.instance [None req-229a0aed-3832-4bda-b5cd-96705da51f9b tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lazy-loading 'numa_topology' on Instance uuid 01c46b33-6788-44a5-a43c-88ee4acc4d39 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:23:46 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-229a0aed-3832-4bda-b5cd-96705da51f9b tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:23:46 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-229a0aed-3832-4bda-b5cd-96705da51f9b tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:23:46 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-229a0aed-3832-4bda-b5cd-96705da51f9b tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-229a0aed-3832-4bda-b5cd-96705da51f9b tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] CPU controller missing on host. {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-229a0aed-3832-4bda-b5cd-96705da51f9b tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-229a0aed-3832-4bda-b5cd-96705da51f9b tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] CPU controller found on host. {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-229a0aed-3832-4bda-b5cd-96705da51f9b tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72418) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-229a0aed-3832-4bda-b5cd-96705da51f9b tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T18:17:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-229a0aed-3832-4bda-b5cd-96705da51f9b tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Flavor limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-229a0aed-3832-4bda-b5cd-96705da51f9b tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Image limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-229a0aed-3832-4bda-b5cd-96705da51f9b tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Flavor pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-229a0aed-3832-4bda-b5cd-96705da51f9b tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Image pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-229a0aed-3832-4bda-b5cd-96705da51f9b tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-229a0aed-3832-4bda-b5cd-96705da51f9b tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-229a0aed-3832-4bda-b5cd-96705da51f9b tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-229a0aed-3832-4bda-b5cd-96705da51f9b tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Got 1 possible topologies {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-229a0aed-3832-4bda-b5cd-96705da51f9b tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-229a0aed-3832-4bda-b5cd-96705da51f9b tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG nova.objects.instance [None req-229a0aed-3832-4bda-b5cd-96705da51f9b tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lazy-loading 'vcpu_model' on Instance uuid 01c46b33-6788-44a5-a43c-88ee4acc4d39 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-229a0aed-3832-4bda-b5cd-96705da51f9b tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:21:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1456004149',display_name='tempest-ServerRescueNegativeTestJSON-server-1456004149',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1456004149',id=4,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:22:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5c68622cd79472ba6ad14a6876aeaea',ramdisk_id='',reservation_id='r-jh195jvw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-326572915',owner_user_name='tempest-ServerRescueNegativeTestJSON-326572915-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:22:15Z,user_data=None,user_id='b3c4feb0a14841eeb757a79b6a05d1fa',uuid=01c46b33-6788-44a5-a43c-88ee4acc4d39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1487cbc0-54ec-4134-9e08-88f02ff870f5", "address": "fa:16:3e:b3:6b:21", "network": {"id": "15a49d9b-3c0d-449b-9473-29f219960e2c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "vif_mac": "fa:16:3e:b3:6b:21"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c68622cd79472ba6ad14a6876aeaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1487cbc0-54", "ovs_interfaceid": "1487cbc0-54ec-4134-9e08-88f02ff870f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-229a0aed-3832-4bda-b5cd-96705da51f9b tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Converting VIF {"id": "1487cbc0-54ec-4134-9e08-88f02ff870f5", "address": "fa:16:3e:b3:6b:21", "network": {"id": "15a49d9b-3c0d-449b-9473-29f219960e2c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "vif_mac": "fa:16:3e:b3:6b:21"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c68622cd79472ba6ad14a6876aeaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1487cbc0-54", "ovs_interfaceid": "1487cbc0-54ec-4134-9e08-88f02ff870f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-229a0aed-3832-4bda-b5cd-96705da51f9b tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:6b:21,bridge_name='br-int',has_traffic_filtering=True,id=1487cbc0-54ec-4134-9e08-88f02ff870f5,network=Network(15a49d9b-3c0d-449b-9473-29f219960e2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1487cbc0-54') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG nova.objects.instance [None req-229a0aed-3832-4bda-b5cd-96705da51f9b tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lazy-loading 'pci_devices' on Instance uuid 01c46b33-6788-44a5-a43c-88ee4acc4d39 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG nova.compute.manager [req-413a81a0-ff12-4d6c-abdc-454f61ba9443 req-d4d03454-fc69-4cda-a04f-75baa864ed39 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received event network-vif-plugged-a0900115-d746-4910-aafd-a6da02efe287 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-413a81a0-ff12-4d6c-abdc-454f61ba9443 req-d4d03454-fc69-4cda-a04f-75baa864ed39 service nova] Acquiring lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-413a81a0-ff12-4d6c-abdc-454f61ba9443 req-d4d03454-fc69-4cda-a04f-75baa864ed39 service nova] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-413a81a0-ff12-4d6c-abdc-454f61ba9443 req-d4d03454-fc69-4cda-a04f-75baa864ed39 service nova] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG nova.compute.manager [req-413a81a0-ff12-4d6c-abdc-454f61ba9443 req-d4d03454-fc69-4cda-a04f-75baa864ed39 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] No waiting events found dispatching network-vif-plugged-a0900115-d746-4910-aafd-a6da02efe287 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:23:46 user nova-compute[72418]: WARNING nova.compute.manager [req-413a81a0-ff12-4d6c-abdc-454f61ba9443 req-d4d03454-fc69-4cda-a04f-75baa864ed39 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received unexpected event network-vif-plugged-a0900115-d746-4910-aafd-a6da02efe287 for instance with vm_state building and task_state spawning.
Aug 09 18:23:46 user nova-compute[72418]: DEBUG nova.compute.manager [req-413a81a0-ff12-4d6c-abdc-454f61ba9443 req-d4d03454-fc69-4cda-a04f-75baa864ed39 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received event network-vif-plugged-af01e732-21ed-4815-842e-90e7b3591398 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-413a81a0-ff12-4d6c-abdc-454f61ba9443 req-d4d03454-fc69-4cda-a04f-75baa864ed39 service nova] Acquiring lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-413a81a0-ff12-4d6c-abdc-454f61ba9443 req-d4d03454-fc69-4cda-a04f-75baa864ed39 service nova] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-413a81a0-ff12-4d6c-abdc-454f61ba9443 req-d4d03454-fc69-4cda-a04f-75baa864ed39 service nova] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG nova.compute.manager [req-413a81a0-ff12-4d6c-abdc-454f61ba9443 req-d4d03454-fc69-4cda-a04f-75baa864ed39 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] No waiting events found dispatching network-vif-plugged-af01e732-21ed-4815-842e-90e7b3591398 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:23:46 user nova-compute[72418]: WARNING nova.compute.manager [req-413a81a0-ff12-4d6c-abdc-454f61ba9443 req-d4d03454-fc69-4cda-a04f-75baa864ed39 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received unexpected event network-vif-plugged-af01e732-21ed-4815-842e-90e7b3591398 for instance with vm_state building and task_state spawning.
Aug 09 18:23:46 user nova-compute[72418]: DEBUG nova.compute.manager [req-413a81a0-ff12-4d6c-abdc-454f61ba9443 req-d4d03454-fc69-4cda-a04f-75baa864ed39 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received event network-vif-plugged-af01e732-21ed-4815-842e-90e7b3591398 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-413a81a0-ff12-4d6c-abdc-454f61ba9443 req-d4d03454-fc69-4cda-a04f-75baa864ed39 service nova] Acquiring lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-413a81a0-ff12-4d6c-abdc-454f61ba9443 req-d4d03454-fc69-4cda-a04f-75baa864ed39 service nova] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-413a81a0-ff12-4d6c-abdc-454f61ba9443 req-d4d03454-fc69-4cda-a04f-75baa864ed39 service nova] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG nova.compute.manager [req-413a81a0-ff12-4d6c-abdc-454f61ba9443 req-d4d03454-fc69-4cda-a04f-75baa864ed39 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] No waiting events found dispatching network-vif-plugged-af01e732-21ed-4815-842e-90e7b3591398 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:23:46 user nova-compute[72418]: WARNING nova.compute.manager [req-413a81a0-ff12-4d6c-abdc-454f61ba9443 req-d4d03454-fc69-4cda-a04f-75baa864ed39 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received unexpected event network-vif-plugged-af01e732-21ed-4815-842e-90e7b3591398 for instance with vm_state building and task_state spawning.
Aug 09 18:23:46 user nova-compute[72418]: DEBUG nova.compute.manager [req-413a81a0-ff12-4d6c-abdc-454f61ba9443 req-d4d03454-fc69-4cda-a04f-75baa864ed39 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received event network-vif-plugged-692db581-bf1f-4295-a18d-65ab40120c7a {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-413a81a0-ff12-4d6c-abdc-454f61ba9443 req-d4d03454-fc69-4cda-a04f-75baa864ed39 service nova] Acquiring lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-413a81a0-ff12-4d6c-abdc-454f61ba9443 req-d4d03454-fc69-4cda-a04f-75baa864ed39 service nova] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-413a81a0-ff12-4d6c-abdc-454f61ba9443 req-d4d03454-fc69-4cda-a04f-75baa864ed39 service nova] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG nova.compute.manager [req-413a81a0-ff12-4d6c-abdc-454f61ba9443 req-d4d03454-fc69-4cda-a04f-75baa864ed39 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] No waiting events found dispatching network-vif-plugged-692db581-bf1f-4295-a18d-65ab40120c7a {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:23:46 user nova-compute[72418]: WARNING nova.compute.manager [req-413a81a0-ff12-4d6c-abdc-454f61ba9443 req-d4d03454-fc69-4cda-a04f-75baa864ed39 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received unexpected event network-vif-plugged-692db581-bf1f-4295-a18d-65ab40120c7a for instance with vm_state building and task_state spawning.
Aug 09 18:23:46 user nova-compute[72418]: DEBUG nova.compute.manager [req-413a81a0-ff12-4d6c-abdc-454f61ba9443 req-d4d03454-fc69-4cda-a04f-75baa864ed39 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received event network-vif-plugged-692db581-bf1f-4295-a18d-65ab40120c7a {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-413a81a0-ff12-4d6c-abdc-454f61ba9443 req-d4d03454-fc69-4cda-a04f-75baa864ed39 service nova] Acquiring lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-413a81a0-ff12-4d6c-abdc-454f61ba9443 req-d4d03454-fc69-4cda-a04f-75baa864ed39 service nova] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-413a81a0-ff12-4d6c-abdc-454f61ba9443 req-d4d03454-fc69-4cda-a04f-75baa864ed39 service nova] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG nova.compute.manager [req-413a81a0-ff12-4d6c-abdc-454f61ba9443 req-d4d03454-fc69-4cda-a04f-75baa864ed39 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] No waiting events found dispatching network-vif-plugged-692db581-bf1f-4295-a18d-65ab40120c7a {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:23:46 user nova-compute[72418]: WARNING nova.compute.manager [req-413a81a0-ff12-4d6c-abdc-454f61ba9443 req-d4d03454-fc69-4cda-a04f-75baa864ed39 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received unexpected event network-vif-plugged-692db581-bf1f-4295-a18d-65ab40120c7a for instance with vm_state building and task_state spawning.
Aug 09 18:23:46 user nova-compute[72418]: DEBUG nova.compute.manager [req-413a81a0-ff12-4d6c-abdc-454f61ba9443 req-d4d03454-fc69-4cda-a04f-75baa864ed39 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received event network-vif-plugged-875b1fd5-6595-48dc-83b1-95ebeee70bb2 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-413a81a0-ff12-4d6c-abdc-454f61ba9443 req-d4d03454-fc69-4cda-a04f-75baa864ed39 service nova] Acquiring lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-413a81a0-ff12-4d6c-abdc-454f61ba9443 req-d4d03454-fc69-4cda-a04f-75baa864ed39 service nova] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-413a81a0-ff12-4d6c-abdc-454f61ba9443 req-d4d03454-fc69-4cda-a04f-75baa864ed39 service nova] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG nova.compute.manager [req-413a81a0-ff12-4d6c-abdc-454f61ba9443 req-d4d03454-fc69-4cda-a04f-75baa864ed39 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] No waiting events found dispatching network-vif-plugged-875b1fd5-6595-48dc-83b1-95ebeee70bb2 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:23:46 user nova-compute[72418]: WARNING nova.compute.manager [req-413a81a0-ff12-4d6c-abdc-454f61ba9443 req-d4d03454-fc69-4cda-a04f-75baa864ed39 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received unexpected event network-vif-plugged-875b1fd5-6595-48dc-83b1-95ebeee70bb2 for instance with vm_state building and task_state spawning.
Aug 09 18:23:46 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-229a0aed-3832-4bda-b5cd-96705da51f9b tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] End _get_guest_xml xml=<domain type="kvm">
Aug 09 18:23:46 user nova-compute[72418]:   <uuid>01c46b33-6788-44a5-a43c-88ee4acc4d39</uuid>
Aug 09 18:23:46 user nova-compute[72418]:   <name>instance-00000004</name>
Aug 09 18:23:46 user nova-compute[72418]:   <memory>524288</memory>
Aug 09 18:23:46 user nova-compute[72418]:   <vcpu>1</vcpu>
Aug 09 18:23:46 user nova-compute[72418]:   <metadata>
Aug 09 18:23:46 user nova-compute[72418]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:23:46 user nova-compute[72418]:       <nova:package version="0.0.0"/>
Aug 09 18:23:46 user nova-compute[72418]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1456004149</nova:name>
Aug 09 18:23:46 user nova-compute[72418]:       <nova:creationTime>2023-08-09 18:23:46</nova:creationTime>
Aug 09 18:23:46 user nova-compute[72418]:       <nova:flavor name="m1.tiny">
Aug 09 18:23:46 user nova-compute[72418]:         <nova:memory>512</nova:memory>
Aug 09 18:23:46 user nova-compute[72418]:         <nova:disk>1</nova:disk>
Aug 09 18:23:46 user nova-compute[72418]:         <nova:swap>0</nova:swap>
Aug 09 18:23:46 user nova-compute[72418]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:23:46 user nova-compute[72418]:         <nova:vcpus>1</nova:vcpus>
Aug 09 18:23:46 user nova-compute[72418]:       </nova:flavor>
Aug 09 18:23:46 user nova-compute[72418]:       <nova:owner>
Aug 09 18:23:46 user nova-compute[72418]:         <nova:user uuid="b3c4feb0a14841eeb757a79b6a05d1fa">tempest-ServerRescueNegativeTestJSON-326572915-project-member</nova:user>
Aug 09 18:23:46 user nova-compute[72418]:         <nova:project uuid="b5c68622cd79472ba6ad14a6876aeaea">tempest-ServerRescueNegativeTestJSON-326572915</nova:project>
Aug 09 18:23:46 user nova-compute[72418]:       </nova:owner>
Aug 09 18:23:46 user nova-compute[72418]:       <nova:root type="image" uuid="8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e"/>
Aug 09 18:23:46 user nova-compute[72418]:       <nova:ports>
Aug 09 18:23:46 user nova-compute[72418]:         <nova:port uuid="1487cbc0-54ec-4134-9e08-88f02ff870f5">
Aug 09 18:23:46 user nova-compute[72418]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 18:23:46 user nova-compute[72418]:         </nova:port>
Aug 09 18:23:46 user nova-compute[72418]:       </nova:ports>
Aug 09 18:23:46 user nova-compute[72418]:     </nova:instance>
Aug 09 18:23:46 user nova-compute[72418]:   </metadata>
Aug 09 18:23:46 user nova-compute[72418]:   <sysinfo type="smbios">
Aug 09 18:23:46 user nova-compute[72418]:     <system>
Aug 09 18:23:46 user nova-compute[72418]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 18:23:46 user nova-compute[72418]:       <entry name="product">OpenStack Nova</entry>
Aug 09 18:23:46 user nova-compute[72418]:       <entry name="version">0.0.0</entry>
Aug 09 18:23:46 user nova-compute[72418]:       <entry name="serial">01c46b33-6788-44a5-a43c-88ee4acc4d39</entry>
Aug 09 18:23:46 user nova-compute[72418]:       <entry name="uuid">01c46b33-6788-44a5-a43c-88ee4acc4d39</entry>
Aug 09 18:23:46 user nova-compute[72418]:       <entry name="family">Virtual Machine</entry>
Aug 09 18:23:46 user nova-compute[72418]:     </system>
Aug 09 18:23:46 user nova-compute[72418]:   </sysinfo>
Aug 09 18:23:46 user nova-compute[72418]:   <os>
Aug 09 18:23:46 user nova-compute[72418]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 18:23:46 user nova-compute[72418]:     <smbios mode="sysinfo"/>
Aug 09 18:23:46 user nova-compute[72418]:   </os>
Aug 09 18:23:46 user nova-compute[72418]:   <features>
Aug 09 18:23:46 user nova-compute[72418]:     <acpi/>
Aug 09 18:23:46 user nova-compute[72418]:     <apic/>
Aug 09 18:23:46 user nova-compute[72418]:     <vmcoreinfo/>
Aug 09 18:23:46 user nova-compute[72418]:   </features>
Aug 09 18:23:46 user nova-compute[72418]:   <clock offset="utc">
Aug 09 18:23:46 user nova-compute[72418]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 18:23:46 user nova-compute[72418]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 18:23:46 user nova-compute[72418]:     <timer name="hpet" present="no"/>
Aug 09 18:23:46 user nova-compute[72418]:   </clock>
Aug 09 18:23:46 user nova-compute[72418]:   <cpu mode="custom" match="exact">
Aug 09 18:23:46 user nova-compute[72418]:     <model>Nehalem</model>
Aug 09 18:23:46 user nova-compute[72418]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 18:23:46 user nova-compute[72418]:   </cpu>
Aug 09 18:23:46 user nova-compute[72418]:   <devices>
Aug 09 18:23:46 user nova-compute[72418]:     <disk type="file" device="disk">
Aug 09 18:23:46 user nova-compute[72418]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 18:23:46 user nova-compute[72418]:       <source file="/opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue"/>
Aug 09 18:23:46 user nova-compute[72418]:       <target dev="vda" bus="virtio"/>
Aug 09 18:23:46 user nova-compute[72418]:     </disk>
Aug 09 18:23:46 user nova-compute[72418]:     <disk type="file" device="disk">
Aug 09 18:23:46 user nova-compute[72418]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 18:23:46 user nova-compute[72418]:       <source file="/opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk"/>
Aug 09 18:23:46 user nova-compute[72418]:       <target dev="vdb" bus="virtio"/>
Aug 09 18:23:46 user nova-compute[72418]:     </disk>
Aug 09 18:23:46 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:23:46 user nova-compute[72418]:       <mac address="fa:16:3e:b3:6b:21"/>
Aug 09 18:23:46 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:23:46 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:23:46 user nova-compute[72418]:       <target dev="tap1487cbc0-54"/>
Aug 09 18:23:46 user nova-compute[72418]:     </interface>
Aug 09 18:23:46 user nova-compute[72418]:     <serial type="pty">
Aug 09 18:23:46 user nova-compute[72418]:       <log file="/opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/console.log" append="off"/>
Aug 09 18:23:46 user nova-compute[72418]:     </serial>
Aug 09 18:23:46 user nova-compute[72418]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 18:23:46 user nova-compute[72418]:     <video>
Aug 09 18:23:46 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:23:46 user nova-compute[72418]:     </video>
Aug 09 18:23:46 user nova-compute[72418]:     <rng model="virtio">
Aug 09 18:23:46 user nova-compute[72418]:       <backend model="random">/dev/urandom</backend>
Aug 09 18:23:46 user nova-compute[72418]:     </rng>
Aug 09 18:23:46 user nova-compute[72418]:     <controller type="usb" index="0" model="none"/>
Aug 09 18:23:46 user nova-compute[72418]:     <memballoon model="virtio">
Aug 09 18:23:46 user nova-compute[72418]:       <stats period="10"/>
Aug 09 18:23:46 user nova-compute[72418]:     </memballoon>
Aug 09 18:23:46 user nova-compute[72418]:   </devices>
Aug 09 18:23:46 user nova-compute[72418]: </domain>
Aug 09 18:23:46 user nova-compute[72418]:  {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 18:23:46 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Instance destroyed successfully.
Aug 09 18:23:46 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-b1622bcf-d0cc-4382-8dfb-486790a4d5c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72418) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-229a0aed-3832-4bda-b5cd-96705da51f9b tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-229a0aed-3832-4bda-b5cd-96705da51f9b tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-229a0aed-3832-4bda-b5cd-96705da51f9b tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] No VIF found with MAC fa:16:3e:b3:6b:21, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:23:46 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:47 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:47 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605427.2060084, 2b284735-40f6-403f-8c72-a70a4da1ef95 => Resumed> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:23:47 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] VM Resumed (Lifecycle Event)
Aug 09 18:23:47 user nova-compute[72418]: DEBUG nova.compute.manager [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Instance event wait completed in 0 seconds for  {{(pid=72418) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 18:23:47 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Guest created on hypervisor {{(pid=72418) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 18:23:47 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:23:47 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:23:47 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Instance spawned successfully.
Aug 09 18:23:47 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 18:23:47 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:23:47 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:23:47 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Found default for hw_cdrom_bus of ide {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:23:47 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Found default for hw_disk_bus of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:23:47 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Found default for hw_input_bus of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:23:47 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Found default for hw_pointer_model of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:23:47 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Found default for hw_video_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:23:47 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Found default for hw_vif_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:23:47 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-b1622bcf-d0cc-4382-8dfb-486790a4d5c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] COPY block job progress, current cursor: 75169792 final cursor: 75497472 {{(pid=72418) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 18:23:47 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:23:47 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605427.2088091, 2b284735-40f6-403f-8c72-a70a4da1ef95 => Started> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:23:47 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] VM Started (Lifecycle Event)
Aug 09 18:23:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.031s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:23:47 user nova-compute[72418]: DEBUG nova.compute.manager [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Start building networks asynchronously for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 18:23:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.470s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:23:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:23:47 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Auditing locally available compute resources for user (node: user) {{(pid=72418) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 18:23:47 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:23:47 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:23:47 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:23:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-bc9dc48a-2dd4-49a1-aff2-0dea277e3ff8 tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Acquiring lock "17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:23:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-bc9dc48a-2dd4-49a1-aff2-0dea277e3ff8 tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Lock "17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:23:47 user nova-compute[72418]: INFO nova.compute.manager [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Took 12.50 seconds to spawn the instance on the hypervisor.
Aug 09 18:23:47 user nova-compute[72418]: DEBUG nova.compute.manager [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:23:47 user nova-compute[72418]: DEBUG nova.objects.instance [None req-bc9dc48a-2dd4-49a1-aff2-0dea277e3ff8 tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Lazy-loading 'flavor' on Instance uuid 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:23:47 user nova-compute[72418]: DEBUG nova.compute.manager [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Allocating IP information in the background. {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 18:23:47 user nova-compute[72418]: DEBUG nova.network.neutron [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] allocate_for_instance() {{(pid=72418) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 18:23:47 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 18:23:47 user nova-compute[72418]: DEBUG nova.compute.manager [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Start building block device mappings for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 18:23:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-bc9dc48a-2dd4-49a1-aff2-0dea277e3ff8 tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Lock "17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.093s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:23:47 user nova-compute[72418]: INFO nova.compute.manager [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Took 41.33 seconds to build instance.
Aug 09 18:23:47 user nova-compute[72418]: DEBUG nova.compute.manager [req-fa4ccbea-ee45-40bc-bab5-30d62f9f951c req-2cadcc9e-fd22-4261-a970-98a20bf24d18 service nova] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Received event network-vif-plugged-1487cbc0-54ec-4134-9e08-88f02ff870f5 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:23:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-fa4ccbea-ee45-40bc-bab5-30d62f9f951c req-2cadcc9e-fd22-4261-a970-98a20bf24d18 service nova] Acquiring lock "01c46b33-6788-44a5-a43c-88ee4acc4d39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:23:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-fa4ccbea-ee45-40bc-bab5-30d62f9f951c req-2cadcc9e-fd22-4261-a970-98a20bf24d18 service nova] Lock "01c46b33-6788-44a5-a43c-88ee4acc4d39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:23:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-fa4ccbea-ee45-40bc-bab5-30d62f9f951c req-2cadcc9e-fd22-4261-a970-98a20bf24d18 service nova] Lock "01c46b33-6788-44a5-a43c-88ee4acc4d39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:23:47 user nova-compute[72418]: DEBUG nova.compute.manager [req-fa4ccbea-ee45-40bc-bab5-30d62f9f951c req-2cadcc9e-fd22-4261-a970-98a20bf24d18 service nova] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] No waiting events found dispatching network-vif-plugged-1487cbc0-54ec-4134-9e08-88f02ff870f5 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:23:47 user nova-compute[72418]: WARNING nova.compute.manager [req-fa4ccbea-ee45-40bc-bab5-30d62f9f951c req-2cadcc9e-fd22-4261-a970-98a20bf24d18 service nova] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Received unexpected event network-vif-plugged-1487cbc0-54ec-4134-9e08-88f02ff870f5 for instance with vm_state active and task_state rescuing.
Aug 09 18:23:47 user nova-compute[72418]: DEBUG nova.policy [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6e1439f58ac640f481a59944ee145f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60e3274c2e3447fcad6d1f16765f4afd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72418) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 18:23:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-b6aaf6a9-4bc9-43f3-8076-bf1a84edd95e tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 41.497s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:23:47 user nova-compute[72418]: DEBUG nova.compute.manager [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Start spawning the instance on the hypervisor. {{(pid=72418) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 18:23:47 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Creating instance directory {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 18:23:47 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Creating image(s)
Aug 09 18:23:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Acquiring lock "/opt/stack/data/nova/instances/aab087ae-c46e-46c8-baa0-d754dc29947f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:23:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Lock "/opt/stack/data/nova/instances/aab087ae-c46e-46c8-baa0-d754dc29947f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:23:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Lock "/opt/stack/data/nova/instances/aab087ae-c46e-46c8-baa0-d754dc29947f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:23:47 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-bc9dc48a-2dd4-49a1-aff2-0dea277e3ff8 tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Acquiring lock "17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:23:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-bc9dc48a-2dd4-49a1-aff2-0dea277e3ff8 tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Lock "17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:23:47 user nova-compute[72418]: INFO nova.compute.manager [None req-bc9dc48a-2dd4-49a1-aff2-0dea277e3ff8 tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Attaching volume b4525421-c0f1-4a81-8cfc-a10b31dcf187 to /dev/vdb
Aug 09 18:23:47 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-b1622bcf-d0cc-4382-8dfb-486790a4d5c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72418) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 18:23:47 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-b1622bcf-d0cc-4382-8dfb-486790a4d5c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 09 18:23:47 user nova-compute[72418]: DEBUG os_brick.utils [None req-bc9dc48a-2dd4-49a1-aff2-0dea277e3ff8 tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:23:47 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:47 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:47 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52bf68c-b111-4ba4-aa82-f04623a00837]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ad56b243ad71\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:47 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:47 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.200s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Acquiring lock "458773cfa7230b717e41c60277832e9f83806d71" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:23:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:23:47 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:48 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[471cdaa9-2c4f-4cb8-97e5-6aea176da50f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:48 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb13f27-929b-43b1-8e88-39fbde7dda78]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:48 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[55af8b21-dbe2-4b7c-942e-eb4b09f1029f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-bc9dc48a-2dd4-49a1-aff2-0dea277e3ff8 tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Running cmd (subprocess): nvme version {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-bc9dc48a-2dd4-49a1-aff2-0dea277e3ff8 tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] 'nvme version' failed. Not Retrying. {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:23:48 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bc9dc48a-2dd4-49a1-aff2-0dea277e3ff8 tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] nvme not present on system {{(pid=72418) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 18:23:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:23:48 user nova-compute[72418]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 18:23:48 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e813ebf-d00e-46cd-8b02-a86b8e437d2c]: (4, '') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:48 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-bc9dc48a-2dd4-49a1-aff2-0dea277e3ff8 tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72418) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 18:23:48 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-bc9dc48a-2dd4-49a1-aff2-0dea277e3ff8 tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 18:23:48 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-bc9dc48a-2dd4-49a1-aff2-0dea277e3ff8 tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] LIGHTOS: no hostnqn found. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 18:23:48 user nova-compute[72418]: DEBUG os_brick.utils [None req-bc9dc48a-2dd4-49a1-aff2-0dea277e3ff8 tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] <== get_connector_properties: return (187ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ad56b243ad71', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:23:48 user nova-compute[72418]: DEBUG nova.virt.block_device [None req-bc9dc48a-2dd4-49a1-aff2-0dea277e3ff8 tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Updating existing volume attachment record: a5bdc1b2-7e0f-4dbc-be14-04285758b9e6 {{(pid=72418) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 18:23:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.172s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/aab087ae-c46e-46c8-baa0-d754dc29947f/disk 1073741824 {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/aab087ae-c46e-46c8-baa0-d754dc29947f/disk 1073741824" returned: 0 in 0.067s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:48 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:23:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:48 user nova-compute[72418]: DEBUG nova.privsep.utils [None req-b1622bcf-d0cc-4382-8dfb-486790a4d5c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72418) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 18:23:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-b1622bcf-d0cc-4382-8dfb-486790a4d5c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpj640dzxg/25564414fe944b3e963ef1bab2057e88.delta /opt/stack/data/nova/instances/snapshots/tmpj640dzxg/25564414fe944b3e963ef1bab2057e88 {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:48 user nova-compute[72418]: DEBUG nova.network.neutron [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Successfully created port: 0eba7184-d598-4e94-aefc-d1f1cbf63046 {{(pid=72418) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 18:23:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.198s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:48 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aab087ae-c46e-46c8-baa0-d754dc29947f/disk. size=1073741824 {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 18:23:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aab087ae-c46e-46c8-baa0-d754dc29947f/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aab087ae-c46e-46c8-baa0-d754dc29947f/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:48 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Cannot resize image /opt/stack/data/nova/instances/aab087ae-c46e-46c8-baa0-d754dc29947f/disk to a smaller size. {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 18:23:48 user nova-compute[72418]: DEBUG nova.objects.instance [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Lazy-loading 'migration_context' on Instance uuid aab087ae-c46e-46c8-baa0-d754dc29947f {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:23:48 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Created local disks {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 18:23:48 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Ensure instance console log exists: /opt/stack/data/nova/instances/aab087ae-c46e-46c8-baa0-d754dc29947f/console.log {{(pid=72418) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 18:23:48 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:23:48 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:23:48 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:23:48 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:48 user nova-compute[72418]: DEBUG nova.compute.manager [req-ea64ea46-b6f7-47f2-b608-fffca9205eb3 req-516badfe-c437-47b0-9bd5-ce819e8ae36f service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received event network-vif-plugged-875b1fd5-6595-48dc-83b1-95ebeee70bb2 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:23:48 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-ea64ea46-b6f7-47f2-b608-fffca9205eb3 req-516badfe-c437-47b0-9bd5-ce819e8ae36f service nova] Acquiring lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:23:48 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-ea64ea46-b6f7-47f2-b608-fffca9205eb3 req-516badfe-c437-47b0-9bd5-ce819e8ae36f service nova] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:23:48 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-ea64ea46-b6f7-47f2-b608-fffca9205eb3 req-516badfe-c437-47b0-9bd5-ce819e8ae36f service nova] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:23:48 user nova-compute[72418]: DEBUG nova.compute.manager [req-ea64ea46-b6f7-47f2-b608-fffca9205eb3 req-516badfe-c437-47b0-9bd5-ce819e8ae36f service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] No waiting events found dispatching network-vif-plugged-875b1fd5-6595-48dc-83b1-95ebeee70bb2 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:23:48 user nova-compute[72418]: WARNING nova.compute.manager [req-ea64ea46-b6f7-47f2-b608-fffca9205eb3 req-516badfe-c437-47b0-9bd5-ce819e8ae36f service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received unexpected event network-vif-plugged-875b1fd5-6595-48dc-83b1-95ebeee70bb2 for instance with vm_state active and task_state None.
Aug 09 18:23:48 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:48 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-b1622bcf-d0cc-4382-8dfb-486790a4d5c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpj640dzxg/25564414fe944b3e963ef1bab2057e88.delta /opt/stack/data/nova/instances/snapshots/tmpj640dzxg/25564414fe944b3e963ef1bab2057e88" returned: 0 in 0.621s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:48 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-b1622bcf-d0cc-4382-8dfb-486790a4d5c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Snapshot extracted, beginning image upload
Aug 09 18:23:49 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:49 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:49 user nova-compute[72418]: DEBUG nova.compute.manager [req-f0678b19-7939-46ad-8a4c-b6901e154f7d req-7f494324-9a4f-4793-b413-6d14a3454118 service nova] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Received event network-vif-plugged-1487cbc0-54ec-4134-9e08-88f02ff870f5 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:23:49 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-f0678b19-7939-46ad-8a4c-b6901e154f7d req-7f494324-9a4f-4793-b413-6d14a3454118 service nova] Acquiring lock "01c46b33-6788-44a5-a43c-88ee4acc4d39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:23:49 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-f0678b19-7939-46ad-8a4c-b6901e154f7d req-7f494324-9a4f-4793-b413-6d14a3454118 service nova] Lock "01c46b33-6788-44a5-a43c-88ee4acc4d39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:23:49 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-f0678b19-7939-46ad-8a4c-b6901e154f7d req-7f494324-9a4f-4793-b413-6d14a3454118 service nova] Lock "01c46b33-6788-44a5-a43c-88ee4acc4d39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:23:49 user nova-compute[72418]: DEBUG nova.compute.manager [req-f0678b19-7939-46ad-8a4c-b6901e154f7d req-7f494324-9a4f-4793-b413-6d14a3454118 service nova] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] No waiting events found dispatching network-vif-plugged-1487cbc0-54ec-4134-9e08-88f02ff870f5 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:23:49 user nova-compute[72418]: WARNING nova.compute.manager [req-f0678b19-7939-46ad-8a4c-b6901e154f7d req-7f494324-9a4f-4793-b413-6d14a3454118 service nova] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Received unexpected event network-vif-plugged-1487cbc0-54ec-4134-9e08-88f02ff870f5 for instance with vm_state active and task_state rescuing.
Aug 09 18:23:49 user nova-compute[72418]: DEBUG nova.network.neutron [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Successfully updated port: 0eba7184-d598-4e94-aefc-d1f1cbf63046 {{(pid=72418) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 18:23:50 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Acquiring lock "refresh_cache-aab087ae-c46e-46c8-baa0-d754dc29947f" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:23:50 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Acquired lock "refresh_cache-aab087ae-c46e-46c8-baa0-d754dc29947f" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:23:50 user nova-compute[72418]: DEBUG nova.network.neutron [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:23:50 user nova-compute[72418]: DEBUG nova.network.neutron [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Instance cache missing network info. {{(pid=72418) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 18:23:50 user nova-compute[72418]: DEBUG nova.network.neutron [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Updating instance_info_cache with network_info: [{"id": "0eba7184-d598-4e94-aefc-d1f1cbf63046", "address": "fa:16:3e:71:1c:06", "network": {"id": "d72da164-7e30-4eeb-8c28-765454c2b24f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1301909372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e3274c2e3447fcad6d1f16765f4afd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eba7184-d5", "ovs_interfaceid": "0eba7184-d598-4e94-aefc-d1f1cbf63046", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:23:50 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Releasing lock "refresh_cache-aab087ae-c46e-46c8-baa0-d754dc29947f" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:23:50 user nova-compute[72418]: DEBUG nova.compute.manager [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Instance network_info: |[{"id": "0eba7184-d598-4e94-aefc-d1f1cbf63046", "address": "fa:16:3e:71:1c:06", "network": {"id": "d72da164-7e30-4eeb-8c28-765454c2b24f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1301909372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e3274c2e3447fcad6d1f16765f4afd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eba7184-d5", "ovs_interfaceid": "0eba7184-d598-4e94-aefc-d1f1cbf63046", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 18:23:50 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Start _get_guest_xml network_info=[{"id": "0eba7184-d598-4e94-aefc-d1f1cbf63046", "address": "fa:16:3e:71:1c:06", "network": {"id": "d72da164-7e30-4eeb-8c28-765454c2b24f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1301909372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e3274c2e3447fcad6d1f16765f4afd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eba7184-d5", "ovs_interfaceid": "0eba7184-d598-4e94-aefc-d1f1cbf63046", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 18:23:50 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:23:50 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:23:50 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 18:23:50 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] CPU controller missing on host. {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 18:23:51 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Removed pending event for 01c46b33-6788-44a5-a43c-88ee4acc4d39 due to event {{(pid=72418) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 18:23:51 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605431.3396926, 01c46b33-6788-44a5-a43c-88ee4acc4d39 => Resumed> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:23:51 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] VM Resumed (Lifecycle Event)
Aug 09 18:23:51 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 18:23:51 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] CPU controller found on host. {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 18:23:51 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72418) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 18:23:51 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T18:17:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 18:23:51 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Flavor limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 18:23:51 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Image limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 18:23:51 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Flavor pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 18:23:51 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Image pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 18:23:51 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 18:23:51 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 18:23:51 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 18:23:51 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Got 1 possible topologies {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 18:23:51 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 18:23:51 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 18:23:51 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:23:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1573430224',display_name='tempest-ServersNegativeTestJSON-server-1573430224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1573430224',id=12,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60e3274c2e3447fcad6d1f16765f4afd',ramdisk_id='',reservation_id='r-4islqo30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1802403477',owner_user_name='tempest-ServersNegativeTestJSON-1802403477-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:23:48Z,user_data=None,user_id='6e1439f58ac640f481a59944ee145f97',uuid=aab087ae-c46e-46c8-baa0-d754dc29947f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0eba7184-d598-4e94-aefc-d1f1cbf63046", "address": "fa:16:3e:71:1c:06", "network": {"id": "d72da164-7e30-4eeb-8c28-765454c2b24f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1301909372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e3274c2e3447fcad6d1f16765f4afd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eba7184-d5", "ovs_interfaceid": "0eba7184-d598-4e94-aefc-d1f1cbf63046", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:23:51 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Converting VIF {"id": "0eba7184-d598-4e94-aefc-d1f1cbf63046", "address": "fa:16:3e:71:1c:06", "network": {"id": "d72da164-7e30-4eeb-8c28-765454c2b24f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1301909372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e3274c2e3447fcad6d1f16765f4afd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eba7184-d5", "ovs_interfaceid": "0eba7184-d598-4e94-aefc-d1f1cbf63046", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:23:51 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:1c:06,bridge_name='br-int',has_traffic_filtering=True,id=0eba7184-d598-4e94-aefc-d1f1cbf63046,network=Network(d72da164-7e30-4eeb-8c28-765454c2b24f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0eba7184-d5') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:23:51 user nova-compute[72418]: DEBUG nova.objects.instance [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Lazy-loading 'pci_devices' on Instance uuid aab087ae-c46e-46c8-baa0-d754dc29947f {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:23:51 user nova-compute[72418]: DEBUG nova.compute.manager [None req-229a0aed-3832-4bda-b5cd-96705da51f9b tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:23:51 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:23:51 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] End _get_guest_xml xml=<domain type="kvm">
Aug 09 18:23:51 user nova-compute[72418]:   <uuid>aab087ae-c46e-46c8-baa0-d754dc29947f</uuid>
Aug 09 18:23:51 user nova-compute[72418]:   <name>instance-0000000c</name>
Aug 09 18:23:51 user nova-compute[72418]:   <memory>524288</memory>
Aug 09 18:23:51 user nova-compute[72418]:   <vcpu>1</vcpu>
Aug 09 18:23:51 user nova-compute[72418]:   <metadata>
Aug 09 18:23:51 user nova-compute[72418]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:23:51 user nova-compute[72418]:       <nova:package version="0.0.0"/>
Aug 09 18:23:51 user nova-compute[72418]:       <nova:name>tempest-ServersNegativeTestJSON-server-1573430224</nova:name>
Aug 09 18:23:51 user nova-compute[72418]:       <nova:creationTime>2023-08-09 18:23:50</nova:creationTime>
Aug 09 18:23:51 user nova-compute[72418]:       <nova:flavor name="m1.tiny">
Aug 09 18:23:51 user nova-compute[72418]:         <nova:memory>512</nova:memory>
Aug 09 18:23:51 user nova-compute[72418]:         <nova:disk>1</nova:disk>
Aug 09 18:23:51 user nova-compute[72418]:         <nova:swap>0</nova:swap>
Aug 09 18:23:51 user nova-compute[72418]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:23:51 user nova-compute[72418]:         <nova:vcpus>1</nova:vcpus>
Aug 09 18:23:51 user nova-compute[72418]:       </nova:flavor>
Aug 09 18:23:51 user nova-compute[72418]:       <nova:owner>
Aug 09 18:23:51 user nova-compute[72418]:         <nova:user uuid="6e1439f58ac640f481a59944ee145f97">tempest-ServersNegativeTestJSON-1802403477-project-member</nova:user>
Aug 09 18:23:51 user nova-compute[72418]:         <nova:project uuid="60e3274c2e3447fcad6d1f16765f4afd">tempest-ServersNegativeTestJSON-1802403477</nova:project>
Aug 09 18:23:51 user nova-compute[72418]:       </nova:owner>
Aug 09 18:23:51 user nova-compute[72418]:       <nova:root type="image" uuid="8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e"/>
Aug 09 18:23:51 user nova-compute[72418]:       <nova:ports>
Aug 09 18:23:51 user nova-compute[72418]:         <nova:port uuid="0eba7184-d598-4e94-aefc-d1f1cbf63046">
Aug 09 18:23:51 user nova-compute[72418]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 18:23:51 user nova-compute[72418]:         </nova:port>
Aug 09 18:23:51 user nova-compute[72418]:       </nova:ports>
Aug 09 18:23:51 user nova-compute[72418]:     </nova:instance>
Aug 09 18:23:51 user nova-compute[72418]:   </metadata>
Aug 09 18:23:51 user nova-compute[72418]:   <sysinfo type="smbios">
Aug 09 18:23:51 user nova-compute[72418]:     <system>
Aug 09 18:23:51 user nova-compute[72418]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 18:23:51 user nova-compute[72418]:       <entry name="product">OpenStack Nova</entry>
Aug 09 18:23:51 user nova-compute[72418]:       <entry name="version">0.0.0</entry>
Aug 09 18:23:51 user nova-compute[72418]:       <entry name="serial">aab087ae-c46e-46c8-baa0-d754dc29947f</entry>
Aug 09 18:23:51 user nova-compute[72418]:       <entry name="uuid">aab087ae-c46e-46c8-baa0-d754dc29947f</entry>
Aug 09 18:23:51 user nova-compute[72418]:       <entry name="family">Virtual Machine</entry>
Aug 09 18:23:51 user nova-compute[72418]:     </system>
Aug 09 18:23:51 user nova-compute[72418]:   </sysinfo>
Aug 09 18:23:51 user nova-compute[72418]:   <os>
Aug 09 18:23:51 user nova-compute[72418]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 18:23:51 user nova-compute[72418]:     <boot dev="hd"/>
Aug 09 18:23:51 user nova-compute[72418]:     <smbios mode="sysinfo"/>
Aug 09 18:23:51 user nova-compute[72418]:   </os>
Aug 09 18:23:51 user nova-compute[72418]:   <features>
Aug 09 18:23:51 user nova-compute[72418]:     <acpi/>
Aug 09 18:23:51 user nova-compute[72418]:     <apic/>
Aug 09 18:23:51 user nova-compute[72418]:     <vmcoreinfo/>
Aug 09 18:23:51 user nova-compute[72418]:   </features>
Aug 09 18:23:51 user nova-compute[72418]:   <clock offset="utc">
Aug 09 18:23:51 user nova-compute[72418]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 18:23:51 user nova-compute[72418]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 18:23:51 user nova-compute[72418]:     <timer name="hpet" present="no"/>
Aug 09 18:23:51 user nova-compute[72418]:   </clock>
Aug 09 18:23:51 user nova-compute[72418]:   <cpu mode="custom" match="exact">
Aug 09 18:23:51 user nova-compute[72418]:     <model>Nehalem</model>
Aug 09 18:23:51 user nova-compute[72418]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 18:23:51 user nova-compute[72418]:   </cpu>
Aug 09 18:23:51 user nova-compute[72418]:   <devices>
Aug 09 18:23:51 user nova-compute[72418]:     <disk type="file" device="disk">
Aug 09 18:23:51 user nova-compute[72418]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 18:23:51 user nova-compute[72418]:       <source file="/opt/stack/data/nova/instances/aab087ae-c46e-46c8-baa0-d754dc29947f/disk"/>
Aug 09 18:23:51 user nova-compute[72418]:       <target dev="vda" bus="virtio"/>
Aug 09 18:23:51 user nova-compute[72418]:     </disk>
Aug 09 18:23:51 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:23:51 user nova-compute[72418]:       <mac address="fa:16:3e:71:1c:06"/>
Aug 09 18:23:51 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:23:51 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:23:51 user nova-compute[72418]:       <target dev="tap0eba7184-d5"/>
Aug 09 18:23:51 user nova-compute[72418]:     </interface>
Aug 09 18:23:51 user nova-compute[72418]:     <serial type="pty">
Aug 09 18:23:51 user nova-compute[72418]:       <log file="/opt/stack/data/nova/instances/aab087ae-c46e-46c8-baa0-d754dc29947f/console.log" append="off"/>
Aug 09 18:23:51 user nova-compute[72418]:     </serial>
Aug 09 18:23:51 user nova-compute[72418]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 18:23:51 user nova-compute[72418]:     <video>
Aug 09 18:23:51 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:23:51 user nova-compute[72418]:     </video>
Aug 09 18:23:51 user nova-compute[72418]:     <rng model="virtio">
Aug 09 18:23:51 user nova-compute[72418]:       <backend model="random">/dev/urandom</backend>
Aug 09 18:23:51 user nova-compute[72418]:     </rng>
Aug 09 18:23:51 user nova-compute[72418]:     <controller type="usb" index="0" model="none"/>
Aug 09 18:23:51 user nova-compute[72418]:     <memballoon model="virtio">
Aug 09 18:23:51 user nova-compute[72418]:       <stats period="10"/>
Aug 09 18:23:51 user nova-compute[72418]:     </memballoon>
Aug 09 18:23:51 user nova-compute[72418]:   </devices>
Aug 09 18:23:51 user nova-compute[72418]: </domain>
Aug 09 18:23:51 user nova-compute[72418]:  {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 18:23:51 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:23:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1573430224',display_name='tempest-ServersNegativeTestJSON-server-1573430224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1573430224',id=12,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60e3274c2e3447fcad6d1f16765f4afd',ramdisk_id='',reservation_id='r-4islqo30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1802403477',owner_user_name='tempest-ServersNegativeTestJSON-1802403477-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:23:48Z,user_data=None,user_id='6e1439f58ac640f481a59944ee145f97',uuid=aab087ae-c46e-46c8-baa0-d754dc29947f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0eba7184-d598-4e94-aefc-d1f1cbf63046", "address": "fa:16:3e:71:1c:06", "network": {"id": "d72da164-7e30-4eeb-8c28-765454c2b24f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1301909372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e3274c2e3447fcad6d1f16765f4afd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eba7184-d5", "ovs_interfaceid": "0eba7184-d598-4e94-aefc-d1f1cbf63046", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:23:51 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Converting VIF {"id": "0eba7184-d598-4e94-aefc-d1f1cbf63046", "address": "fa:16:3e:71:1c:06", "network": {"id": "d72da164-7e30-4eeb-8c28-765454c2b24f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1301909372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e3274c2e3447fcad6d1f16765f4afd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eba7184-d5", "ovs_interfaceid": "0eba7184-d598-4e94-aefc-d1f1cbf63046", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:23:51 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:1c:06,bridge_name='br-int',has_traffic_filtering=True,id=0eba7184-d598-4e94-aefc-d1f1cbf63046,network=Network(d72da164-7e30-4eeb-8c28-765454c2b24f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0eba7184-d5') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:23:51 user nova-compute[72418]: DEBUG os_vif [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:1c:06,bridge_name='br-int',has_traffic_filtering=True,id=0eba7184-d598-4e94-aefc-d1f1cbf63046,network=Network(d72da164-7e30-4eeb-8c28-765454c2b24f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0eba7184-d5') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:23:51 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:51 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:23:51 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:23:51 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:51 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0eba7184-d5, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:23:51 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0eba7184-d5, col_values=(('external_ids', {'iface-id': '0eba7184-d598-4e94-aefc-d1f1cbf63046', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:1c:06', 'vm-uuid': 'aab087ae-c46e-46c8-baa0-d754dc29947f'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:23:51 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:51 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:23:51 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:51 user nova-compute[72418]: INFO os_vif [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:1c:06,bridge_name='br-int',has_traffic_filtering=True,id=0eba7184-d598-4e94-aefc-d1f1cbf63046,network=Network(d72da164-7e30-4eeb-8c28-765454c2b24f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0eba7184-d5')
Aug 09 18:23:51 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:23:51 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 09 18:23:51 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605431.3405974, 01c46b33-6788-44a5-a43c-88ee4acc4d39 => Started> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:23:51 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] VM Started (Lifecycle Event)
Aug 09 18:23:51 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:23:51 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:23:51 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 09 18:23:51 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:23:51 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] No VIF found with MAC fa:16:3e:71:1c:06, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:23:51 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:23:51 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:23:51 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:23:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/479ea4c3-ad7f-4da0-a901-defe46d96065/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:51 user nova-compute[72418]: DEBUG nova.compute.manager [req-bdd5d5cc-4749-4603-ae23-10d2afa107d4 req-6dffb1e4-3299-4c37-8128-372082018e70 service nova] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Received event network-vif-plugged-1487cbc0-54ec-4134-9e08-88f02ff870f5 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:23:51 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-bdd5d5cc-4749-4603-ae23-10d2afa107d4 req-6dffb1e4-3299-4c37-8128-372082018e70 service nova] Acquiring lock "01c46b33-6788-44a5-a43c-88ee4acc4d39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:23:51 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-bdd5d5cc-4749-4603-ae23-10d2afa107d4 req-6dffb1e4-3299-4c37-8128-372082018e70 service nova] Lock "01c46b33-6788-44a5-a43c-88ee4acc4d39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:23:51 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-bdd5d5cc-4749-4603-ae23-10d2afa107d4 req-6dffb1e4-3299-4c37-8128-372082018e70 service nova] Lock "01c46b33-6788-44a5-a43c-88ee4acc4d39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:23:51 user nova-compute[72418]: DEBUG nova.compute.manager [req-bdd5d5cc-4749-4603-ae23-10d2afa107d4 req-6dffb1e4-3299-4c37-8128-372082018e70 service nova] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] No waiting events found dispatching network-vif-plugged-1487cbc0-54ec-4134-9e08-88f02ff870f5 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:23:51 user nova-compute[72418]: WARNING nova.compute.manager [req-bdd5d5cc-4749-4603-ae23-10d2afa107d4 req-6dffb1e4-3299-4c37-8128-372082018e70 service nova] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Received unexpected event network-vif-plugged-1487cbc0-54ec-4134-9e08-88f02ff870f5 for instance with vm_state rescued and task_state None.
Aug 09 18:23:51 user nova-compute[72418]: DEBUG nova.compute.manager [req-bdd5d5cc-4749-4603-ae23-10d2afa107d4 req-6dffb1e4-3299-4c37-8128-372082018e70 service nova] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Received event network-changed-0eba7184-d598-4e94-aefc-d1f1cbf63046 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:23:51 user nova-compute[72418]: DEBUG nova.compute.manager [req-bdd5d5cc-4749-4603-ae23-10d2afa107d4 req-6dffb1e4-3299-4c37-8128-372082018e70 service nova] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Refreshing instance network info cache due to event network-changed-0eba7184-d598-4e94-aefc-d1f1cbf63046. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:23:51 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-bdd5d5cc-4749-4603-ae23-10d2afa107d4 req-6dffb1e4-3299-4c37-8128-372082018e70 service nova] Acquiring lock "refresh_cache-aab087ae-c46e-46c8-baa0-d754dc29947f" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:23:51 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-bdd5d5cc-4749-4603-ae23-10d2afa107d4 req-6dffb1e4-3299-4c37-8128-372082018e70 service nova] Acquired lock "refresh_cache-aab087ae-c46e-46c8-baa0-d754dc29947f" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:23:51 user nova-compute[72418]: DEBUG nova.network.neutron [req-bdd5d5cc-4749-4603-ae23-10d2afa107d4 req-6dffb1e4-3299-4c37-8128-372082018e70 service nova] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Refreshing network info cache for port 0eba7184-d598-4e94-aefc-d1f1cbf63046 {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:23:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/479ea4c3-ad7f-4da0-a901-defe46d96065/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/479ea4c3-ad7f-4da0-a901-defe46d96065/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:52 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/479ea4c3-ad7f-4da0-a901-defe46d96065/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28dad451-f27e-4c62-8353-e3b89e0196cd/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:52 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-b1622bcf-d0cc-4382-8dfb-486790a4d5c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Snapshot image upload complete
Aug 09 18:23:52 user nova-compute[72418]: INFO nova.compute.manager [None req-b1622bcf-d0cc-4382-8dfb-486790a4d5c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Took 7.41 seconds to snapshot the instance on the hypervisor.
Aug 09 18:23:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28dad451-f27e-4c62-8353-e3b89e0196cd/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28dad451-f27e-4c62-8353-e3b89e0196cd/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:52 user nova-compute[72418]: DEBUG nova.network.neutron [req-bdd5d5cc-4749-4603-ae23-10d2afa107d4 req-6dffb1e4-3299-4c37-8128-372082018e70 service nova] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Updated VIF entry in instance network info cache for port 0eba7184-d598-4e94-aefc-d1f1cbf63046. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:23:52 user nova-compute[72418]: DEBUG nova.network.neutron [req-bdd5d5cc-4749-4603-ae23-10d2afa107d4 req-6dffb1e4-3299-4c37-8128-372082018e70 service nova] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Updating instance_info_cache with network_info: [{"id": "0eba7184-d598-4e94-aefc-d1f1cbf63046", "address": "fa:16:3e:71:1c:06", "network": {"id": "d72da164-7e30-4eeb-8c28-765454c2b24f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1301909372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e3274c2e3447fcad6d1f16765f4afd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eba7184-d5", "ovs_interfaceid": "0eba7184-d598-4e94-aefc-d1f1cbf63046", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:23:52 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-bdd5d5cc-4749-4603-ae23-10d2afa107d4 req-6dffb1e4-3299-4c37-8128-372082018e70 service nova] Releasing lock "refresh_cache-aab087ae-c46e-46c8-baa0-d754dc29947f" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:23:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28dad451-f27e-4c62-8353-e3b89e0196cd/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dabfdb24-fc0b-4a00-a229-1ece48e27d18/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dabfdb24-fc0b-4a00-a229-1ece48e27d18/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dabfdb24-fc0b-4a00-a229-1ece48e27d18/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dabfdb24-fc0b-4a00-a229-1ece48e27d18/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:53 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:53 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:53 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:53 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:53 user nova-compute[72418]: DEBUG nova.compute.manager [req-d0ce333a-2752-4b1f-8584-67f7f856e41a req-d82646e3-48e7-4cfd-89a2-ba3c6c531560 service nova] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Received event network-vif-plugged-0eba7184-d598-4e94-aefc-d1f1cbf63046 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:23:53 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-d0ce333a-2752-4b1f-8584-67f7f856e41a req-d82646e3-48e7-4cfd-89a2-ba3c6c531560 service nova] Acquiring lock "aab087ae-c46e-46c8-baa0-d754dc29947f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:23:53 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-d0ce333a-2752-4b1f-8584-67f7f856e41a req-d82646e3-48e7-4cfd-89a2-ba3c6c531560 service nova] Lock "aab087ae-c46e-46c8-baa0-d754dc29947f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:23:53 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-d0ce333a-2752-4b1f-8584-67f7f856e41a req-d82646e3-48e7-4cfd-89a2-ba3c6c531560 service nova] Lock "aab087ae-c46e-46c8-baa0-d754dc29947f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:23:53 user nova-compute[72418]: DEBUG nova.compute.manager [req-d0ce333a-2752-4b1f-8584-67f7f856e41a req-d82646e3-48e7-4cfd-89a2-ba3c6c531560 service nova] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] No waiting events found dispatching network-vif-plugged-0eba7184-d598-4e94-aefc-d1f1cbf63046 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:23:53 user nova-compute[72418]: WARNING nova.compute.manager [req-d0ce333a-2752-4b1f-8584-67f7f856e41a req-d82646e3-48e7-4cfd-89a2-ba3c6c531560 service nova] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Received unexpected event network-vif-plugged-0eba7184-d598-4e94-aefc-d1f1cbf63046 for instance with vm_state building and task_state spawning.
Aug 09 18:23:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:55 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:55 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:55 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:55 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6084e681-01c4-4a6c-beb3-dcda4a990a51/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:55 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6084e681-01c4-4a6c-beb3-dcda4a990a51/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:55 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6084e681-01c4-4a6c-beb3-dcda4a990a51/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:55 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6084e681-01c4-4a6c-beb3-dcda4a990a51/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:55 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:23:55 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aab087ae-c46e-46c8-baa0-d754dc29947f/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:55 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605435.7339673, aab087ae-c46e-46c8-baa0-d754dc29947f => Resumed> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:23:55 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] VM Resumed (Lifecycle Event)
Aug 09 18:23:55 user nova-compute[72418]: DEBUG nova.compute.manager [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Instance event wait completed in 0 seconds for  {{(pid=72418) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 18:23:55 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Guest created on hypervisor {{(pid=72418) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 18:23:55 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Instance spawned successfully.
Aug 09 18:23:55 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 18:23:55 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:23:55 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:23:55 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Found default for hw_cdrom_bus of ide {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:23:55 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Found default for hw_disk_bus of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:23:55 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Found default for hw_input_bus of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:23:55 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Found default for hw_pointer_model of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:23:55 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Found default for hw_video_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:23:55 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Found default for hw_vif_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:23:55 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:23:55 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605435.74727, aab087ae-c46e-46c8-baa0-d754dc29947f => Started> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:23:55 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] VM Started (Lifecycle Event)
Aug 09 18:23:55 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:23:55 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:23:55 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aab087ae-c46e-46c8-baa0-d754dc29947f/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:55 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aab087ae-c46e-46c8-baa0-d754dc29947f/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:55 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:23:55 user nova-compute[72418]: INFO nova.compute.manager [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Took 8.16 seconds to spawn the instance on the hypervisor.
Aug 09 18:23:55 user nova-compute[72418]: DEBUG nova.compute.manager [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:23:55 user nova-compute[72418]: DEBUG nova.compute.manager [req-3681d185-b0e4-4ba8-acd1-31235ed85c7f req-908e7713-cdff-46d8-bbdc-b1e55767cd8e service nova] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Received event network-vif-plugged-0eba7184-d598-4e94-aefc-d1f1cbf63046 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:23:55 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-3681d185-b0e4-4ba8-acd1-31235ed85c7f req-908e7713-cdff-46d8-bbdc-b1e55767cd8e service nova] Acquiring lock "aab087ae-c46e-46c8-baa0-d754dc29947f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:23:55 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-3681d185-b0e4-4ba8-acd1-31235ed85c7f req-908e7713-cdff-46d8-bbdc-b1e55767cd8e service nova] Lock "aab087ae-c46e-46c8-baa0-d754dc29947f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:23:55 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-3681d185-b0e4-4ba8-acd1-31235ed85c7f req-908e7713-cdff-46d8-bbdc-b1e55767cd8e service nova] Lock "aab087ae-c46e-46c8-baa0-d754dc29947f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:23:55 user nova-compute[72418]: DEBUG nova.compute.manager [req-3681d185-b0e4-4ba8-acd1-31235ed85c7f req-908e7713-cdff-46d8-bbdc-b1e55767cd8e service nova] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] No waiting events found dispatching network-vif-plugged-0eba7184-d598-4e94-aefc-d1f1cbf63046 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:23:55 user nova-compute[72418]: WARNING nova.compute.manager [req-3681d185-b0e4-4ba8-acd1-31235ed85c7f req-908e7713-cdff-46d8-bbdc-b1e55767cd8e service nova] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Received unexpected event network-vif-plugged-0eba7184-d598-4e94-aefc-d1f1cbf63046 for instance with vm_state building and task_state spawning.
Aug 09 18:23:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aab087ae-c46e-46c8-baa0-d754dc29947f/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:56 user nova-compute[72418]: INFO nova.compute.manager [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Took 9.70 seconds to build instance.
Aug 09 18:23:56 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-9c64b8e9-8e1d-434a-8168-cd63ba302810 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Lock "aab087ae-c46e-46c8-baa0-d754dc29947f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.853s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:23:56 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:56 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:23:56 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:23:56 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Hypervisor/Node resource view: name=user free_ram=6854MB free_disk=25.876354217529297GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72418) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 18:23:56 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:23:56 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:23:57 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 6af7918a-ce90-45ab-93d8-684e1489e891 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:23:57 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 8fe41968-a219-4a5a-afdb-32eb2082bb40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:23:57 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:23:57 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 01c46b33-6788-44a5-a43c-88ee4acc4d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:23:57 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 479ea4c3-ad7f-4da0-a901-defe46d96065 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:23:57 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 6084e681-01c4-4a6c-beb3-dcda4a990a51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:23:57 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:23:57 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance dabfdb24-fc0b-4a00-a229-1ece48e27d18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:23:57 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance d9d5d476-484e-49a3-a665-5a2069ea606e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:23:57 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 2b284735-40f6-403f-8c72-a70a4da1ef95 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:23:57 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 28dad451-f27e-4c62-8353-e3b89e0196cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:23:57 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance aab087ae-c46e-46c8-baa0-d754dc29947f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:23:57 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 18:23:57 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 18:23:57 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:23:57 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:23:57 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:23:57 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Compute_service record updated for user:user {{(pid=72418) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 18:23:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.727s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc9dc48a-2dd4-49a1-aff2-0dea277e3ff8 tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Calling os-brick to attach iSCSI Volume {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9dc48a-2dd4-49a1-aff2-0dea277e3ff8 tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b4525421-c0f1-4a81-8cfc-a10b31dcf187'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BlGHniDZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:23:58 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-bc9dc48a-2dd4-49a1-aff2-0dea277e3ff8 tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:23:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-bc9dc48a-2dd4-49a1-aff2-0dea277e3ff8 tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-bc9dc48a-2dd4-49a1-aff2-0dea277e3ff8 tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:23:58 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-bc9dc48a-2dd4-49a1-aff2-0dea277e3ff8 tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:23:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-bc9dc48a-2dd4-49a1-aff2-0dea277e3ff8 tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4525421-c0f1-4a81-8cfc-a10b31dcf187" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-bc9dc48a-2dd4-49a1-aff2-0dea277e3ff8 tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4525421-c0f1-4a81-8cfc-a10b31dcf187" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:23:58 user nova-compute[72418]: INFO os_brick.initiator.connectors.iscsi [None req-bc9dc48a-2dd4-49a1-aff2-0dea277e3ff8 tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 18:23:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4525421-c0f1-4a81-8cfc-a10b31dcf187 -p 172.16.0.220:3260 {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4525421-c0f1-4a81-8cfc-a10b31dcf187 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a39a8fa-9d51-4c90-b682-5eb284a92523]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9dc48a-2dd4-49a1-aff2-0dea277e3ff8 tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 18:23:58 user nova-compute[72418]:  {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4525421-c0f1-4a81-8cfc-a10b31dcf187 -p 172.16.0.220:3260 --interface default --op new {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4525421-c0f1-4a81-8cfc-a10b31dcf187 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35924a0-eeb6-4a37-aeac-e45f9ee30e13]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4525421-c0f1-4a81-8cfc-a10b31dcf187] added\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9dc48a-2dd4-49a1-aff2-0dea277e3ff8 tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4525421-c0f1-4a81-8cfc-a10b31dcf187] added
Aug 09 18:23:58 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4525421-c0f1-4a81-8cfc-a10b31dcf187 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4525421-c0f1-4a81-8cfc-a10b31dcf187 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[452d7d4e-a8d6-4f18-ac06-f8e6902adc58]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9dc48a-2dd4-49a1-aff2-0dea277e3ff8 tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4525421-c0f1-4a81-8cfc-a10b31dcf187 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4525421-c0f1-4a81-8cfc-a10b31dcf187 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[9312bd35-12d9-481a-9cb9-58a312476c50]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9dc48a-2dd4-49a1-aff2-0dea277e3ff8 tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4525421-c0f1-4a81-8cfc-a10b31dcf187 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BlGHniDZ {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4525421-c0f1-4a81-8cfc-a10b31dcf187 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BlGHniDZ" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e6cb17-eed0-4ee9-9e06-e20271ede95f]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9dc48a-2dd4-49a1-aff2-0dea277e3ff8 tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BlGHniDZ'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4525421-c0f1-4a81-8cfc-a10b31dcf187 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4525421-c0f1-4a81-8cfc-a10b31dcf187 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9d8ab1-cf5b-4adc-a6e4-a0bf1bdbacc4]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9dc48a-2dd4-49a1-aff2-0dea277e3ff8 tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5d3c9a-d8c1-4351-8ff7-a51146516b45]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9dc48a-2dd4-49a1-aff2-0dea277e3ff8 tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:23:58 user nova-compute[72418]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)
Aug 09 18:23:58 user nova-compute[72418]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)
Aug 09 18:23:58 user nova-compute[72418]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)
Aug 09 18:23:58 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9dc48a-2dd4-49a1-aff2-0dea277e3ff8 tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:23:58 user nova-compute[72418]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)
Aug 09 18:23:58 user nova-compute[72418]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)
Aug 09 18:23:58 user nova-compute[72418]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)
Aug 09 18:23:58 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4525421-c0f1-4a81-8cfc-a10b31dcf187 -p 172.16.0.220:3260 --login {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4525421-c0f1-4a81-8cfc-a10b31dcf187 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[939b35e6-9775-411f-930b-dbdb3eeb07d0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4525421-c0f1-4a81-8cfc-a10b31dcf187, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b4525421-c0f1-4a81-8cfc-a10b31dcf187, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9dc48a-2dd4-49a1-aff2-0dea277e3ff8 tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4525421-c0f1-4a81-8cfc-a10b31dcf187, portal: 172.16.0.220,3260]
Aug 09 18:23:58 user nova-compute[72418]: Login to [iface: default, target: iqn.2010-10.org.openstack:b4525421-c0f1-4a81-8cfc-a10b31dcf187, portal: 172.16.0.220,3260] successful.
Aug 09 18:23:58 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4525421-c0f1-4a81-8cfc-a10b31dcf187 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4525421-c0f1-4a81-8cfc-a10b31dcf187 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa903fb1-d62e-4899-ac77-7fbb66ee81e0]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9dc48a-2dd4-49a1-aff2-0dea277e3ff8 tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c9c890-9535-44c6-8421-cf1c74b65521]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4525421-c0f1-4a81-8cfc-a10b31dcf187 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9dc48a-2dd4-49a1-aff2-0dea277e3ff8 tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:23:58 user nova-compute[72418]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)
Aug 09 18:23:58 user nova-compute[72418]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)
Aug 09 18:23:58 user nova-compute[72418]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)
Aug 09 18:23:58 user nova-compute[72418]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4525421-c0f1-4a81-8cfc-a10b31dcf187 (non-flash)
Aug 09 18:23:58 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9dc48a-2dd4-49a1-aff2-0dea277e3ff8 tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:23:58 user nova-compute[72418]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)
Aug 09 18:23:58 user nova-compute[72418]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)
Aug 09 18:23:58 user nova-compute[72418]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)
Aug 09 18:23:58 user nova-compute[72418]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4525421-c0f1-4a81-8cfc-a10b31dcf187 (non-flash)
Aug 09 18:23:58 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-bc9dc48a-2dd4-49a1-aff2-0dea277e3ff8 tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4525421-c0f1-4a81-8cfc-a10b31dcf187" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9dc48a-2dd4-49a1-aff2-0dea277e3ff8 tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Connected to 172.16.0.220:3260 {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-bc9dc48a-2dd4-49a1-aff2-0dea277e3ff8 tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=72418) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-bc9dc48a-2dd4-49a1-aff2-0dea277e3ff8 tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72418) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd7980f-af2e-4098-b367-e9b6a77ae2c2]: (4, ('- - 0', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-bc9dc48a-2dd4-49a1-aff2-0dea277e3ff8 tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72418) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9dc48a-2dd4-49a1-aff2-0dea277e3ff8 tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BlGHniDZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Starting heal instance info cache {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "refresh_cache-8fe41968-a219-4a5a-afdb-32eb2082bb40" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquired lock "refresh_cache-8fe41968-a219-4a5a-afdb-32eb2082bb40" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:23:58 user nova-compute[72418]: DEBUG nova.network.neutron [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Forcefully refreshing network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 18:23:59 user nova-compute[72418]: DEBUG nova.network.neutron [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Updating instance_info_cache with network_info: [{"id": "2e2b5832-b357-4012-8bfc-d26009aa91f8", "address": "fa:16:3e:ee:f9:5d", "network": {"id": "beaefb5c-f5e4-47e7-ab68-60131f532ade", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e5863cda54487682a4edcc24202c91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2b5832-b3", "ovs_interfaceid": "2e2b5832-b357-4012-8bfc-d26009aa91f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:23:59 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Releasing lock "refresh_cache-8fe41968-a219-4a5a-afdb-32eb2082bb40" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:23:59 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Updated the network info_cache for instance {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 18:23:59 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:23:59 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-bc9dc48a-2dd4-49a1-aff2-0dea277e3ff8 tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:23:59 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9dc48a-2dd4-49a1-aff2-0dea277e3ff8 tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '23861636565623534', 'path': '/dev/sdf'} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:23:59 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc9dc48a-2dd4-49a1-aff2-0dea277e3ff8 tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861636565623534', 'path': '/dev/sdf'} {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 18:23:59 user nova-compute[72418]: DEBUG nova.objects.instance [None req-bc9dc48a-2dd4-49a1-aff2-0dea277e3ff8 tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Lazy-loading 'flavor' on Instance uuid 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:23:59 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-bc9dc48a-2dd4-49a1-aff2-0dea277e3ff8 tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 18:23:59 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:23:59 user nova-compute[72418]:   <source dev="/dev/sdf"/>
Aug 09 18:23:59 user nova-compute[72418]:   <target dev="vdb" bus="virtio"/>
Aug 09 18:23:59 user nova-compute[72418]:   <serial>b4525421-c0f1-4a81-8cfc-a10b31dcf187</serial>
Aug 09 18:23:59 user nova-compute[72418]: </disk>
Aug 09 18:23:59 user nova-compute[72418]:  {{(pid=72418) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 18:24:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-bc9dc48a-2dd4-49a1-aff2-0dea277e3ff8 tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:24:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-bc9dc48a-2dd4-49a1-aff2-0dea277e3ff8 tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:24:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-bc9dc48a-2dd4-49a1-aff2-0dea277e3ff8 tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] No VIF found with MAC fa:16:3e:2e:8f:f7, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:24:00 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-bc9dc48a-2dd4-49a1-aff2-0dea277e3ff8 tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Lock "17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.512s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:24:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ac45f517-d41c-44f3-8943-328413f3ad3e tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Acquiring lock "17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:24:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ac45f517-d41c-44f3-8943-328413f3ad3e tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Lock "17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:24:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ac45f517-d41c-44f3-8943-328413f3ad3e tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Acquiring lock "17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:24:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ac45f517-d41c-44f3-8943-328413f3ad3e tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Lock "17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:24:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ac45f517-d41c-44f3-8943-328413f3ad3e tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Lock "17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:24:01 user nova-compute[72418]: INFO nova.compute.manager [None req-ac45f517-d41c-44f3-8943-328413f3ad3e tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Terminating instance
Aug 09 18:24:01 user nova-compute[72418]: DEBUG nova.compute.manager [None req-ac45f517-d41c-44f3-8943-328413f3ad3e tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Start destroying the instance on the hypervisor. {{(pid=72418) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 18:24:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:24:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:24:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:24:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:24:01 user nova-compute[72418]: DEBUG nova.compute.manager [req-6617a84b-3d74-4df6-821b-826a0ae0d291 req-f5f84368-e2d2-4460-a7d1-421470dcbd4a service nova] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Received event network-vif-unplugged-c58368cc-29db-48a5-ab5d-a56526aba194 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:24:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-6617a84b-3d74-4df6-821b-826a0ae0d291 req-f5f84368-e2d2-4460-a7d1-421470dcbd4a service nova] Acquiring lock "17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:24:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-6617a84b-3d74-4df6-821b-826a0ae0d291 req-f5f84368-e2d2-4460-a7d1-421470dcbd4a service nova] Lock "17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:24:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-6617a84b-3d74-4df6-821b-826a0ae0d291 req-f5f84368-e2d2-4460-a7d1-421470dcbd4a service nova] Lock "17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:24:01 user nova-compute[72418]: DEBUG nova.compute.manager [req-6617a84b-3d74-4df6-821b-826a0ae0d291 req-f5f84368-e2d2-4460-a7d1-421470dcbd4a service nova] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] No waiting events found dispatching network-vif-unplugged-c58368cc-29db-48a5-ab5d-a56526aba194 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:24:01 user nova-compute[72418]: DEBUG nova.compute.manager [req-6617a84b-3d74-4df6-821b-826a0ae0d291 req-f5f84368-e2d2-4460-a7d1-421470dcbd4a service nova] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Received event network-vif-unplugged-c58368cc-29db-48a5-ab5d-a56526aba194 for instance with task_state deleting. {{(pid=72418) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 18:24:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:24:02 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:24:02 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Instance destroyed successfully.
Aug 09 18:24:02 user nova-compute[72418]: DEBUG nova.objects.instance [None req-ac45f517-d41c-44f3-8943-328413f3ad3e tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Lazy-loading 'resources' on Instance uuid 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:24:02 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-ac45f517-d41c-44f3-8943-328413f3ad3e tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:21:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1589364230',display_name='tempest-DeleteServersTestJSON-server-1589364230',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1589364230',id=3,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:22:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4cc13d02ace44ca1a9ae7bf264a784cf',ramdisk_id='',reservation_id='r-0ap2tpf3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1562741887',owner_user_name='tempest-DeleteServersTestJSON-1562741887-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:22:14Z,user_data=None,user_id='55f358ec00924ae69a00e3718cbc3f78',uuid=17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c58368cc-29db-48a5-ab5d-a56526aba194", "address": "fa:16:3e:2e:8f:f7", "network": {"id": "e51a8e3c-5c3a-4057-bb86-f7a3f3f1f031", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1399538693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cc13d02ace44ca1a9ae7bf264a784cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc58368cc-29", "ovs_interfaceid": "c58368cc-29db-48a5-ab5d-a56526aba194", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 18:24:02 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-ac45f517-d41c-44f3-8943-328413f3ad3e tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Converting VIF {"id": "c58368cc-29db-48a5-ab5d-a56526aba194", "address": "fa:16:3e:2e:8f:f7", "network": {"id": "e51a8e3c-5c3a-4057-bb86-f7a3f3f1f031", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1399538693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cc13d02ace44ca1a9ae7bf264a784cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc58368cc-29", "ovs_interfaceid": "c58368cc-29db-48a5-ab5d-a56526aba194", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:24:02 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-ac45f517-d41c-44f3-8943-328413f3ad3e tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:8f:f7,bridge_name='br-int',has_traffic_filtering=True,id=c58368cc-29db-48a5-ab5d-a56526aba194,network=Network(e51a8e3c-5c3a-4057-bb86-f7a3f3f1f031),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc58368cc-29') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:24:02 user nova-compute[72418]: DEBUG os_vif [None req-ac45f517-d41c-44f3-8943-328413f3ad3e tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:8f:f7,bridge_name='br-int',has_traffic_filtering=True,id=c58368cc-29db-48a5-ab5d-a56526aba194,network=Network(e51a8e3c-5c3a-4057-bb86-f7a3f3f1f031),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc58368cc-29') {{(pid=72418) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 18:24:02 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:24:02 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc58368cc-29, bridge=br-int, if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:24:02 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:24:02 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:24:02 user nova-compute[72418]: INFO os_vif [None req-ac45f517-d41c-44f3-8943-328413f3ad3e tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:8f:f7,bridge_name='br-int',has_traffic_filtering=True,id=c58368cc-29db-48a5-ab5d-a56526aba194,network=Network(e51a8e3c-5c3a-4057-bb86-f7a3f3f1f031),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc58368cc-29')
Aug 09 18:24:02 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac45f517-d41c-44f3-8943-328413f3ad3e tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] calling os-brick to detach iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 18:24:02 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac45f517-d41c-44f3-8943-328413f3ad3e tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, {'target_iqns': ['iqn.2010-10.org.openstack:b4525421-c0f1-4a81-8cfc-a10b31dcf187'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BlGHniDZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:24:02 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-ac45f517-d41c-44f3-8943-328413f3ad3e tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:24:02 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-ac45f517-d41c-44f3-8943-328413f3ad3e tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:24:02 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-ac45f517-d41c-44f3-8943-328413f3ad3e tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:24:02 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac45f517-d41c-44f3-8943-328413f3ad3e tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4525421-c0f1-4a81-8cfc-a10b31dcf187', 0)] {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 18:24:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:02 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa4fbdc6-949c-48eb-848a-f36bb142a573]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4525421-c0f1-4a81-8cfc-a10b31dcf187\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:02 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b230a8-ae65-4b5f-8583-5bf60988752f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4525421-c0f1-4a81-8cfc-a10b31dcf187 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:02 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac45f517-d41c-44f3-8943-328413f3ad3e tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:24:02 user nova-compute[72418]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)
Aug 09 18:24:02 user nova-compute[72418]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)
Aug 09 18:24:02 user nova-compute[72418]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)
Aug 09 18:24:02 user nova-compute[72418]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4525421-c0f1-4a81-8cfc-a10b31dcf187 (non-flash)
Aug 09 18:24:02 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:24:02 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac45f517-d41c-44f3-8943-328413f3ad3e tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:24:02 user nova-compute[72418]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)
Aug 09 18:24:02 user nova-compute[72418]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)
Aug 09 18:24:02 user nova-compute[72418]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)
Aug 09 18:24:02 user nova-compute[72418]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4525421-c0f1-4a81-8cfc-a10b31dcf187 (non-flash)
Aug 09 18:24:02 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:24:02 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac45f517-d41c-44f3-8943-328413f3ad3e tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f43000d4c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4525421-c0f1-4a81-8cfc-a10b31dcf187'): ({'sdf'}, set())}) {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 18:24:02 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-ac45f517-d41c-44f3-8943-328413f3ad3e tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Removing single pathed devices sdf {{(pid=72418) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 18:24:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:02 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a31575-1d68-4717-90f8-6edecd4e9b85]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:02 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df441ca-26a5-4179-aaca-2891cbbba975]: (4, ('ok\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:02 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-ac45f517-d41c-44f3-8943-328413f3ad3e tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Flushing IO for device /dev/sdf {{(pid=72418) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 18:24:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:02 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad05f79-2d97-4889-92c8-a49347ebbc96]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:02 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-ac45f517-d41c-44f3-8943-328413f3ad3e tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72418) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 18:24:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.064s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:02 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9905bdf-52c3-4ac7-963d-7a4d114b88d6]: (4, ('1', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:02 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-ac45f517-d41c-44f3-8943-328413f3ad3e tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 18:24:02 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-ac45f517-d41c-44f3-8943-328413f3ad3e tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] SCSI volumes sdf have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 18:24:02 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac45f517-d41c-44f3-8943-328413f3ad3e tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4525421-c0f1-4a81-8cfc-a10b31dcf187')] {{(pid=72418) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 18:24:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4525421-c0f1-4a81-8cfc-a10b31dcf187 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4525421-c0f1-4a81-8cfc-a10b31dcf187 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:02 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7238b39-2223-4ecc-b7c1-cdac5a9d7553]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:02 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac45f517-d41c-44f3-8943-328413f3ad3e tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:24:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4525421-c0f1-4a81-8cfc-a10b31dcf187 -p 172.16.0.220:3260 --logout {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4525421-c0f1-4a81-8cfc-a10b31dcf187 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:02 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89feb4f-1b0e-439e-b501-18270b1c2db2]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:b4525421-c0f1-4a81-8cfc-a10b31dcf187, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:b4525421-c0f1-4a81-8cfc-a10b31dcf187, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:02 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac45f517-d41c-44f3-8943-328413f3ad3e tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:b4525421-c0f1-4a81-8cfc-a10b31dcf187, portal: 172.16.0.220,3260]
Aug 09 18:24:02 user nova-compute[72418]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:b4525421-c0f1-4a81-8cfc-a10b31dcf187, portal: 172.16.0.220,3260] successful.
Aug 09 18:24:02 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:24:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4525421-c0f1-4a81-8cfc-a10b31dcf187 -p 172.16.0.220:3260 --op delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4525421-c0f1-4a81-8cfc-a10b31dcf187 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:02 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac59571-e57d-4ddd-b0c0-c5fe074529d5]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:02 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac45f517-d41c-44f3-8943-328413f3ad3e tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:24:02 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-ac45f517-d41c-44f3-8943-328413f3ad3e tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:24:02 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac45f517-d41c-44f3-8943-328413f3ad3e tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] <== disconnect_volume: return (362ms) None {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:24:02 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac45f517-d41c-44f3-8943-328413f3ad3e tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Disconnected iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 18:24:02 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-ac45f517-d41c-44f3-8943-328413f3ad3e tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Deleting instance files /opt/stack/data/nova/instances/17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6_del
Aug 09 18:24:02 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-ac45f517-d41c-44f3-8943-328413f3ad3e tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Deletion of /opt/stack/data/nova/instances/17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6_del complete
Aug 09 18:24:02 user nova-compute[72418]: INFO nova.compute.manager [None req-ac45f517-d41c-44f3-8943-328413f3ad3e tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Took 1.33 seconds to destroy the instance on the hypervisor.
Aug 09 18:24:02 user nova-compute[72418]: DEBUG oslo.service.loopingcall [None req-ac45f517-d41c-44f3-8943-328413f3ad3e tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72418) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 18:24:02 user nova-compute[72418]: DEBUG nova.compute.manager [-] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Deallocating network for instance {{(pid=72418) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 18:24:02 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] deallocate_for_instance() {{(pid=72418) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 18:24:04 user nova-compute[72418]: DEBUG nova.compute.manager [req-cede2c8a-988a-4aa8-9d9b-597c004a3e76 req-eb786a34-5aa8-4812-963d-974ecdb13e0f service nova] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Received event network-vif-plugged-c58368cc-29db-48a5-ab5d-a56526aba194 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:24:04 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-cede2c8a-988a-4aa8-9d9b-597c004a3e76 req-eb786a34-5aa8-4812-963d-974ecdb13e0f service nova] Acquiring lock "17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:24:04 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-cede2c8a-988a-4aa8-9d9b-597c004a3e76 req-eb786a34-5aa8-4812-963d-974ecdb13e0f service nova] Lock "17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:24:04 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-cede2c8a-988a-4aa8-9d9b-597c004a3e76 req-eb786a34-5aa8-4812-963d-974ecdb13e0f service nova] Lock "17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:24:04 user nova-compute[72418]: DEBUG nova.compute.manager [req-cede2c8a-988a-4aa8-9d9b-597c004a3e76 req-eb786a34-5aa8-4812-963d-974ecdb13e0f service nova] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] No waiting events found dispatching network-vif-plugged-c58368cc-29db-48a5-ab5d-a56526aba194 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:24:04 user nova-compute[72418]: WARNING nova.compute.manager [req-cede2c8a-988a-4aa8-9d9b-597c004a3e76 req-eb786a34-5aa8-4812-963d-974ecdb13e0f service nova] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Received unexpected event network-vif-plugged-c58368cc-29db-48a5-ab5d-a56526aba194 for instance with vm_state active and task_state deleting.
Aug 09 18:24:04 user nova-compute[72418]: DEBUG nova.compute.manager [req-780f8bf0-12c0-445e-823f-df438a4b2b1c req-f1d3f30d-7076-40d5-af71-a1735e3d3a01 service nova] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Received event network-changed-e6c1511d-0765-4136-854a-e9a673db5071 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:24:04 user nova-compute[72418]: DEBUG nova.compute.manager [req-780f8bf0-12c0-445e-823f-df438a4b2b1c req-f1d3f30d-7076-40d5-af71-a1735e3d3a01 service nova] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Refreshing instance network info cache due to event network-changed-e6c1511d-0765-4136-854a-e9a673db5071. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:24:04 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-780f8bf0-12c0-445e-823f-df438a4b2b1c req-f1d3f30d-7076-40d5-af71-a1735e3d3a01 service nova] Acquiring lock "refresh_cache-4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:24:04 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-780f8bf0-12c0-445e-823f-df438a4b2b1c req-f1d3f30d-7076-40d5-af71-a1735e3d3a01 service nova] Acquired lock "refresh_cache-4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:24:04 user nova-compute[72418]: DEBUG nova.network.neutron [req-780f8bf0-12c0-445e-823f-df438a4b2b1c req-f1d3f30d-7076-40d5-af71-a1735e3d3a01 service nova] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Refreshing network info cache for port e6c1511d-0765-4136-854a-e9a673db5071 {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:24:04 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:24:04 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Took 2.09 seconds to deallocate network for instance.
Aug 09 18:24:05 user nova-compute[72418]: DEBUG nova.network.neutron [req-780f8bf0-12c0-445e-823f-df438a4b2b1c req-f1d3f30d-7076-40d5-af71-a1735e3d3a01 service nova] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Updated VIF entry in instance network info cache for port e6c1511d-0765-4136-854a-e9a673db5071. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:24:05 user nova-compute[72418]: DEBUG nova.network.neutron [req-780f8bf0-12c0-445e-823f-df438a4b2b1c req-f1d3f30d-7076-40d5-af71-a1735e3d3a01 service nova] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Updating instance_info_cache with network_info: [{"id": "e6c1511d-0765-4136-854a-e9a673db5071", "address": "fa:16:3e:ca:f9:2b", "network": {"id": "57e1bdad-aad5-47b8-854b-68f3c1375325", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1415993909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f09f1028304efd84f2e694efdae063", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c1511d-07", "ovs_interfaceid": "e6c1511d-0765-4136-854a-e9a673db5071", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:24:05 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-4afa082f-fcdc-43e0-85d1-811a2bc3f0e0 tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] Acquiring lock "6084e681-01c4-4a6c-beb3-dcda4a990a51" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:24:05 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-4afa082f-fcdc-43e0-85d1-811a2bc3f0e0 tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] Lock "6084e681-01c4-4a6c-beb3-dcda4a990a51" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:24:05 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-780f8bf0-12c0-445e-823f-df438a4b2b1c req-f1d3f30d-7076-40d5-af71-a1735e3d3a01 service nova] Releasing lock "refresh_cache-4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:24:05 user nova-compute[72418]: DEBUG nova.objects.instance [None req-4afa082f-fcdc-43e0-85d1-811a2bc3f0e0 tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] Lazy-loading 'flavor' on Instance uuid 6084e681-01c4-4a6c-beb3-dcda4a990a51 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:24:05 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-4afa082f-fcdc-43e0-85d1-811a2bc3f0e0 tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] Lock "6084e681-01c4-4a6c-beb3-dcda4a990a51" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.095s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:24:05 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-4afa082f-fcdc-43e0-85d1-811a2bc3f0e0 tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] Acquiring lock "6084e681-01c4-4a6c-beb3-dcda4a990a51" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:24:05 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-4afa082f-fcdc-43e0-85d1-811a2bc3f0e0 tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] Lock "6084e681-01c4-4a6c-beb3-dcda4a990a51" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:24:05 user nova-compute[72418]: INFO nova.compute.manager [None req-4afa082f-fcdc-43e0-85d1-811a2bc3f0e0 tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Attaching volume b15b8a52-21ea-41a6-a7fb-b3e6bf95b084 to /dev/vdb
Aug 09 18:24:05 user nova-compute[72418]: DEBUG os_brick.utils [None req-4afa082f-fcdc-43e0-85d1-811a2bc3f0e0 tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:24:05 user nova-compute[72418]: INFO nova.compute.manager [None req-ac45f517-d41c-44f3-8943-328413f3ad3e tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Took 1.02 seconds to detach 1 volumes for instance.
Aug 09 18:24:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:05 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffcb442b-0f34-4320-aad2-ee4154fb0260]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ad56b243ad71\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:05 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[49332635-405b-4e00-a206-becf07cffdd7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:05 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ac45f517-d41c-44f3-8943-328413f3ad3e tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:24:05 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ac45f517-d41c-44f3-8943-328413f3ad3e tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:24:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:05 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f77e44c-bb1c-452e-b258-e0f1a5d8e799]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:05 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9437fe-c1b3-47ab-a4b8-c99e8c934e3d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-4afa082f-fcdc-43e0-85d1-811a2bc3f0e0 tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] Running cmd (subprocess): nvme version {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-4afa082f-fcdc-43e0-85d1-811a2bc3f0e0 tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:24:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4afa082f-fcdc-43e0-85d1-811a2bc3f0e0 tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] nvme not present on system {{(pid=72418) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 18:24:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:24:06 user nova-compute[72418]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 18:24:06 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[72256b8c-e50a-44c3-8b36-e09e8a0b826c]: (4, '') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:06 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-4afa082f-fcdc-43e0-85d1-811a2bc3f0e0 tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72418) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 18:24:06 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-4afa082f-fcdc-43e0-85d1-811a2bc3f0e0 tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 18:24:06 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-4afa082f-fcdc-43e0-85d1-811a2bc3f0e0 tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] LIGHTOS: no hostnqn found. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 18:24:06 user nova-compute[72418]: DEBUG os_brick.utils [None req-4afa082f-fcdc-43e0-85d1-811a2bc3f0e0 tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ad56b243ad71', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:24:06 user nova-compute[72418]: DEBUG nova.virt.block_device [None req-4afa082f-fcdc-43e0-85d1-811a2bc3f0e0 tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Updating existing volume attachment record: 424bd912-a3b3-4334-8560-8559fa689803 {{(pid=72418) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 18:24:06 user nova-compute[72418]: DEBUG nova.compute.manager [req-4b32db5b-995e-4229-8e64-d8c8d701200a req-fd7008c8-f41e-4261-891a-f4090f8db4c6 service nova] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Received event network-changed-ae43991a-cb38-4bb3-ae7e-9c72684dcdd9 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:24:06 user nova-compute[72418]: DEBUG nova.compute.manager [req-4b32db5b-995e-4229-8e64-d8c8d701200a req-fd7008c8-f41e-4261-891a-f4090f8db4c6 service nova] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Refreshing instance network info cache due to event network-changed-ae43991a-cb38-4bb3-ae7e-9c72684dcdd9. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:24:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-4b32db5b-995e-4229-8e64-d8c8d701200a req-fd7008c8-f41e-4261-891a-f4090f8db4c6 service nova] Acquiring lock "refresh_cache-6084e681-01c4-4a6c-beb3-dcda4a990a51" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:24:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-4b32db5b-995e-4229-8e64-d8c8d701200a req-fd7008c8-f41e-4261-891a-f4090f8db4c6 service nova] Acquired lock "refresh_cache-6084e681-01c4-4a6c-beb3-dcda4a990a51" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:24:06 user nova-compute[72418]: DEBUG nova.network.neutron [req-4b32db5b-995e-4229-8e64-d8c8d701200a req-fd7008c8-f41e-4261-891a-f4090f8db4c6 service nova] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Refreshing network info cache for port ae43991a-cb38-4bb3-ae7e-9c72684dcdd9 {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:24:06 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-ac45f517-d41c-44f3-8943-328413f3ad3e tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:24:06 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-ac45f517-d41c-44f3-8943-328413f3ad3e tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:24:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ac45f517-d41c-44f3-8943-328413f3ad3e tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.655s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:24:06 user nova-compute[72418]: INFO nova.scheduler.client.report [None req-ac45f517-d41c-44f3-8943-328413f3ad3e tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Deleted allocations for instance 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6
Aug 09 18:24:06 user nova-compute[72418]: DEBUG nova.network.neutron [req-4b32db5b-995e-4229-8e64-d8c8d701200a req-fd7008c8-f41e-4261-891a-f4090f8db4c6 service nova] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Updated VIF entry in instance network info cache for port ae43991a-cb38-4bb3-ae7e-9c72684dcdd9. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:24:06 user nova-compute[72418]: DEBUG nova.network.neutron [req-4b32db5b-995e-4229-8e64-d8c8d701200a req-fd7008c8-f41e-4261-891a-f4090f8db4c6 service nova] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Updating instance_info_cache with network_info: [{"id": "ae43991a-cb38-4bb3-ae7e-9c72684dcdd9", "address": "fa:16:3e:98:e7:5b", "network": {"id": "625ace3e-82b3-4e9c-b5d2-018f7c686cf4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1965184187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df6a65ef22db446c9cda523621cda645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae43991a-cb", "ovs_interfaceid": "ae43991a-cb38-4bb3-ae7e-9c72684dcdd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:24:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ac45f517-d41c-44f3-8943-328413f3ad3e tempest-DeleteServersTestJSON-1562741887 tempest-DeleteServersTestJSON-1562741887-project-member] Lock "17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.381s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:24:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-4b32db5b-995e-4229-8e64-d8c8d701200a req-fd7008c8-f41e-4261-891a-f4090f8db4c6 service nova] Releasing lock "refresh_cache-6084e681-01c4-4a6c-beb3-dcda4a990a51" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:24:06 user nova-compute[72418]: DEBUG nova.compute.manager [req-4b32db5b-995e-4229-8e64-d8c8d701200a req-fd7008c8-f41e-4261-891a-f4090f8db4c6 service nova] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Received event network-vif-deleted-c58368cc-29db-48a5-ab5d-a56526aba194 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:24:07 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:24:07 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:24:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-68062e4f-0264-42c1-a5f1-462620ec2054 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Acquiring lock "4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:24:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-68062e4f-0264-42c1-a5f1-462620ec2054 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Lock "4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:24:09 user nova-compute[72418]: DEBUG nova.objects.instance [None req-68062e4f-0264-42c1-a5f1-462620ec2054 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Lazy-loading 'flavor' on Instance uuid 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:24:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-68062e4f-0264-42c1-a5f1-462620ec2054 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Lock "4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:24:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-68062e4f-0264-42c1-a5f1-462620ec2054 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Acquiring lock "4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:24:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-68062e4f-0264-42c1-a5f1-462620ec2054 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Lock "4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:24:09 user nova-compute[72418]: INFO nova.compute.manager [None req-68062e4f-0264-42c1-a5f1-462620ec2054 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Attaching volume a5c27e91-240a-4425-8cc8-42ab8d92b2ca to /dev/vdb
Aug 09 18:24:09 user nova-compute[72418]: DEBUG os_brick.utils [None req-68062e4f-0264-42c1-a5f1-462620ec2054 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:24:09 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:09 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:09 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[956bc0e4-2517-4a49-bb6d-c94e8c0d2410]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ad56b243ad71\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:09 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:09 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:09 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd34541-491b-4ef5-9f00-8f2b0f43bf7a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:09 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:09 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:09 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a529ce1-493a-4a18-aea9-1418c863f9ec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:09 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e28ff3-cff3-46e8-9866-a4f5bd737057]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:09 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-68062e4f-0264-42c1-a5f1-462620ec2054 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Running cmd (subprocess): nvme version {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:09 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-68062e4f-0264-42c1-a5f1-462620ec2054 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] 'nvme version' failed. Not Retrying. {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:24:09 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.nvmeof [None req-68062e4f-0264-42c1-a5f1-462620ec2054 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] nvme not present on system {{(pid=72418) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 18:24:09 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:09 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:24:09 user nova-compute[72418]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 18:24:09 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4c3774-5221-4d9d-8cdd-db4f11f219b4]: (4, '') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:09 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-68062e4f-0264-42c1-a5f1-462620ec2054 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72418) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 18:24:09 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-68062e4f-0264-42c1-a5f1-462620ec2054 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 18:24:09 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-68062e4f-0264-42c1-a5f1-462620ec2054 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] LIGHTOS: no hostnqn found. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 18:24:09 user nova-compute[72418]: DEBUG os_brick.utils [None req-68062e4f-0264-42c1-a5f1-462620ec2054 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ad56b243ad71', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:24:09 user nova-compute[72418]: DEBUG nova.virt.block_device [None req-68062e4f-0264-42c1-a5f1-462620ec2054 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Updating existing volume attachment record: 9de923d1-a551-46b7-bdd6-18c2c6c7174a {{(pid=72418) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 18:24:12 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:24:12 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:24:15 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:24:15 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4afa082f-fcdc-43e0-85d1-811a2bc3f0e0 tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Calling os-brick to attach iSCSI Volume {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 18:24:15 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afa082f-fcdc-43e0-85d1-811a2bc3f0e0 tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b15b8a52-21ea-41a6-a7fb-b3e6bf95b084'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PLXsFxbn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:24:15 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-4afa082f-fcdc-43e0-85d1-811a2bc3f0e0 tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:24:15 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-4afa082f-fcdc-43e0-85d1-811a2bc3f0e0 tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:24:15 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-4afa082f-fcdc-43e0-85d1-811a2bc3f0e0 tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:24:15 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-4afa082f-fcdc-43e0-85d1-811a2bc3f0e0 tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:24:15 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-4afa082f-fcdc-43e0-85d1-811a2bc3f0e0 tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b15b8a52-21ea-41a6-a7fb-b3e6bf95b084" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:24:15 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-4afa082f-fcdc-43e0-85d1-811a2bc3f0e0 tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b15b8a52-21ea-41a6-a7fb-b3e6bf95b084" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:24:15 user nova-compute[72418]: INFO os_brick.initiator.connectors.iscsi [None req-4afa082f-fcdc-43e0-85d1-811a2bc3f0e0 tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 18:24:15 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b15b8a52-21ea-41a6-a7fb-b3e6bf95b084 -p 172.16.0.220:3260 {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:15 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b15b8a52-21ea-41a6-a7fb-b3e6bf95b084 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:15 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ed405a-8d52-40bf-bc03-f439bf243fc6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:15 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afa082f-fcdc-43e0-85d1-811a2bc3f0e0 tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 18:24:15 user nova-compute[72418]:  {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:24:15 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b15b8a52-21ea-41a6-a7fb-b3e6bf95b084 -p 172.16.0.220:3260 --interface default --op new {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:15 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b15b8a52-21ea-41a6-a7fb-b3e6bf95b084 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:15 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c083d1e-508f-43c0-83dd-cddeaea5942f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b15b8a52-21ea-41a6-a7fb-b3e6bf95b084] added\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:15 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afa082f-fcdc-43e0-85d1-811a2bc3f0e0 tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b15b8a52-21ea-41a6-a7fb-b3e6bf95b084] added
Aug 09 18:24:15 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:24:15 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b15b8a52-21ea-41a6-a7fb-b3e6bf95b084 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:15 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b15b8a52-21ea-41a6-a7fb-b3e6bf95b084 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:15 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e20e62-a511-411c-a716-1a09773a188d]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:15 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afa082f-fcdc-43e0-85d1-811a2bc3f0e0 tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:24:15 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b15b8a52-21ea-41a6-a7fb-b3e6bf95b084 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:15 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b15b8a52-21ea-41a6-a7fb-b3e6bf95b084 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:15 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[98182f47-8e8c-4685-a22a-f90dc70f8c70]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:15 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afa082f-fcdc-43e0-85d1-811a2bc3f0e0 tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:24:15 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b15b8a52-21ea-41a6-a7fb-b3e6bf95b084 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PLXsFxbn {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:15 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b15b8a52-21ea-41a6-a7fb-b3e6bf95b084 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PLXsFxbn" returned: 0 in 0.031s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:15 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49b118b-f971-4ed4-b652-f148e4039de6]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:15 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afa082f-fcdc-43e0-85d1-811a2bc3f0e0 tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PLXsFxbn'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:24:15 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b15b8a52-21ea-41a6-a7fb-b3e6bf95b084 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:15 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b15b8a52-21ea-41a6-a7fb-b3e6bf95b084 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:15 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[0506aaef-3ea5-49a9-8860-495a48eced9e]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:15 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afa082f-fcdc-43e0-85d1-811a2bc3f0e0 tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:24:15 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:15 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:15 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce703a06-1a22-433d-881a-d15159878a9d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:15 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afa082f-fcdc-43e0-85d1-811a2bc3f0e0 tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:24:15 user nova-compute[72418]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)
Aug 09 18:24:15 user nova-compute[72418]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)
Aug 09 18:24:15 user nova-compute[72418]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)
Aug 09 18:24:15 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:24:15 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afa082f-fcdc-43e0-85d1-811a2bc3f0e0 tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:24:15 user nova-compute[72418]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)
Aug 09 18:24:15 user nova-compute[72418]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)
Aug 09 18:24:15 user nova-compute[72418]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)
Aug 09 18:24:15 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:24:15 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b15b8a52-21ea-41a6-a7fb-b3e6bf95b084 -p 172.16.0.220:3260 --login {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:15 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b15b8a52-21ea-41a6-a7fb-b3e6bf95b084 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:15 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[192bcbf3-6d5e-47c7-9469-8cfe0a3fc816]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b15b8a52-21ea-41a6-a7fb-b3e6bf95b084, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b15b8a52-21ea-41a6-a7fb-b3e6bf95b084, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:15 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afa082f-fcdc-43e0-85d1-811a2bc3f0e0 tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b15b8a52-21ea-41a6-a7fb-b3e6bf95b084, portal: 172.16.0.220,3260]
Aug 09 18:24:15 user nova-compute[72418]: Login to [iface: default, target: iqn.2010-10.org.openstack:b15b8a52-21ea-41a6-a7fb-b3e6bf95b084, portal: 172.16.0.220,3260] successful.
Aug 09 18:24:15 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:24:15 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b15b8a52-21ea-41a6-a7fb-b3e6bf95b084 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:15 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b15b8a52-21ea-41a6-a7fb-b3e6bf95b084 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:15 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ee6d58-4c6d-4437-8e3f-f6e89e323848]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:15 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afa082f-fcdc-43e0-85d1-811a2bc3f0e0 tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:24:15 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:15 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:15 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7b203f-2766-459d-a418-f10202859249]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15b8a52-21ea-41a6-a7fb-b3e6bf95b084 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:15 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afa082f-fcdc-43e0-85d1-811a2bc3f0e0 tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:24:15 user nova-compute[72418]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)
Aug 09 18:24:15 user nova-compute[72418]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)
Aug 09 18:24:15 user nova-compute[72418]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)
Aug 09 18:24:15 user nova-compute[72418]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15b8a52-21ea-41a6-a7fb-b3e6bf95b084 (non-flash)
Aug 09 18:24:15 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:24:15 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afa082f-fcdc-43e0-85d1-811a2bc3f0e0 tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:24:15 user nova-compute[72418]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)
Aug 09 18:24:15 user nova-compute[72418]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)
Aug 09 18:24:15 user nova-compute[72418]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)
Aug 09 18:24:15 user nova-compute[72418]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15b8a52-21ea-41a6-a7fb-b3e6bf95b084 (non-flash)
Aug 09 18:24:15 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:24:15 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-4afa082f-fcdc-43e0-85d1-811a2bc3f0e0 tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b15b8a52-21ea-41a6-a7fb-b3e6bf95b084" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:24:15 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afa082f-fcdc-43e0-85d1-811a2bc3f0e0 tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] Connected to 172.16.0.220:3260 {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 18:24:15 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-4afa082f-fcdc-43e0-85d1-811a2bc3f0e0 tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=72418) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 18:24:15 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-4afa082f-fcdc-43e0-85d1-811a2bc3f0e0 tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=72418) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 18:24:16 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:16 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:16 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f633d89-22e1-4833-a0f7-3324a55bc0cb]: (4, ('- - 0', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:16 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-4afa082f-fcdc-43e0-85d1-811a2bc3f0e0 tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72418) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 18:24:16 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afa082f-fcdc-43e0-85d1-811a2bc3f0e0 tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PLXsFxbn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 18:24:17 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-4afa082f-fcdc-43e0-85d1-811a2bc3f0e0 tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.388s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:24:17 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afa082f-fcdc-43e0-85d1-811a2bc3f0e0 tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] <== connect_volume: return (1390ms) {'type': 'block', 'scsi_wwn': '23537363266323036', 'path': '/dev/sdf'} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:24:17 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4afa082f-fcdc-43e0-85d1-811a2bc3f0e0 tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537363266323036', 'path': '/dev/sdf'} {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 18:24:17 user nova-compute[72418]: DEBUG nova.objects.instance [None req-4afa082f-fcdc-43e0-85d1-811a2bc3f0e0 tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] Lazy-loading 'flavor' on Instance uuid 6084e681-01c4-4a6c-beb3-dcda4a990a51 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:24:17 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:24:17 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-4afa082f-fcdc-43e0-85d1-811a2bc3f0e0 tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] attach device xml: <disk type="block" device="disk">
Aug 09 18:24:17 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:24:17 user nova-compute[72418]:   <source dev="/dev/sdf"/>
Aug 09 18:24:17 user nova-compute[72418]:   <target dev="vdb" bus="virtio"/>
Aug 09 18:24:17 user nova-compute[72418]:   <serial>b15b8a52-21ea-41a6-a7fb-b3e6bf95b084</serial>
Aug 09 18:24:17 user nova-compute[72418]: </disk>
Aug 09 18:24:17 user nova-compute[72418]:  {{(pid=72418) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 18:24:17 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:24:17 user nova-compute[72418]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691605442.2297852, 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6 => Stopped> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:24:17 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] VM Stopped (Lifecycle Event)
Aug 09 18:24:17 user nova-compute[72418]: DEBUG nova.compute.manager [None req-68ce9907-1d8a-427e-86da-8840eada682c None None] [instance: 17fbed62-a6a5-4eaa-85cb-c1a7a0b0c6f6] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:24:17 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:24:17 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-4afa082f-fcdc-43e0-85d1-811a2bc3f0e0 tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:24:17 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-4afa082f-fcdc-43e0-85d1-811a2bc3f0e0 tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:24:17 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-4afa082f-fcdc-43e0-85d1-811a2bc3f0e0 tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] No VIF found with MAC fa:16:3e:98:e7:5b, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:24:17 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-4afa082f-fcdc-43e0-85d1-811a2bc3f0e0 tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] Lock "6084e681-01c4-4a6c-beb3-dcda4a990a51" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.978s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:24:18 user nova-compute[72418]: DEBUG nova.compute.manager [req-026d031b-b507-4db3-86d4-2ff8fb4cc9c1 req-6722f975-92e8-44dd-9d07-e7bb3f9c8ea2 service nova] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Received event network-changed-e53ca69c-b53f-4f5f-b8fa-f8a66b4177f5 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:24:18 user nova-compute[72418]: DEBUG nova.compute.manager [req-026d031b-b507-4db3-86d4-2ff8fb4cc9c1 req-6722f975-92e8-44dd-9d07-e7bb3f9c8ea2 service nova] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Refreshing instance network info cache due to event network-changed-e53ca69c-b53f-4f5f-b8fa-f8a66b4177f5. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:24:18 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-026d031b-b507-4db3-86d4-2ff8fb4cc9c1 req-6722f975-92e8-44dd-9d07-e7bb3f9c8ea2 service nova] Acquiring lock "refresh_cache-dabfdb24-fc0b-4a00-a229-1ece48e27d18" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:24:18 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-026d031b-b507-4db3-86d4-2ff8fb4cc9c1 req-6722f975-92e8-44dd-9d07-e7bb3f9c8ea2 service nova] Acquired lock "refresh_cache-dabfdb24-fc0b-4a00-a229-1ece48e27d18" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:24:18 user nova-compute[72418]: DEBUG nova.network.neutron [req-026d031b-b507-4db3-86d4-2ff8fb4cc9c1 req-6722f975-92e8-44dd-9d07-e7bb3f9c8ea2 service nova] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Refreshing network info cache for port e53ca69c-b53f-4f5f-b8fa-f8a66b4177f5 {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:24:18 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-8b523aa9-27da-4d1b-98a2-1b6031cf48d4 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Acquiring lock "dabfdb24-fc0b-4a00-a229-1ece48e27d18" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:24:18 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-8b523aa9-27da-4d1b-98a2-1b6031cf48d4 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Lock "dabfdb24-fc0b-4a00-a229-1ece48e27d18" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:24:18 user nova-compute[72418]: DEBUG nova.objects.instance [None req-8b523aa9-27da-4d1b-98a2-1b6031cf48d4 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Lazy-loading 'flavor' on Instance uuid dabfdb24-fc0b-4a00-a229-1ece48e27d18 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:24:18 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-8b523aa9-27da-4d1b-98a2-1b6031cf48d4 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Lock "dabfdb24-fc0b-4a00-a229-1ece48e27d18" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.099s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:24:18 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-ce0d4477-be24-4c96-bb82-409a14d7107b tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] volume_snapshot_create: create_info: {'snapshot_id': 'a061f3a9-ad02-4dc9-b47b-ead6dffda101', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=72418) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 09 18:24:18 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-ce0d4477-be24-4c96-bb82-409a14d7107b tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] snap xml: <domainsnapshot>
Aug 09 18:24:18 user nova-compute[72418]:   <disks>
Aug 09 18:24:18 user nova-compute[72418]:     <disk name="/dev/sdf" snapshot="external" type="file">
Aug 09 18:24:18 user nova-compute[72418]:       <source file="/dev/new_file"/>
Aug 09 18:24:18 user nova-compute[72418]:     </disk>
Aug 09 18:24:18 user nova-compute[72418]:     <disk name="vda" snapshot="no"/>
Aug 09 18:24:18 user nova-compute[72418]:   </disks>
Aug 09 18:24:18 user nova-compute[72418]: </domainsnapshot>
Aug 09 18:24:18 user nova-compute[72418]:  {{(pid=72418) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 09 18:24:18 user nova-compute[72418]: DEBUG nova.objects.instance [None req-ce0d4477-be24-4c96-bb82-409a14d7107b tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] Lazy-loading 'system_metadata' on Instance uuid 6084e681-01c4-4a6c-beb3-dcda4a990a51 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:24:18 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-ce0d4477-be24-4c96-bb82-409a14d7107b tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 09 18:24:18 user nova-compute[72418]: ERROR nova.virt.libvirt.driver [None req-ce0d4477-be24-4c96-bb82-409a14d7107b tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 18:24:18 user nova-compute[72418]: ERROR nova.virt.libvirt.driver [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Traceback (most recent call last):
Aug 09 18:24:18 user nova-compute[72418]: ERROR nova.virt.libvirt.driver [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 09 18:24:18 user nova-compute[72418]: ERROR nova.virt.libvirt.driver [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 09 18:24:18 user nova-compute[72418]: ERROR nova.virt.libvirt.driver [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 09 18:24:18 user nova-compute[72418]: ERROR nova.virt.libvirt.driver [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 09 18:24:18 user nova-compute[72418]: ERROR nova.virt.libvirt.driver [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 193, in doit
Aug 09 18:24:18 user nova-compute[72418]: ERROR nova.virt.libvirt.driver [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 09 18:24:18 user nova-compute[72418]: ERROR nova.virt.libvirt.driver [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 09 18:24:18 user nova-compute[72418]: ERROR nova.virt.libvirt.driver [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51]     rv = execute(f, *args, **kwargs)
Aug 09 18:24:18 user nova-compute[72418]: ERROR nova.virt.libvirt.driver [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 132, in execute
Aug 09 18:24:18 user nova-compute[72418]: ERROR nova.virt.libvirt.driver [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51]     six.reraise(c, e, tb)
Aug 09 18:24:18 user nova-compute[72418]: ERROR nova.virt.libvirt.driver [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 09 18:24:18 user nova-compute[72418]: ERROR nova.virt.libvirt.driver [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51]     raise value
Aug 09 18:24:18 user nova-compute[72418]: ERROR nova.virt.libvirt.driver [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 86, in tworker
Aug 09 18:24:18 user nova-compute[72418]: ERROR nova.virt.libvirt.driver [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51]     rv = meth(*args, **kwargs)
Aug 09 18:24:18 user nova-compute[72418]: ERROR nova.virt.libvirt.driver [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 09 18:24:18 user nova-compute[72418]: ERROR nova.virt.libvirt.driver [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 09 18:24:18 user nova-compute[72418]: ERROR nova.virt.libvirt.driver [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 18:24:18 user nova-compute[72418]: ERROR nova.virt.libvirt.driver [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] 
Aug 09 18:24:18 user nova-compute[72418]: ERROR nova.virt.libvirt.driver [None req-ce0d4477-be24-4c96-bb82-409a14d7107b tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 18:24:18 user nova-compute[72418]: ERROR nova.virt.libvirt.driver [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Traceback (most recent call last):
Aug 09 18:24:18 user nova-compute[72418]: ERROR nova.virt.libvirt.driver [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 09 18:24:18 user nova-compute[72418]: ERROR nova.virt.libvirt.driver [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51]     self._volume_snapshot_create(context, instance, guest,
Aug 09 18:24:18 user nova-compute[72418]: ERROR nova.virt.libvirt.driver [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 09 18:24:18 user nova-compute[72418]: ERROR nova.virt.libvirt.driver [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 09 18:24:18 user nova-compute[72418]: ERROR nova.virt.libvirt.driver [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 09 18:24:18 user nova-compute[72418]: ERROR nova.virt.libvirt.driver [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 09 18:24:18 user nova-compute[72418]: ERROR nova.virt.libvirt.driver [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 193, in doit
Aug 09 18:24:18 user nova-compute[72418]: ERROR nova.virt.libvirt.driver [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 09 18:24:18 user nova-compute[72418]: ERROR nova.virt.libvirt.driver [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 09 18:24:18 user nova-compute[72418]: ERROR nova.virt.libvirt.driver [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51]     rv = execute(f, *args, **kwargs)
Aug 09 18:24:18 user nova-compute[72418]: ERROR nova.virt.libvirt.driver [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 132, in execute
Aug 09 18:24:18 user nova-compute[72418]: ERROR nova.virt.libvirt.driver [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51]     six.reraise(c, e, tb)
Aug 09 18:24:18 user nova-compute[72418]: ERROR nova.virt.libvirt.driver [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 09 18:24:18 user nova-compute[72418]: ERROR nova.virt.libvirt.driver [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51]     raise value
Aug 09 18:24:18 user nova-compute[72418]: ERROR nova.virt.libvirt.driver [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 86, in tworker
Aug 09 18:24:18 user nova-compute[72418]: ERROR nova.virt.libvirt.driver [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51]     rv = meth(*args, **kwargs)
Aug 09 18:24:18 user nova-compute[72418]: ERROR nova.virt.libvirt.driver [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 09 18:24:18 user nova-compute[72418]: ERROR nova.virt.libvirt.driver [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 09 18:24:18 user nova-compute[72418]: ERROR nova.virt.libvirt.driver [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 18:24:18 user nova-compute[72418]: ERROR nova.virt.libvirt.driver [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] 
Aug 09 18:24:18 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-de33b919-83bb-4583-abe3-947aebd3fdaa tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] volume_snapshot_delete: delete_info: {'volume_id': 'b15b8a52-21ea-41a6-a7fb-b3e6bf95b084'} {{(pid=72418) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 09 18:24:18 user nova-compute[72418]: ERROR nova.virt.libvirt.driver [None req-de33b919-83bb-4583-abe3-947aebd3fdaa tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 09 18:24:18 user nova-compute[72418]: ERROR nova.virt.libvirt.driver [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Traceback (most recent call last):
Aug 09 18:24:18 user nova-compute[72418]: ERROR nova.virt.libvirt.driver [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 09 18:24:18 user nova-compute[72418]: ERROR nova.virt.libvirt.driver [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 09 18:24:18 user nova-compute[72418]: ERROR nova.virt.libvirt.driver [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 09 18:24:18 user nova-compute[72418]: ERROR nova.virt.libvirt.driver [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51]     if delete_info['type'] != 'qcow2':
Aug 09 18:24:18 user nova-compute[72418]: ERROR nova.virt.libvirt.driver [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] KeyError: 'type'
Aug 09 18:24:18 user nova-compute[72418]: ERROR nova.virt.libvirt.driver [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] 
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver [None req-ce0d4477-be24-4c96-bb82-409a14d7107b tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot a061f3a9-ad02-4dc9-b47b-ead6dffda101 could not be found.
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 193, in doit
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 132, in execute
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver     raise value
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 86, in tworker
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver 
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver 
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 223, in post
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot a061f3a9-ad02-4dc9-b47b-ead6dffda101 could not be found. (HTTP 404) (Request-ID: req-ecd5e9d1-5075-4f73-bb78-24c51d540fe2)
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver 
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver 
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 223, in post
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot a061f3a9-ad02-4dc9-b47b-ead6dffda101 could not be found.
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver 
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver [None req-de33b919-83bb-4583-abe3-947aebd3fdaa tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver 
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver 
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 223, in post
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-eaf41ad5-0fdd-4ca2-8871-a7d935b9a1b2)
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver 
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver 
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 223, in post
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 09 18:24:19 user nova-compute[72418]: ERROR nova.virt.libvirt.driver 
Aug 09 18:24:19 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-8b523aa9-27da-4d1b-98a2-1b6031cf48d4 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Acquiring lock "dabfdb24-fc0b-4a00-a229-1ece48e27d18" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-8b523aa9-27da-4d1b-98a2-1b6031cf48d4 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Lock "dabfdb24-fc0b-4a00-a229-1ece48e27d18" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:24:19 user nova-compute[72418]: INFO nova.compute.manager [None req-8b523aa9-27da-4d1b-98a2-1b6031cf48d4 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Attaching volume 1d982f88-39fb-45e9-a6c9-4a4379a52ea3 to /dev/vdb
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server [None req-ce0d4477-be24-4c96-bb82-409a14d7107b tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 193, in doit
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 132, in execute
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server     raise value
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 86, in tworker
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server 
Aug 09 18:24:19 user nova-compute[72418]: DEBUG nova.network.neutron [req-026d031b-b507-4db3-86d4-2ff8fb4cc9c1 req-6722f975-92e8-44dd-9d07-e7bb3f9c8ea2 service nova] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Updated VIF entry in instance network info cache for port e53ca69c-b53f-4f5f-b8fa-f8a66b4177f5. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG nova.network.neutron [req-026d031b-b507-4db3-86d4-2ff8fb4cc9c1 req-6722f975-92e8-44dd-9d07-e7bb3f9c8ea2 service nova] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Updating instance_info_cache with network_info: [{"id": "e53ca69c-b53f-4f5f-b8fa-f8a66b4177f5", "address": "fa:16:3e:9a:12:a5", "network": {"id": "6dd2923f-ee1a-4058-abfb-b1fb2b0c8325", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1188534456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cee457e31034445e82a46b87d54ef5f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape53ca69c-b5", "ovs_interfaceid": "e53ca69c-b53f-4f5f-b8fa-f8a66b4177f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server [None req-de33b919-83bb-4583-abe3-947aebd3fdaa tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] Exception during message handling: KeyError: 'type'
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 09 18:24:19 user nova-compute[72418]: ERROR oslo_messaging.rpc.server 
Aug 09 18:24:19 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-026d031b-b507-4db3-86d4-2ff8fb4cc9c1 req-6722f975-92e8-44dd-9d07-e7bb3f9c8ea2 service nova] Releasing lock "refresh_cache-dabfdb24-fc0b-4a00-a229-1ece48e27d18" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG os_brick.utils [None req-8b523aa9-27da-4d1b-98a2-1b6031cf48d4 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcab778-48d6-4123-8fcb-0f260e5f12fd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ad56b243ad71\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[119013da-c238-44cd-9f8e-1b0496124970]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81245f2-6a81-4ff7-aa18-d32c9d50a2b6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fb661c-1d97-4218-b9ee-7bbb51949362]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-8b523aa9-27da-4d1b-98a2-1b6031cf48d4 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Running cmd (subprocess): nvme version {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-8b523aa9-27da-4d1b-98a2-1b6031cf48d4 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] 'nvme version' failed. Not Retrying. {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8b523aa9-27da-4d1b-98a2-1b6031cf48d4 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] nvme not present on system {{(pid=72418) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:24:19 user nova-compute[72418]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 18:24:19 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f26d1d0-794f-462a-867f-4cfcb4328440]: (4, '') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-8b523aa9-27da-4d1b-98a2-1b6031cf48d4 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72418) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-8b523aa9-27da-4d1b-98a2-1b6031cf48d4 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-8b523aa9-27da-4d1b-98a2-1b6031cf48d4 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] LIGHTOS: no hostnqn found. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG os_brick.utils [None req-8b523aa9-27da-4d1b-98a2-1b6031cf48d4 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ad56b243ad71', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG nova.virt.block_device [None req-8b523aa9-27da-4d1b-98a2-1b6031cf48d4 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Updating existing volume attachment record: 4f88a247-a3ee-4664-9c28-1d6bc1d3c883 {{(pid=72418) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-65ed4eb0-aadd-4ddc-a83d-b89f767ce48f tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] Acquiring lock "6084e681-01c4-4a6c-beb3-dcda4a990a51" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-65ed4eb0-aadd-4ddc-a83d-b89f767ce48f tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] Lock "6084e681-01c4-4a6c-beb3-dcda4a990a51" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:24:19 user nova-compute[72418]: INFO nova.compute.manager [None req-65ed4eb0-aadd-4ddc-a83d-b89f767ce48f tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Detaching volume b15b8a52-21ea-41a6-a7fb-b3e6bf95b084
Aug 09 18:24:19 user nova-compute[72418]: INFO nova.virt.block_device [None req-65ed4eb0-aadd-4ddc-a83d-b89f767ce48f tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Attempting to driver detach volume b15b8a52-21ea-41a6-a7fb-b3e6bf95b084 from mountpoint /dev/vdb
Aug 09 18:24:19 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-65ed4eb0-aadd-4ddc-a83d-b89f767ce48f tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] Attempting to detach device vdb from instance 6084e681-01c4-4a6c-beb3-dcda4a990a51 from the persistent domain config. {{(pid=72418) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-65ed4eb0-aadd-4ddc-a83d-b89f767ce48f tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] detach device xml: <disk type="block" device="disk">
Aug 09 18:24:19 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:24:19 user nova-compute[72418]:   <source dev="/dev/sdf"/>
Aug 09 18:24:19 user nova-compute[72418]:   <target dev="vdb" bus="virtio"/>
Aug 09 18:24:19 user nova-compute[72418]:   <serial>b15b8a52-21ea-41a6-a7fb-b3e6bf95b084</serial>
Aug 09 18:24:19 user nova-compute[72418]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 18:24:19 user nova-compute[72418]: </disk>
Aug 09 18:24:19 user nova-compute[72418]:  {{(pid=72418) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 18:24:19 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-65ed4eb0-aadd-4ddc-a83d-b89f767ce48f tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] Successfully detached device vdb from instance 6084e681-01c4-4a6c-beb3-dcda4a990a51 from the persistent domain config.
Aug 09 18:24:19 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-65ed4eb0-aadd-4ddc-a83d-b89f767ce48f tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6084e681-01c4-4a6c-beb3-dcda4a990a51 from the live domain config. {{(pid=72418) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-65ed4eb0-aadd-4ddc-a83d-b89f767ce48f tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] detach device xml: <disk type="block" device="disk">
Aug 09 18:24:19 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:24:19 user nova-compute[72418]:   <source dev="/dev/sdf"/>
Aug 09 18:24:19 user nova-compute[72418]:   <target dev="vdb" bus="virtio"/>
Aug 09 18:24:19 user nova-compute[72418]:   <serial>b15b8a52-21ea-41a6-a7fb-b3e6bf95b084</serial>
Aug 09 18:24:19 user nova-compute[72418]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 18:24:19 user nova-compute[72418]: </disk>
Aug 09 18:24:19 user nova-compute[72418]:  {{(pid=72418) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68062e4f-0264-42c1-a5f1-462620ec2054 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Calling os-brick to attach iSCSI Volume {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-68062e4f-0264-42c1-a5f1-462620ec2054 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a5c27e91-240a-4425-8cc8-42ab8d92b2ca'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JrhBiTbe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:24:19 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-68062e4f-0264-42c1-a5f1-462620ec2054 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:24:19 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-68062e4f-0264-42c1-a5f1-462620ec2054 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-68062e4f-0264-42c1-a5f1-462620ec2054 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:24:19 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-68062e4f-0264-42c1-a5f1-462620ec2054 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:24:19 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-68062e4f-0264-42c1-a5f1-462620ec2054 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5c27e91-240a-4425-8cc8-42ab8d92b2ca" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-68062e4f-0264-42c1-a5f1-462620ec2054 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5c27e91-240a-4425-8cc8-42ab8d92b2ca" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:24:19 user nova-compute[72418]: INFO os_brick.initiator.connectors.iscsi [None req-68062e4f-0264-42c1-a5f1-462620ec2054 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 18:24:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5c27e91-240a-4425-8cc8-42ab8d92b2ca -p 172.16.0.220:3260 {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5c27e91-240a-4425-8cc8-42ab8d92b2ca -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f960a03-6baa-407b-b26c-b7e3045339c6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-68062e4f-0264-42c1-a5f1-462620ec2054 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 18:24:19 user nova-compute[72418]:  {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5c27e91-240a-4425-8cc8-42ab8d92b2ca -p 172.16.0.220:3260 --interface default --op new {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5c27e91-240a-4425-8cc8-42ab8d92b2ca -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebee6842-27ab-42b6-9a98-b2b686846401]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5c27e91-240a-4425-8cc8-42ab8d92b2ca] added\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-68062e4f-0264-42c1-a5f1-462620ec2054 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5c27e91-240a-4425-8cc8-42ab8d92b2ca] added
Aug 09 18:24:19 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5c27e91-240a-4425-8cc8-42ab8d92b2ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5c27e91-240a-4425-8cc8-42ab8d92b2ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[08104860-0c0a-46d5-86b2-c3bce1017055]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-68062e4f-0264-42c1-a5f1-462620ec2054 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5c27e91-240a-4425-8cc8-42ab8d92b2ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5c27e91-240a-4425-8cc8-42ab8d92b2ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbe6f70-08ad-47ed-88ba-33874a6abf11]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-68062e4f-0264-42c1-a5f1-462620ec2054 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5c27e91-240a-4425-8cc8-42ab8d92b2ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JrhBiTbe {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5c27e91-240a-4425-8cc8-42ab8d92b2ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JrhBiTbe" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67b0910-41a8-47eb-926e-60e9c05667f2]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-68062e4f-0264-42c1-a5f1-462620ec2054 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JrhBiTbe'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5c27e91-240a-4425-8cc8-42ab8d92b2ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5c27e91-240a-4425-8cc8-42ab8d92b2ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f363979-d993-4f30-a3f8-a6297bc6b2e8]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-68062e4f-0264-42c1-a5f1-462620ec2054 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[346ecdca-26a7-4df9-8465-49120b49de48]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15b8a52-21ea-41a6-a7fb-b3e6bf95b084 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-68062e4f-0264-42c1-a5f1-462620ec2054 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:24:19 user nova-compute[72418]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)
Aug 09 18:24:19 user nova-compute[72418]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)
Aug 09 18:24:19 user nova-compute[72418]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)
Aug 09 18:24:19 user nova-compute[72418]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15b8a52-21ea-41a6-a7fb-b3e6bf95b084 (non-flash)
Aug 09 18:24:19 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-68062e4f-0264-42c1-a5f1-462620ec2054 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:24:19 user nova-compute[72418]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)
Aug 09 18:24:19 user nova-compute[72418]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)
Aug 09 18:24:19 user nova-compute[72418]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)
Aug 09 18:24:19 user nova-compute[72418]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15b8a52-21ea-41a6-a7fb-b3e6bf95b084 (non-flash)
Aug 09 18:24:19 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Received event <DeviceRemovedEvent: 1691605459.9026492, 6084e681-01c4-4a6c-beb3-dcda4a990a51 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72418) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5c27e91-240a-4425-8cc8-42ab8d92b2ca -p 172.16.0.220:3260 --login {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-65ed4eb0-aadd-4ddc-a83d-b89f767ce48f tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6084e681-01c4-4a6c-beb3-dcda4a990a51 {{(pid=72418) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 18:24:19 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-65ed4eb0-aadd-4ddc-a83d-b89f767ce48f tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] Successfully detached device vdb from instance 6084e681-01c4-4a6c-beb3-dcda4a990a51 from the live domain config.
Aug 09 18:24:19 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65ed4eb0-aadd-4ddc-a83d-b89f767ce48f tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] calling os-brick to detach iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ed4eb0-aadd-4ddc-a83d-b89f767ce48f tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, {'target_iqns': ['iqn.2010-10.org.openstack:b15b8a52-21ea-41a6-a7fb-b3e6bf95b084'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PLXsFxbn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:24:19 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-65ed4eb0-aadd-4ddc-a83d-b89f767ce48f tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:24:19 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-65ed4eb0-aadd-4ddc-a83d-b89f767ce48f tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5c27e91-240a-4425-8cc8-42ab8d92b2ca -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20f6fda-3ad0-4ff5-b4fa-ef5b78c60a37]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5c27e91-240a-4425-8cc8-42ab8d92b2ca, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a5c27e91-240a-4425-8cc8-42ab8d92b2ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-68062e4f-0264-42c1-a5f1-462620ec2054 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5c27e91-240a-4425-8cc8-42ab8d92b2ca, portal: 172.16.0.220,3260]
Aug 09 18:24:19 user nova-compute[72418]: Login to [iface: default, target: iqn.2010-10.org.openstack:a5c27e91-240a-4425-8cc8-42ab8d92b2ca, portal: 172.16.0.220,3260] successful.
Aug 09 18:24:19 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5c27e91-240a-4425-8cc8-42ab8d92b2ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5c27e91-240a-4425-8cc8-42ab8d92b2ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[775e670c-9928-4cb5-ad5c-108dcf18d441]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:19 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-68062e4f-0264-42c1-a5f1-462620ec2054 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:24:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:20 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[01eaf99c-f933-448e-966d-e9607efe150e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15b8a52-21ea-41a6-a7fb-b3e6bf95b084 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c27e91-240a-4425-8cc8-42ab8d92b2ca (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-68062e4f-0264-42c1-a5f1-462620ec2054 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:24:20 user nova-compute[72418]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)
Aug 09 18:24:20 user nova-compute[72418]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)
Aug 09 18:24:20 user nova-compute[72418]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)
Aug 09 18:24:20 user nova-compute[72418]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15b8a52-21ea-41a6-a7fb-b3e6bf95b084 (non-flash)
Aug 09 18:24:20 user nova-compute[72418]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c27e91-240a-4425-8cc8-42ab8d92b2ca (non-flash)
Aug 09 18:24:20 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:24:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-68062e4f-0264-42c1-a5f1-462620ec2054 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:24:20 user nova-compute[72418]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)
Aug 09 18:24:20 user nova-compute[72418]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)
Aug 09 18:24:20 user nova-compute[72418]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)
Aug 09 18:24:20 user nova-compute[72418]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15b8a52-21ea-41a6-a7fb-b3e6bf95b084 (non-flash)
Aug 09 18:24:20 user nova-compute[72418]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c27e91-240a-4425-8cc8-42ab8d92b2ca (non-flash)
Aug 09 18:24:20 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:24:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-68062e4f-0264-42c1-a5f1-462620ec2054 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5c27e91-240a-4425-8cc8-42ab8d92b2ca" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:24:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-68062e4f-0264-42c1-a5f1-462620ec2054 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Connected to 172.16.0.220:3260 {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 18:24:20 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-68062e4f-0264-42c1-a5f1-462620ec2054 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=72418) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 18:24:20 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-68062e4f-0264-42c1-a5f1-462620ec2054 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72418) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 18:24:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:20 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[05026f84-45be-4e4e-9b7d-2108b874e93a]: (4, ('- - 0', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:20 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-68062e4f-0264-42c1-a5f1-462620ec2054 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72418) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 18:24:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-68062e4f-0264-42c1-a5f1-462620ec2054 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JrhBiTbe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 18:24:21 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-68062e4f-0264-42c1-a5f1-462620ec2054 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:24:21 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-68062e4f-0264-42c1-a5f1-462620ec2054 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23431316637313762', 'path': '/dev/sdg'} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:24:21 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68062e4f-0264-42c1-a5f1-462620ec2054 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431316637313762', 'path': '/dev/sdg'} {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 18:24:21 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-65ed4eb0-aadd-4ddc-a83d-b89f767ce48f tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.153s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:24:21 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ed4eb0-aadd-4ddc-a83d-b89f767ce48f tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b15b8a52-21ea-41a6-a7fb-b3e6bf95b084', 0)] {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 18:24:21 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:21 user nova-compute[72418]: DEBUG nova.objects.instance [None req-68062e4f-0264-42c1-a5f1-462620ec2054 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Lazy-loading 'flavor' on Instance uuid 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:24:21 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:21 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d9c819-1aed-4226-a009-3a505c791848]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5c27e91-240a-4425-8cc8-42ab8d92b2ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b15b8a52-21ea-41a6-a7fb-b3e6bf95b084\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:21 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:21 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:21 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e222605-4e58-40eb-9f44-c38c3dd0383d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15b8a52-21ea-41a6-a7fb-b3e6bf95b084 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c27e91-240a-4425-8cc8-42ab8d92b2ca (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:21 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ed4eb0-aadd-4ddc-a83d-b89f767ce48f tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:24:21 user nova-compute[72418]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)
Aug 09 18:24:21 user nova-compute[72418]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)
Aug 09 18:24:21 user nova-compute[72418]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)
Aug 09 18:24:21 user nova-compute[72418]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15b8a52-21ea-41a6-a7fb-b3e6bf95b084 (non-flash)
Aug 09 18:24:21 user nova-compute[72418]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c27e91-240a-4425-8cc8-42ab8d92b2ca (non-flash)
Aug 09 18:24:21 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:24:21 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ed4eb0-aadd-4ddc-a83d-b89f767ce48f tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:24:21 user nova-compute[72418]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)
Aug 09 18:24:21 user nova-compute[72418]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)
Aug 09 18:24:21 user nova-compute[72418]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)
Aug 09 18:24:21 user nova-compute[72418]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15b8a52-21ea-41a6-a7fb-b3e6bf95b084 (non-flash)
Aug 09 18:24:21 user nova-compute[72418]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c27e91-240a-4425-8cc8-42ab8d92b2ca (non-flash)
Aug 09 18:24:21 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:24:21 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ed4eb0-aadd-4ddc-a83d-b89f767ce48f tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f42f82ce5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b15b8a52-21ea-41a6-a7fb-b3e6bf95b084'): ({'sdf'}, set())}) {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 18:24:21 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-65ed4eb0-aadd-4ddc-a83d-b89f767ce48f tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] Removing single pathed devices sdf {{(pid=72418) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 18:24:21 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-68062e4f-0264-42c1-a5f1-462620ec2054 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 18:24:21 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:24:21 user nova-compute[72418]:   <source dev="/dev/sdg"/>
Aug 09 18:24:21 user nova-compute[72418]:   <target dev="vdb" bus="virtio"/>
Aug 09 18:24:21 user nova-compute[72418]:   <serial>a5c27e91-240a-4425-8cc8-42ab8d92b2ca</serial>
Aug 09 18:24:21 user nova-compute[72418]: </disk>
Aug 09 18:24:21 user nova-compute[72418]:  {{(pid=72418) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 18:24:21 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:21 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:21 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a4aad9-8e97-444f-94e3-6ab2914ea03f]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:21 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:21 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:21 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba6e55e6-7a26-4e9a-901f-6416ab835fbb]: (4, ('ok\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:21 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-65ed4eb0-aadd-4ddc-a83d-b89f767ce48f tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] Flushing IO for device /dev/sdf {{(pid=72418) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 18:24:21 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:21 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:21 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[67bc7e99-3720-441d-8bf1-e89c693a36db]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:21 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-65ed4eb0-aadd-4ddc-a83d-b89f767ce48f tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72418) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 18:24:21 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:21 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:21 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c17c18b-460a-4888-a728-b48ed9832ff5]: (4, ('1', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:21 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-65ed4eb0-aadd-4ddc-a83d-b89f767ce48f tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 18:24:21 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-65ed4eb0-aadd-4ddc-a83d-b89f767ce48f tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] SCSI volumes sdf have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 18:24:21 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ed4eb0-aadd-4ddc-a83d-b89f767ce48f tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b15b8a52-21ea-41a6-a7fb-b3e6bf95b084')] {{(pid=72418) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 18:24:21 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b15b8a52-21ea-41a6-a7fb-b3e6bf95b084 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:21 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b15b8a52-21ea-41a6-a7fb-b3e6bf95b084 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:21 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f56bf35-6bdd-4e87-959a-183739d72ab7]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:21 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ed4eb0-aadd-4ddc-a83d-b89f767ce48f tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:24:21 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b15b8a52-21ea-41a6-a7fb-b3e6bf95b084 -p 172.16.0.220:3260 --logout {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:21 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b15b8a52-21ea-41a6-a7fb-b3e6bf95b084 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:21 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab5d70f-6ff3-4b96-bb55-ed4debbe5947]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:b15b8a52-21ea-41a6-a7fb-b3e6bf95b084, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:b15b8a52-21ea-41a6-a7fb-b3e6bf95b084, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:21 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ed4eb0-aadd-4ddc-a83d-b89f767ce48f tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:b15b8a52-21ea-41a6-a7fb-b3e6bf95b084, portal: 172.16.0.220,3260]
Aug 09 18:24:21 user nova-compute[72418]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:b15b8a52-21ea-41a6-a7fb-b3e6bf95b084, portal: 172.16.0.220,3260] successful.
Aug 09 18:24:21 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:24:21 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b15b8a52-21ea-41a6-a7fb-b3e6bf95b084 -p 172.16.0.220:3260 --op delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:21 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b15b8a52-21ea-41a6-a7fb-b3e6bf95b084 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:21 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[323193d2-820e-4411-bb90-597e11b854e2]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:21 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ed4eb0-aadd-4ddc-a83d-b89f767ce48f tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:24:21 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-65ed4eb0-aadd-4ddc-a83d-b89f767ce48f tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:24:21 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ed4eb0-aadd-4ddc-a83d-b89f767ce48f tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] <== disconnect_volume: return (1460ms) None {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:24:21 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65ed4eb0-aadd-4ddc-a83d-b89f767ce48f tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Disconnected iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 18:24:21 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-68062e4f-0264-42c1-a5f1-462620ec2054 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:24:21 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-68062e4f-0264-42c1-a5f1-462620ec2054 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:24:21 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-68062e4f-0264-42c1-a5f1-462620ec2054 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] No VIF found with MAC fa:16:3e:ca:f9:2b, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:24:21 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-68062e4f-0264-42c1-a5f1-462620ec2054 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Lock "4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.966s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:24:22 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Acquiring lock "b6927390-e0f7-43cf-8a83-d3c004865129" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:24:22 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Lock "b6927390-e0f7-43cf-8a83-d3c004865129" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:24:22 user nova-compute[72418]: DEBUG nova.compute.manager [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Starting instance... {{(pid=72418) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 18:24:22 user nova-compute[72418]: DEBUG nova.objects.instance [None req-65ed4eb0-aadd-4ddc-a83d-b89f767ce48f tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] Lazy-loading 'flavor' on Instance uuid 6084e681-01c4-4a6c-beb3-dcda4a990a51 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:24:22 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:24:22 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:24:22 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:24:22 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:24:22 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72418) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 18:24:22 user nova-compute[72418]: INFO nova.compute.claims [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Claim successful on node user
Aug 09 18:24:22 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-65ed4eb0-aadd-4ddc-a83d-b89f767ce48f tempest-VolumesAssistedSnapshotsTest-46170243 tempest-VolumesAssistedSnapshotsTest-46170243-project-admin] Lock "6084e681-01c4-4a6c-beb3-dcda4a990a51" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.003s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:24:22 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:24:22 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:24:22 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.672s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:24:22 user nova-compute[72418]: DEBUG nova.compute.manager [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Start building networks asynchronously for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 18:24:23 user nova-compute[72418]: DEBUG nova.compute.manager [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Allocating IP information in the background. {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 18:24:23 user nova-compute[72418]: DEBUG nova.network.neutron [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] allocate_for_instance() {{(pid=72418) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 18:24:23 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 18:24:23 user nova-compute[72418]: DEBUG nova.compute.manager [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Start building block device mappings for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 18:24:23 user nova-compute[72418]: DEBUG nova.policy [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cb031f5ca0bc4b7dbb600ee287a26e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7a7d69112347edb919fb26f98e55e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72418) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 18:24:23 user nova-compute[72418]: DEBUG nova.compute.manager [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Start spawning the instance on the hypervisor. {{(pid=72418) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 18:24:23 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Creating instance directory {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 18:24:23 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Creating image(s)
Aug 09 18:24:23 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Acquiring lock "/opt/stack/data/nova/instances/b6927390-e0f7-43cf-8a83-d3c004865129/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:24:23 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Lock "/opt/stack/data/nova/instances/b6927390-e0f7-43cf-8a83-d3c004865129/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:24:23 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Lock "/opt/stack/data/nova/instances/b6927390-e0f7-43cf-8a83-d3c004865129/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:24:23 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:23 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.140s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:23 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Acquiring lock "458773cfa7230b717e41c60277832e9f83806d71" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:24:23 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:24:23 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:23 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.163s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:23 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/b6927390-e0f7-43cf-8a83-d3c004865129/disk 1073741824 {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:23 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/b6927390-e0f7-43cf-8a83-d3c004865129/disk 1073741824" returned: 0 in 0.054s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:23 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:24:23 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:23 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.134s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:23 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b6927390-e0f7-43cf-8a83-d3c004865129/disk. size=1073741824 {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 18:24:23 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6927390-e0f7-43cf-8a83-d3c004865129/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:23 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-9a70f1fb-07c8-442f-8f1f-2d2a58ff4a78 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Acquiring lock "4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:24:23 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-9a70f1fb-07c8-442f-8f1f-2d2a58ff4a78 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Lock "4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:24:23 user nova-compute[72418]: INFO nova.compute.manager [None req-9a70f1fb-07c8-442f-8f1f-2d2a58ff4a78 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Detaching volume a5c27e91-240a-4425-8cc8-42ab8d92b2ca
Aug 09 18:24:23 user nova-compute[72418]: DEBUG nova.network.neutron [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Successfully created port: 50b32717-31fd-42cc-9a2c-34a0b08faff1 {{(pid=72418) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 18:24:23 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6927390-e0f7-43cf-8a83-d3c004865129/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:23 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Cannot resize image /opt/stack/data/nova/instances/b6927390-e0f7-43cf-8a83-d3c004865129/disk to a smaller size. {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 18:24:23 user nova-compute[72418]: DEBUG nova.objects.instance [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Lazy-loading 'migration_context' on Instance uuid b6927390-e0f7-43cf-8a83-d3c004865129 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:24:23 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Created local disks {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 18:24:23 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Ensure instance console log exists: /opt/stack/data/nova/instances/b6927390-e0f7-43cf-8a83-d3c004865129/console.log {{(pid=72418) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 18:24:23 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:24:23 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:24:23 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:24:23 user nova-compute[72418]: INFO nova.virt.block_device [None req-9a70f1fb-07c8-442f-8f1f-2d2a58ff4a78 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Attempting to driver detach volume a5c27e91-240a-4425-8cc8-42ab8d92b2ca from mountpoint /dev/vdb
Aug 09 18:24:23 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-9a70f1fb-07c8-442f-8f1f-2d2a58ff4a78 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Attempting to detach device vdb from instance 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf from the persistent domain config. {{(pid=72418) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 18:24:23 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-9a70f1fb-07c8-442f-8f1f-2d2a58ff4a78 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 18:24:23 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:24:23 user nova-compute[72418]:   <source dev="/dev/sdg"/>
Aug 09 18:24:23 user nova-compute[72418]:   <target dev="vdb" bus="virtio"/>
Aug 09 18:24:23 user nova-compute[72418]:   <serial>a5c27e91-240a-4425-8cc8-42ab8d92b2ca</serial>
Aug 09 18:24:23 user nova-compute[72418]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 18:24:23 user nova-compute[72418]: </disk>
Aug 09 18:24:23 user nova-compute[72418]:  {{(pid=72418) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 18:24:23 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-9a70f1fb-07c8-442f-8f1f-2d2a58ff4a78 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Successfully detached device vdb from instance 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf from the persistent domain config.
Aug 09 18:24:23 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-9a70f1fb-07c8-442f-8f1f-2d2a58ff4a78 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf from the live domain config. {{(pid=72418) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 18:24:23 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-9a70f1fb-07c8-442f-8f1f-2d2a58ff4a78 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 18:24:23 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:24:23 user nova-compute[72418]:   <source dev="/dev/sdg"/>
Aug 09 18:24:23 user nova-compute[72418]:   <target dev="vdb" bus="virtio"/>
Aug 09 18:24:23 user nova-compute[72418]:   <serial>a5c27e91-240a-4425-8cc8-42ab8d92b2ca</serial>
Aug 09 18:24:23 user nova-compute[72418]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 18:24:23 user nova-compute[72418]: </disk>
Aug 09 18:24:23 user nova-compute[72418]:  {{(pid=72418) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Received event <DeviceRemovedEvent: 1691605464.3799431, 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72418) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-9a70f1fb-07c8-442f-8f1f-2d2a58ff4a78 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf {{(pid=72418) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 18:24:24 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-9a70f1fb-07c8-442f-8f1f-2d2a58ff4a78 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Successfully detached device vdb from instance 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf from the live domain config.
Aug 09 18:24:24 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a70f1fb-07c8-442f-8f1f-2d2a58ff4a78 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] calling os-brick to detach iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a70f1fb-07c8-442f-8f1f-2d2a58ff4a78 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, {'target_iqns': ['iqn.2010-10.org.openstack:a5c27e91-240a-4425-8cc8-42ab8d92b2ca'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JrhBiTbe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:24:24 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-9a70f1fb-07c8-442f-8f1f-2d2a58ff4a78 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:24:24 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-9a70f1fb-07c8-442f-8f1f-2d2a58ff4a78 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-9a70f1fb-07c8-442f-8f1f-2d2a58ff4a78 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a70f1fb-07c8-442f-8f1f-2d2a58ff4a78 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5c27e91-240a-4425-8cc8-42ab8d92b2ca', 0)] {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[2764a864-52ff-474e-a8a9-a7c0b46ed1c0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5c27e91-240a-4425-8cc8-42ab8d92b2ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb26768-6a5f-46eb-84e9-0c71a97ba5a1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c27e91-240a-4425-8cc8-42ab8d92b2ca (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a70f1fb-07c8-442f-8f1f-2d2a58ff4a78 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:24:24 user nova-compute[72418]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)
Aug 09 18:24:24 user nova-compute[72418]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)
Aug 09 18:24:24 user nova-compute[72418]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)
Aug 09 18:24:24 user nova-compute[72418]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c27e91-240a-4425-8cc8-42ab8d92b2ca (non-flash)
Aug 09 18:24:24 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a70f1fb-07c8-442f-8f1f-2d2a58ff4a78 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:24:24 user nova-compute[72418]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)
Aug 09 18:24:24 user nova-compute[72418]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)
Aug 09 18:24:24 user nova-compute[72418]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)
Aug 09 18:24:24 user nova-compute[72418]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c27e91-240a-4425-8cc8-42ab8d92b2ca (non-flash)
Aug 09 18:24:24 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a70f1fb-07c8-442f-8f1f-2d2a58ff4a78 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f430029f640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5c27e91-240a-4425-8cc8-42ab8d92b2ca'): ({'sdg'}, set())}) {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-9a70f1fb-07c8-442f-8f1f-2d2a58ff4a78 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Removing single pathed devices sdg {{(pid=72418) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c71377f-fbff-40b0-b87e-c34455c7f639]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.024s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8dcde5d-0a12-42d5-b86c-7efd4b707dc4]: (4, ('ok\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-9a70f1fb-07c8-442f-8f1f-2d2a58ff4a78 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Flushing IO for device /dev/sdg {{(pid=72418) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[b513407e-655a-4131-8660-79c1eaf95528]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-9a70f1fb-07c8-442f-8f1f-2d2a58ff4a78 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72418) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG nova.network.neutron [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Successfully updated port: 50b32717-31fd-42cc-9a2c-34a0b08faff1 {{(pid=72418) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.041s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[4937d569-c0a4-4c33-9c41-3f6fb53acf04]: (4, ('1', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-9a70f1fb-07c8-442f-8f1f-2d2a58ff4a78 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-9a70f1fb-07c8-442f-8f1f-2d2a58ff4a78 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] SCSI volumes sdg have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a70f1fb-07c8-442f-8f1f-2d2a58ff4a78 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5c27e91-240a-4425-8cc8-42ab8d92b2ca')] {{(pid=72418) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5c27e91-240a-4425-8cc8-42ab8d92b2ca -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Acquiring lock "refresh_cache-b6927390-e0f7-43cf-8a83-d3c004865129" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Acquired lock "refresh_cache-b6927390-e0f7-43cf-8a83-d3c004865129" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG nova.network.neutron [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5c27e91-240a-4425-8cc8-42ab8d92b2ca -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c3e374-3760-4e40-913e-d909275cadd2]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a70f1fb-07c8-442f-8f1f-2d2a58ff4a78 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5c27e91-240a-4425-8cc8-42ab8d92b2ca -p 172.16.0.220:3260 --logout {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG nova.compute.manager [req-4fd17e7e-2987-4314-94b1-6ece081e9f01 req-2d1c82bb-c04e-4c6f-b9fd-89d5957cf368 service nova] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Received event network-changed-50b32717-31fd-42cc-9a2c-34a0b08faff1 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG nova.compute.manager [req-4fd17e7e-2987-4314-94b1-6ece081e9f01 req-2d1c82bb-c04e-4c6f-b9fd-89d5957cf368 service nova] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Refreshing instance network info cache due to event network-changed-50b32717-31fd-42cc-9a2c-34a0b08faff1. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-4fd17e7e-2987-4314-94b1-6ece081e9f01 req-2d1c82bb-c04e-4c6f-b9fd-89d5957cf368 service nova] Acquiring lock "refresh_cache-b6927390-e0f7-43cf-8a83-d3c004865129" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG nova.network.neutron [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Instance cache missing network info. {{(pid=72418) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5c27e91-240a-4425-8cc8-42ab8d92b2ca -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[39437e62-343f-4f6d-926a-21ad0a15d4d2]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:a5c27e91-240a-4425-8cc8-42ab8d92b2ca, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:a5c27e91-240a-4425-8cc8-42ab8d92b2ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a70f1fb-07c8-442f-8f1f-2d2a58ff4a78 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:a5c27e91-240a-4425-8cc8-42ab8d92b2ca, portal: 172.16.0.220,3260]
Aug 09 18:24:24 user nova-compute[72418]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:a5c27e91-240a-4425-8cc8-42ab8d92b2ca, portal: 172.16.0.220,3260] successful.
Aug 09 18:24:24 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5c27e91-240a-4425-8cc8-42ab8d92b2ca -p 172.16.0.220:3260 --op delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5c27e91-240a-4425-8cc8-42ab8d92b2ca -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1cf2929-2083-4fc7-b43a-7bf75dcfaa9b]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a70f1fb-07c8-442f-8f1f-2d2a58ff4a78 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-9a70f1fb-07c8-442f-8f1f-2d2a58ff4a78 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a70f1fb-07c8-442f-8f1f-2d2a58ff4a78 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] <== disconnect_volume: return (317ms) None {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a70f1fb-07c8-442f-8f1f-2d2a58ff4a78 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Disconnected iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG nova.network.neutron [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Updating instance_info_cache with network_info: [{"id": "50b32717-31fd-42cc-9a2c-34a0b08faff1", "address": "fa:16:3e:81:2b:fc", "network": {"id": "c14fe632-b9ef-4551-8767-8bd9520ab900", "bridge": "br-int", "label": "tempest-VolumesActionsTest-889666224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7a7d69112347edb919fb26f98e55e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50b32717-31", "ovs_interfaceid": "50b32717-31fd-42cc-9a2c-34a0b08faff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Releasing lock "refresh_cache-b6927390-e0f7-43cf-8a83-d3c004865129" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG nova.compute.manager [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Instance network_info: |[{"id": "50b32717-31fd-42cc-9a2c-34a0b08faff1", "address": "fa:16:3e:81:2b:fc", "network": {"id": "c14fe632-b9ef-4551-8767-8bd9520ab900", "bridge": "br-int", "label": "tempest-VolumesActionsTest-889666224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7a7d69112347edb919fb26f98e55e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50b32717-31", "ovs_interfaceid": "50b32717-31fd-42cc-9a2c-34a0b08faff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-4fd17e7e-2987-4314-94b1-6ece081e9f01 req-2d1c82bb-c04e-4c6f-b9fd-89d5957cf368 service nova] Acquired lock "refresh_cache-b6927390-e0f7-43cf-8a83-d3c004865129" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG nova.network.neutron [req-4fd17e7e-2987-4314-94b1-6ece081e9f01 req-2d1c82bb-c04e-4c6f-b9fd-89d5957cf368 service nova] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Refreshing network info cache for port 50b32717-31fd-42cc-9a2c-34a0b08faff1 {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Start _get_guest_xml network_info=[{"id": "50b32717-31fd-42cc-9a2c-34a0b08faff1", "address": "fa:16:3e:81:2b:fc", "network": {"id": "c14fe632-b9ef-4551-8767-8bd9520ab900", "bridge": "br-int", "label": "tempest-VolumesActionsTest-889666224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7a7d69112347edb919fb26f98e55e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50b32717-31", "ovs_interfaceid": "50b32717-31fd-42cc-9a2c-34a0b08faff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 18:24:24 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:24:24 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:24:24 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 18:24:24 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] CPU controller missing on host. {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 18:24:25 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 18:24:25 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] CPU controller found on host. {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 18:24:25 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72418) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 18:24:25 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T18:17:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 18:24:25 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Flavor limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 18:24:25 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Image limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 18:24:25 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Flavor pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 18:24:25 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Image pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 18:24:25 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 18:24:25 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 18:24:25 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 18:24:25 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Got 1 possible topologies {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 18:24:25 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 18:24:25 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 18:24:25 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:24:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-330004694',display_name='tempest-VolumesActionsTest-instance-330004694',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-330004694',id=13,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af7a7d69112347edb919fb26f98e55e3',ramdisk_id='',reservation_id='r-o27rlw1t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1905077092',owner_user_name='tempest-VolumesActionsTest-1905077092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:24:23Z,user_data=None,user_id='cb031f5ca0bc4b7dbb600ee287a26e6f',uuid=b6927390-e0f7-43cf-8a83-d3c004865129,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50b32717-31fd-42cc-9a2c-34a0b08faff1", "address": "fa:16:3e:81:2b:fc", "network": {"id": "c14fe632-b9ef-4551-8767-8bd9520ab900", "bridge": "br-int", "label": "tempest-VolumesActionsTest-889666224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7a7d69112347edb919fb26f98e55e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50b32717-31", "ovs_interfaceid": "50b32717-31fd-42cc-9a2c-34a0b08faff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:24:25 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Converting VIF {"id": "50b32717-31fd-42cc-9a2c-34a0b08faff1", "address": "fa:16:3e:81:2b:fc", "network": {"id": "c14fe632-b9ef-4551-8767-8bd9520ab900", "bridge": "br-int", "label": "tempest-VolumesActionsTest-889666224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7a7d69112347edb919fb26f98e55e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50b32717-31", "ovs_interfaceid": "50b32717-31fd-42cc-9a2c-34a0b08faff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:24:25 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:2b:fc,bridge_name='br-int',has_traffic_filtering=True,id=50b32717-31fd-42cc-9a2c-34a0b08faff1,network=Network(c14fe632-b9ef-4551-8767-8bd9520ab900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50b32717-31') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:24:25 user nova-compute[72418]: DEBUG nova.objects.instance [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Lazy-loading 'pci_devices' on Instance uuid b6927390-e0f7-43cf-8a83-d3c004865129 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:24:25 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] End _get_guest_xml xml=<domain type="kvm">
Aug 09 18:24:25 user nova-compute[72418]:   <uuid>b6927390-e0f7-43cf-8a83-d3c004865129</uuid>
Aug 09 18:24:25 user nova-compute[72418]:   <name>instance-0000000d</name>
Aug 09 18:24:25 user nova-compute[72418]:   <memory>524288</memory>
Aug 09 18:24:25 user nova-compute[72418]:   <vcpu>1</vcpu>
Aug 09 18:24:25 user nova-compute[72418]:   <metadata>
Aug 09 18:24:25 user nova-compute[72418]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:24:25 user nova-compute[72418]:       <nova:package version="0.0.0"/>
Aug 09 18:24:25 user nova-compute[72418]:       <nova:name>tempest-VolumesActionsTest-instance-330004694</nova:name>
Aug 09 18:24:25 user nova-compute[72418]:       <nova:creationTime>2023-08-09 18:24:24</nova:creationTime>
Aug 09 18:24:25 user nova-compute[72418]:       <nova:flavor name="m1.tiny">
Aug 09 18:24:25 user nova-compute[72418]:         <nova:memory>512</nova:memory>
Aug 09 18:24:25 user nova-compute[72418]:         <nova:disk>1</nova:disk>
Aug 09 18:24:25 user nova-compute[72418]:         <nova:swap>0</nova:swap>
Aug 09 18:24:25 user nova-compute[72418]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:24:25 user nova-compute[72418]:         <nova:vcpus>1</nova:vcpus>
Aug 09 18:24:25 user nova-compute[72418]:       </nova:flavor>
Aug 09 18:24:25 user nova-compute[72418]:       <nova:owner>
Aug 09 18:24:25 user nova-compute[72418]:         <nova:user uuid="cb031f5ca0bc4b7dbb600ee287a26e6f">tempest-VolumesActionsTest-1905077092-project-member</nova:user>
Aug 09 18:24:25 user nova-compute[72418]:         <nova:project uuid="af7a7d69112347edb919fb26f98e55e3">tempest-VolumesActionsTest-1905077092</nova:project>
Aug 09 18:24:25 user nova-compute[72418]:       </nova:owner>
Aug 09 18:24:25 user nova-compute[72418]:       <nova:root type="image" uuid="8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e"/>
Aug 09 18:24:25 user nova-compute[72418]:       <nova:ports>
Aug 09 18:24:25 user nova-compute[72418]:         <nova:port uuid="50b32717-31fd-42cc-9a2c-34a0b08faff1">
Aug 09 18:24:25 user nova-compute[72418]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 09 18:24:25 user nova-compute[72418]:         </nova:port>
Aug 09 18:24:25 user nova-compute[72418]:       </nova:ports>
Aug 09 18:24:25 user nova-compute[72418]:     </nova:instance>
Aug 09 18:24:25 user nova-compute[72418]:   </metadata>
Aug 09 18:24:25 user nova-compute[72418]:   <sysinfo type="smbios">
Aug 09 18:24:25 user nova-compute[72418]:     <system>
Aug 09 18:24:25 user nova-compute[72418]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 18:24:25 user nova-compute[72418]:       <entry name="product">OpenStack Nova</entry>
Aug 09 18:24:25 user nova-compute[72418]:       <entry name="version">0.0.0</entry>
Aug 09 18:24:25 user nova-compute[72418]:       <entry name="serial">b6927390-e0f7-43cf-8a83-d3c004865129</entry>
Aug 09 18:24:25 user nova-compute[72418]:       <entry name="uuid">b6927390-e0f7-43cf-8a83-d3c004865129</entry>
Aug 09 18:24:25 user nova-compute[72418]:       <entry name="family">Virtual Machine</entry>
Aug 09 18:24:25 user nova-compute[72418]:     </system>
Aug 09 18:24:25 user nova-compute[72418]:   </sysinfo>
Aug 09 18:24:25 user nova-compute[72418]:   <os>
Aug 09 18:24:25 user nova-compute[72418]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 18:24:25 user nova-compute[72418]:     <boot dev="hd"/>
Aug 09 18:24:25 user nova-compute[72418]:     <smbios mode="sysinfo"/>
Aug 09 18:24:25 user nova-compute[72418]:   </os>
Aug 09 18:24:25 user nova-compute[72418]:   <features>
Aug 09 18:24:25 user nova-compute[72418]:     <acpi/>
Aug 09 18:24:25 user nova-compute[72418]:     <apic/>
Aug 09 18:24:25 user nova-compute[72418]:     <vmcoreinfo/>
Aug 09 18:24:25 user nova-compute[72418]:   </features>
Aug 09 18:24:25 user nova-compute[72418]:   <clock offset="utc">
Aug 09 18:24:25 user nova-compute[72418]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 18:24:25 user nova-compute[72418]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 18:24:25 user nova-compute[72418]:     <timer name="hpet" present="no"/>
Aug 09 18:24:25 user nova-compute[72418]:   </clock>
Aug 09 18:24:25 user nova-compute[72418]:   <cpu mode="custom" match="exact">
Aug 09 18:24:25 user nova-compute[72418]:     <model>Nehalem</model>
Aug 09 18:24:25 user nova-compute[72418]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 18:24:25 user nova-compute[72418]:   </cpu>
Aug 09 18:24:25 user nova-compute[72418]:   <devices>
Aug 09 18:24:25 user nova-compute[72418]:     <disk type="file" device="disk">
Aug 09 18:24:25 user nova-compute[72418]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 18:24:25 user nova-compute[72418]:       <source file="/opt/stack/data/nova/instances/b6927390-e0f7-43cf-8a83-d3c004865129/disk"/>
Aug 09 18:24:25 user nova-compute[72418]:       <target dev="vda" bus="virtio"/>
Aug 09 18:24:25 user nova-compute[72418]:     </disk>
Aug 09 18:24:25 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:24:25 user nova-compute[72418]:       <mac address="fa:16:3e:81:2b:fc"/>
Aug 09 18:24:25 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:24:25 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:24:25 user nova-compute[72418]:       <target dev="tap50b32717-31"/>
Aug 09 18:24:25 user nova-compute[72418]:     </interface>
Aug 09 18:24:25 user nova-compute[72418]:     <serial type="pty">
Aug 09 18:24:25 user nova-compute[72418]:       <log file="/opt/stack/data/nova/instances/b6927390-e0f7-43cf-8a83-d3c004865129/console.log" append="off"/>
Aug 09 18:24:25 user nova-compute[72418]:     </serial>
Aug 09 18:24:25 user nova-compute[72418]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 18:24:25 user nova-compute[72418]:     <video>
Aug 09 18:24:25 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:24:25 user nova-compute[72418]:     </video>
Aug 09 18:24:25 user nova-compute[72418]:     <rng model="virtio">
Aug 09 18:24:25 user nova-compute[72418]:       <backend model="random">/dev/urandom</backend>
Aug 09 18:24:25 user nova-compute[72418]:     </rng>
Aug 09 18:24:25 user nova-compute[72418]:     <controller type="usb" index="0" model="none"/>
Aug 09 18:24:25 user nova-compute[72418]:     <memballoon model="virtio">
Aug 09 18:24:25 user nova-compute[72418]:       <stats period="10"/>
Aug 09 18:24:25 user nova-compute[72418]:     </memballoon>
Aug 09 18:24:25 user nova-compute[72418]:   </devices>
Aug 09 18:24:25 user nova-compute[72418]: </domain>
Aug 09 18:24:25 user nova-compute[72418]:  {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 18:24:25 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:24:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-330004694',display_name='tempest-VolumesActionsTest-instance-330004694',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-330004694',id=13,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af7a7d69112347edb919fb26f98e55e3',ramdisk_id='',reservation_id='r-o27rlw1t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1905077092',owner_user_name='tempest-VolumesActionsTest-1905077092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:24:23Z,user_data=None,user_id='cb031f5ca0bc4b7dbb600ee287a26e6f',uuid=b6927390-e0f7-43cf-8a83-d3c004865129,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50b32717-31fd-42cc-9a2c-34a0b08faff1", "address": "fa:16:3e:81:2b:fc", "network": {"id": "c14fe632-b9ef-4551-8767-8bd9520ab900", "bridge": "br-int", "label": "tempest-VolumesActionsTest-889666224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7a7d69112347edb919fb26f98e55e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50b32717-31", "ovs_interfaceid": "50b32717-31fd-42cc-9a2c-34a0b08faff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:24:25 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Converting VIF {"id": "50b32717-31fd-42cc-9a2c-34a0b08faff1", "address": "fa:16:3e:81:2b:fc", "network": {"id": "c14fe632-b9ef-4551-8767-8bd9520ab900", "bridge": "br-int", "label": "tempest-VolumesActionsTest-889666224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7a7d69112347edb919fb26f98e55e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50b32717-31", "ovs_interfaceid": "50b32717-31fd-42cc-9a2c-34a0b08faff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:24:25 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:2b:fc,bridge_name='br-int',has_traffic_filtering=True,id=50b32717-31fd-42cc-9a2c-34a0b08faff1,network=Network(c14fe632-b9ef-4551-8767-8bd9520ab900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50b32717-31') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:24:25 user nova-compute[72418]: DEBUG os_vif [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:2b:fc,bridge_name='br-int',has_traffic_filtering=True,id=50b32717-31fd-42cc-9a2c-34a0b08faff1,network=Network(c14fe632-b9ef-4551-8767-8bd9520ab900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50b32717-31') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:24:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:24:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:24:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:24:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:24:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap50b32717-31, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:24:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap50b32717-31, col_values=(('external_ids', {'iface-id': '50b32717-31fd-42cc-9a2c-34a0b08faff1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:2b:fc', 'vm-uuid': 'b6927390-e0f7-43cf-8a83-d3c004865129'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:24:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:24:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:24:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:24:25 user nova-compute[72418]: INFO os_vif [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:2b:fc,bridge_name='br-int',has_traffic_filtering=True,id=50b32717-31fd-42cc-9a2c-34a0b08faff1,network=Network(c14fe632-b9ef-4551-8767-8bd9520ab900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50b32717-31')
Aug 09 18:24:25 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:24:25 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] No VIF found with MAC fa:16:3e:81:2b:fc, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:24:25 user nova-compute[72418]: DEBUG nova.objects.instance [None req-9a70f1fb-07c8-442f-8f1f-2d2a58ff4a78 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Lazy-loading 'flavor' on Instance uuid 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:24:25 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-9a70f1fb-07c8-442f-8f1f-2d2a58ff4a78 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Lock "4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.745s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:24:25 user nova-compute[72418]: DEBUG nova.network.neutron [req-4fd17e7e-2987-4314-94b1-6ece081e9f01 req-2d1c82bb-c04e-4c6f-b9fd-89d5957cf368 service nova] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Updated VIF entry in instance network info cache for port 50b32717-31fd-42cc-9a2c-34a0b08faff1. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:24:25 user nova-compute[72418]: DEBUG nova.network.neutron [req-4fd17e7e-2987-4314-94b1-6ece081e9f01 req-2d1c82bb-c04e-4c6f-b9fd-89d5957cf368 service nova] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Updating instance_info_cache with network_info: [{"id": "50b32717-31fd-42cc-9a2c-34a0b08faff1", "address": "fa:16:3e:81:2b:fc", "network": {"id": "c14fe632-b9ef-4551-8767-8bd9520ab900", "bridge": "br-int", "label": "tempest-VolumesActionsTest-889666224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7a7d69112347edb919fb26f98e55e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50b32717-31", "ovs_interfaceid": "50b32717-31fd-42cc-9a2c-34a0b08faff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:24:25 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-4fd17e7e-2987-4314-94b1-6ece081e9f01 req-2d1c82bb-c04e-4c6f-b9fd-89d5957cf368 service nova] Releasing lock "refresh_cache-b6927390-e0f7-43cf-8a83-d3c004865129" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:24:26 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:24:26 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:24:26 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:24:26 user nova-compute[72418]: DEBUG nova.compute.manager [req-eb01b9aa-396e-4ea0-ade3-1dbb65c907a8 req-1c87a76f-6eca-4d37-b363-51d8307c4b36 service nova] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Received event network-vif-plugged-50b32717-31fd-42cc-9a2c-34a0b08faff1 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:24:26 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-eb01b9aa-396e-4ea0-ade3-1dbb65c907a8 req-1c87a76f-6eca-4d37-b363-51d8307c4b36 service nova] Acquiring lock "b6927390-e0f7-43cf-8a83-d3c004865129-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:24:26 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-eb01b9aa-396e-4ea0-ade3-1dbb65c907a8 req-1c87a76f-6eca-4d37-b363-51d8307c4b36 service nova] Lock "b6927390-e0f7-43cf-8a83-d3c004865129-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:24:26 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-eb01b9aa-396e-4ea0-ade3-1dbb65c907a8 req-1c87a76f-6eca-4d37-b363-51d8307c4b36 service nova] Lock "b6927390-e0f7-43cf-8a83-d3c004865129-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:24:26 user nova-compute[72418]: DEBUG nova.compute.manager [req-eb01b9aa-396e-4ea0-ade3-1dbb65c907a8 req-1c87a76f-6eca-4d37-b363-51d8307c4b36 service nova] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] No waiting events found dispatching network-vif-plugged-50b32717-31fd-42cc-9a2c-34a0b08faff1 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:24:26 user nova-compute[72418]: WARNING nova.compute.manager [req-eb01b9aa-396e-4ea0-ade3-1dbb65c907a8 req-1c87a76f-6eca-4d37-b363-51d8307c4b36 service nova] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Received unexpected event network-vif-plugged-50b32717-31fd-42cc-9a2c-34a0b08faff1 for instance with vm_state building and task_state spawning.
Aug 09 18:24:27 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:24:27 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:24:27 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:24:27 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:24:27 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:24:27 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b523aa9-27da-4d1b-98a2-1b6031cf48d4 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Calling os-brick to attach iSCSI Volume {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b523aa9-27da-4d1b-98a2-1b6031cf48d4 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXyMalNF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:24:28 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-8b523aa9-27da-4d1b-98a2-1b6031cf48d4 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:24:28 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-8b523aa9-27da-4d1b-98a2-1b6031cf48d4 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-8b523aa9-27da-4d1b-98a2-1b6031cf48d4 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:24:28 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-8b523aa9-27da-4d1b-98a2-1b6031cf48d4 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:24:28 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-8b523aa9-27da-4d1b-98a2-1b6031cf48d4 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-8b523aa9-27da-4d1b-98a2-1b6031cf48d4 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:24:28 user nova-compute[72418]: INFO os_brick.initiator.connectors.iscsi [None req-8b523aa9-27da-4d1b-98a2-1b6031cf48d4 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 18:24:28 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 -p 172.16.0.220:3260 {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[639f3aab-11fb-47ce-980b-161e842b3b76]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b523aa9-27da-4d1b-98a2-1b6031cf48d4 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 18:24:28 user nova-compute[72418]:  {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[56fafb49-c3ff-4887-8701-c5b99888fec0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3] added\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b523aa9-27da-4d1b-98a2-1b6031cf48d4 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3] added
Aug 09 18:24:28 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[028a9082-6a0c-48f6-822c-7399b31f7f24]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b523aa9-27da-4d1b-98a2-1b6031cf48d4 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f165b00-b5c5-4473-b1cd-d71ad9f82da7]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b523aa9-27da-4d1b-98a2-1b6031cf48d4 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EXyMalNF {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EXyMalNF" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc788682-1a67-4021-84e0-95b6c9aabb64]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b523aa9-27da-4d1b-98a2-1b6031cf48d4 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EXyMalNF'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e09cc0-a0a3-4b94-95d5-8cce1d7b2961]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b523aa9-27da-4d1b-98a2-1b6031cf48d4 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad3d782-b575-4782-8572-48743b34577f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b523aa9-27da-4d1b-98a2-1b6031cf48d4 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:24:28 user nova-compute[72418]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)
Aug 09 18:24:28 user nova-compute[72418]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)
Aug 09 18:24:28 user nova-compute[72418]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)
Aug 09 18:24:28 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b523aa9-27da-4d1b-98a2-1b6031cf48d4 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:24:28 user nova-compute[72418]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)
Aug 09 18:24:28 user nova-compute[72418]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)
Aug 09 18:24:28 user nova-compute[72418]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)
Aug 09 18:24:28 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 -p 172.16.0.220:3260 --login {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[0912fed4-e0ad-4dae-8ff0-a46222511b9e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b523aa9-27da-4d1b-98a2-1b6031cf48d4 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3, portal: 172.16.0.220,3260]
Aug 09 18:24:28 user nova-compute[72418]: Login to [iface: default, target: iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3, portal: 172.16.0.220,3260] successful.
Aug 09 18:24:28 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06409ba-d066-4add-ae78-ce5f2111143c]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b523aa9-27da-4d1b-98a2-1b6031cf48d4 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[b293e784-d122-4f06-ad3c-491e116d60cf]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b523aa9-27da-4d1b-98a2-1b6031cf48d4 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:24:28 user nova-compute[72418]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)
Aug 09 18:24:28 user nova-compute[72418]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)
Aug 09 18:24:28 user nova-compute[72418]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)
Aug 09 18:24:28 user nova-compute[72418]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 (non-flash)
Aug 09 18:24:28 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b523aa9-27da-4d1b-98a2-1b6031cf48d4 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:24:28 user nova-compute[72418]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)
Aug 09 18:24:28 user nova-compute[72418]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)
Aug 09 18:24:28 user nova-compute[72418]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)
Aug 09 18:24:28 user nova-compute[72418]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 (non-flash)
Aug 09 18:24:28 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-8b523aa9-27da-4d1b-98a2-1b6031cf48d4 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b523aa9-27da-4d1b-98a2-1b6031cf48d4 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Connected to 172.16.0.220:3260 {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-8b523aa9-27da-4d1b-98a2-1b6031cf48d4 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] HCTL ('37', '-', '-', 0) found on session 9 with lun 0 {{(pid=72418) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-8b523aa9-27da-4d1b-98a2-1b6031cf48d4 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72418) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[327611b9-5d50-4ba7-ba0f-674307dbe572]: (4, ('- - 0', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-8b523aa9-27da-4d1b-98a2-1b6031cf48d4 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Searching for a device in session 9 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72418) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b523aa9-27da-4d1b-98a2-1b6031cf48d4 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXyMalNF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG nova.compute.manager [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Instance event wait completed in 0 seconds for  {{(pid=72418) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Guest created on hypervisor {{(pid=72418) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605468.6543055, b6927390-e0f7-43cf-8a83-d3c004865129 => Resumed> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:24:28 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] VM Resumed (Lifecycle Event)
Aug 09 18:24:28 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Instance spawned successfully.
Aug 09 18:24:28 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Found default for hw_cdrom_bus of ide {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Found default for hw_disk_bus of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Found default for hw_input_bus of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Found default for hw_pointer_model of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Found default for hw_video_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Found default for hw_vif_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:24:28 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:24:28 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605468.6544642, b6927390-e0f7-43cf-8a83-d3c004865129 => Started> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:24:28 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] VM Started (Lifecycle Event)
Aug 09 18:24:28 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:24:28 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:24:28 user nova-compute[72418]: INFO nova.compute.manager [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Took 5.58 seconds to spawn the instance on the hypervisor.
Aug 09 18:24:28 user nova-compute[72418]: DEBUG nova.compute.manager [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG nova.compute.manager [req-090ef8e7-4a12-4b87-b138-c65d0c978f03 req-35d66827-b898-48e8-9515-7fce9bcbc5b3 service nova] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Received event network-vif-plugged-50b32717-31fd-42cc-9a2c-34a0b08faff1 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-090ef8e7-4a12-4b87-b138-c65d0c978f03 req-35d66827-b898-48e8-9515-7fce9bcbc5b3 service nova] Acquiring lock "b6927390-e0f7-43cf-8a83-d3c004865129-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-090ef8e7-4a12-4b87-b138-c65d0c978f03 req-35d66827-b898-48e8-9515-7fce9bcbc5b3 service nova] Lock "b6927390-e0f7-43cf-8a83-d3c004865129-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-090ef8e7-4a12-4b87-b138-c65d0c978f03 req-35d66827-b898-48e8-9515-7fce9bcbc5b3 service nova] Lock "b6927390-e0f7-43cf-8a83-d3c004865129-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:24:28 user nova-compute[72418]: DEBUG nova.compute.manager [req-090ef8e7-4a12-4b87-b138-c65d0c978f03 req-35d66827-b898-48e8-9515-7fce9bcbc5b3 service nova] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] No waiting events found dispatching network-vif-plugged-50b32717-31fd-42cc-9a2c-34a0b08faff1 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:24:28 user nova-compute[72418]: WARNING nova.compute.manager [req-090ef8e7-4a12-4b87-b138-c65d0c978f03 req-35d66827-b898-48e8-9515-7fce9bcbc5b3 service nova] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Received unexpected event network-vif-plugged-50b32717-31fd-42cc-9a2c-34a0b08faff1 for instance with vm_state building and task_state spawning.
Aug 09 18:24:28 user nova-compute[72418]: INFO nova.compute.manager [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Took 6.57 seconds to build instance.
Aug 09 18:24:28 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-51fb2d2c-3b5b-42d6-9e4b-1d6cec6a707a tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Lock "b6927390-e0f7-43cf-8a83-d3c004865129" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.688s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:24:29 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-8b523aa9-27da-4d1b-98a2-1b6031cf48d4 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:24:29 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b523aa9-27da-4d1b-98a2-1b6031cf48d4 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23265303064323639', 'path': '/dev/sdf'} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:24:29 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b523aa9-27da-4d1b-98a2-1b6031cf48d4 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265303064323639', 'path': '/dev/sdf'} {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 18:24:29 user nova-compute[72418]: DEBUG nova.objects.instance [None req-8b523aa9-27da-4d1b-98a2-1b6031cf48d4 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Lazy-loading 'flavor' on Instance uuid dabfdb24-fc0b-4a00-a229-1ece48e27d18 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:24:29 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-8b523aa9-27da-4d1b-98a2-1b6031cf48d4 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 18:24:29 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:24:29 user nova-compute[72418]:   <source dev="/dev/sdf"/>
Aug 09 18:24:29 user nova-compute[72418]:   <target dev="vdb" bus="virtio"/>
Aug 09 18:24:29 user nova-compute[72418]:   <serial>1d982f88-39fb-45e9-a6c9-4a4379a52ea3</serial>
Aug 09 18:24:29 user nova-compute[72418]: </disk>
Aug 09 18:24:29 user nova-compute[72418]:  {{(pid=72418) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 18:24:29 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-8b523aa9-27da-4d1b-98a2-1b6031cf48d4 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:24:29 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-8b523aa9-27da-4d1b-98a2-1b6031cf48d4 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:24:29 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-8b523aa9-27da-4d1b-98a2-1b6031cf48d4 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] No VIF found with MAC fa:16:3e:9a:12:a5, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:24:30 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-8b523aa9-27da-4d1b-98a2-1b6031cf48d4 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Lock "dabfdb24-fc0b-4a00-a229-1ece48e27d18" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.041s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:24:30 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:24:30 user nova-compute[72418]: DEBUG nova.compute.manager [req-417f23cb-e2d4-4cac-99fc-a6bc14406861 req-4f7aa71d-1939-4f6e-8144-d7ec543ba62d service nova] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Received event network-changed-2472f1be-ea8f-46b6-a4f3-481f517c7edd {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:24:30 user nova-compute[72418]: DEBUG nova.compute.manager [req-417f23cb-e2d4-4cac-99fc-a6bc14406861 req-4f7aa71d-1939-4f6e-8144-d7ec543ba62d service nova] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Refreshing instance network info cache due to event network-changed-2472f1be-ea8f-46b6-a4f3-481f517c7edd. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:24:30 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-417f23cb-e2d4-4cac-99fc-a6bc14406861 req-4f7aa71d-1939-4f6e-8144-d7ec543ba62d service nova] Acquiring lock "refresh_cache-d9d5d476-484e-49a3-a665-5a2069ea606e" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:24:30 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-417f23cb-e2d4-4cac-99fc-a6bc14406861 req-4f7aa71d-1939-4f6e-8144-d7ec543ba62d service nova] Acquired lock "refresh_cache-d9d5d476-484e-49a3-a665-5a2069ea606e" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:24:30 user nova-compute[72418]: DEBUG nova.network.neutron [req-417f23cb-e2d4-4cac-99fc-a6bc14406861 req-4f7aa71d-1939-4f6e-8144-d7ec543ba62d service nova] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Refreshing network info cache for port 2472f1be-ea8f-46b6-a4f3-481f517c7edd {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:24:31 user nova-compute[72418]: DEBUG nova.network.neutron [req-417f23cb-e2d4-4cac-99fc-a6bc14406861 req-4f7aa71d-1939-4f6e-8144-d7ec543ba62d service nova] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Updated VIF entry in instance network info cache for port 2472f1be-ea8f-46b6-a4f3-481f517c7edd. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:24:31 user nova-compute[72418]: DEBUG nova.network.neutron [req-417f23cb-e2d4-4cac-99fc-a6bc14406861 req-4f7aa71d-1939-4f6e-8144-d7ec543ba62d service nova] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Updating instance_info_cache with network_info: [{"id": "2472f1be-ea8f-46b6-a4f3-481f517c7edd", "address": "fa:16:3e:86:93:dc", "network": {"id": "eddf3956-c192-42b3-b928-5e9cf4f07f5f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1344000484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64ada6c609434916beb7b6a1d117a993", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2472f1be-ea", "ovs_interfaceid": "2472f1be-ea8f-46b6-a4f3-481f517c7edd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:24:31 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-417f23cb-e2d4-4cac-99fc-a6bc14406861 req-4f7aa71d-1939-4f6e-8144-d7ec543ba62d service nova] Releasing lock "refresh_cache-d9d5d476-484e-49a3-a665-5a2069ea606e" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:24:31 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Acquiring lock "dabfdb24-fc0b-4a00-a229-1ece48e27d18" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:24:31 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Lock "dabfdb24-fc0b-4a00-a229-1ece48e27d18" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:24:31 user nova-compute[72418]: DEBUG os_brick.utils [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:24:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:31 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8aff4d-347d-4c86-8a46-37f53a68bb9c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ad56b243ad71\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:31 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad923c4c-dcce-45d2-bc6e-ac706b323c18]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:31 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5bf77e0-d885-4508-a6b5-4096d5e49ca4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:31 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c66b94c-7a49-4117-a508-7c311deb8257]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Running cmd (subprocess): nvme version {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:24:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] nvme not present on system {{(pid=72418) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 18:24:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:24:31 user nova-compute[72418]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 18:24:31 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2ecadf-67e5-4db5-a7da-4aef61c261da]: (4, '') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72418) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 18:24:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 18:24:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] LIGHTOS: no hostnqn found. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 18:24:31 user nova-compute[72418]: DEBUG os_brick.utils [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ad56b243ad71', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:24:31 user nova-compute[72418]: INFO nova.compute.manager [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Swapping volume 1d982f88-39fb-45e9-a6c9-4a4379a52ea3 for 1de0aad7-83ac-4b9b-ba88-3418baa6a1aa
Aug 09 18:24:31 user nova-compute[72418]: INFO nova.compute.manager [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Rebuilding instance
Aug 09 18:24:31 user nova-compute[72418]: DEBUG nova.objects.instance [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Lazy-loading 'trusted_certs' on Instance uuid d9d5d476-484e-49a3-a665-5a2069ea606e {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:24:31 user nova-compute[72418]: DEBUG nova.compute.manager [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:24:31 user nova-compute[72418]: DEBUG nova.objects.instance [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Lazy-loading 'pci_requests' on Instance uuid d9d5d476-484e-49a3-a665-5a2069ea606e {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:24:31 user nova-compute[72418]: DEBUG nova.objects.instance [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Lazy-loading 'pci_devices' on Instance uuid d9d5d476-484e-49a3-a665-5a2069ea606e {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:24:31 user nova-compute[72418]: DEBUG nova.objects.instance [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Lazy-loading 'resources' on Instance uuid d9d5d476-484e-49a3-a665-5a2069ea606e {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:24:31 user nova-compute[72418]: DEBUG nova.objects.instance [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Lazy-loading 'migration_context' on Instance uuid d9d5d476-484e-49a3-a665-5a2069ea606e {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:24:31 user nova-compute[72418]: DEBUG nova.objects.instance [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72418) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 09 18:24:32 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:24:32 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:24:32 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:24:32 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:24:32 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:24:32 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Instance destroyed successfully.
Aug 09 18:24:32 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Instance destroyed successfully.
Aug 09 18:24:32 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:22:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1508281415',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-575459132',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTlpxVeNhPxeJuW8zTxzwBKwT/CA/qFwbFSyGFFQ5WBC/z6rTuUG5Drvoef5DHSqpEg+qFNytmw3WteLGcKSZH4mMFqTcywv5Hy3vANpNfa+6Xl/MY5tiOWNwwb6BRwFw==',key_name='tempest-keypair-546529688',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:23:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='64ada6c609434916beb7b6a1d117a993',ramdisk_id='',reservation_id='r-fnsl4oak',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1647763299',owner_user_name='tempest-ServerActionsV293TestJSON-1647763299-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:24:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3a35ad1146840949d0f1cc4780efa2b',uuid=d9d5d476-484e-49a3-a665-5a2069ea606e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2472f1be-ea8f-46b6-a4f3-481f517c7edd", "address": "fa:16:3e:86:93:dc", "network": {"id": "eddf3956-c192-42b3-b928-5e9cf4f07f5f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1344000484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64ada6c609434916beb7b6a1d117a993", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2472f1be-ea", "ovs_interfaceid": "2472f1be-ea8f-46b6-a4f3-481f517c7edd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 18:24:32 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Converting VIF {"id": "2472f1be-ea8f-46b6-a4f3-481f517c7edd", "address": "fa:16:3e:86:93:dc", "network": {"id": "eddf3956-c192-42b3-b928-5e9cf4f07f5f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1344000484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64ada6c609434916beb7b6a1d117a993", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2472f1be-ea", "ovs_interfaceid": "2472f1be-ea8f-46b6-a4f3-481f517c7edd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:24:32 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:93:dc,bridge_name='br-int',has_traffic_filtering=True,id=2472f1be-ea8f-46b6-a4f3-481f517c7edd,network=Network(eddf3956-c192-42b3-b928-5e9cf4f07f5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2472f1be-ea') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:24:32 user nova-compute[72418]: DEBUG os_vif [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:93:dc,bridge_name='br-int',has_traffic_filtering=True,id=2472f1be-ea8f-46b6-a4f3-481f517c7edd,network=Network(eddf3956-c192-42b3-b928-5e9cf4f07f5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2472f1be-ea') {{(pid=72418) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 18:24:32 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:24:32 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2472f1be-ea, bridge=br-int, if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:24:32 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:24:32 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:24:32 user nova-compute[72418]: INFO os_vif [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:93:dc,bridge_name='br-int',has_traffic_filtering=True,id=2472f1be-ea8f-46b6-a4f3-481f517c7edd,network=Network(eddf3956-c192-42b3-b928-5e9cf4f07f5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2472f1be-ea')
Aug 09 18:24:32 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] calling os-brick to detach iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 18:24:32 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, {'target_iqns': ['iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TUdEGbkO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:24:32 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 18:24:32 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:24:32 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:24:32 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424', 0)] {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 18:24:32 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:32 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:32 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde0f439-e51e-4580-8be9-7f7146f55152]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:32 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:32 user nova-compute[72418]: DEBUG nova.compute.manager [req-34b3ac5c-6c76-445a-8c81-edc39b281a75 req-ff5e4ae2-41c9-4316-88a7-3c988293b8ff service nova] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Received event network-vif-unplugged-2472f1be-ea8f-46b6-a4f3-481f517c7edd {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:24:32 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-34b3ac5c-6c76-445a-8c81-edc39b281a75 req-ff5e4ae2-41c9-4316-88a7-3c988293b8ff service nova] Acquiring lock "d9d5d476-484e-49a3-a665-5a2069ea606e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:24:32 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-34b3ac5c-6c76-445a-8c81-edc39b281a75 req-ff5e4ae2-41c9-4316-88a7-3c988293b8ff service nova] Lock "d9d5d476-484e-49a3-a665-5a2069ea606e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:24:32 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-34b3ac5c-6c76-445a-8c81-edc39b281a75 req-ff5e4ae2-41c9-4316-88a7-3c988293b8ff service nova] Lock "d9d5d476-484e-49a3-a665-5a2069ea606e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:24:32 user nova-compute[72418]: DEBUG nova.compute.manager [req-34b3ac5c-6c76-445a-8c81-edc39b281a75 req-ff5e4ae2-41c9-4316-88a7-3c988293b8ff service nova] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] No waiting events found dispatching network-vif-unplugged-2472f1be-ea8f-46b6-a4f3-481f517c7edd {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:24:32 user nova-compute[72418]: WARNING nova.compute.manager [req-34b3ac5c-6c76-445a-8c81-edc39b281a75 req-ff5e4ae2-41c9-4316-88a7-3c988293b8ff service nova] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Received unexpected event network-vif-unplugged-2472f1be-ea8f-46b6-a4f3-481f517c7edd for instance with vm_state active and task_state rebuilding.
Aug 09 18:24:32 user nova-compute[72418]: DEBUG nova.compute.manager [req-34b3ac5c-6c76-445a-8c81-edc39b281a75 req-ff5e4ae2-41c9-4316-88a7-3c988293b8ff service nova] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Received event network-vif-plugged-2472f1be-ea8f-46b6-a4f3-481f517c7edd {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:24:32 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-34b3ac5c-6c76-445a-8c81-edc39b281a75 req-ff5e4ae2-41c9-4316-88a7-3c988293b8ff service nova] Acquiring lock "d9d5d476-484e-49a3-a665-5a2069ea606e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:24:32 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-34b3ac5c-6c76-445a-8c81-edc39b281a75 req-ff5e4ae2-41c9-4316-88a7-3c988293b8ff service nova] Lock "d9d5d476-484e-49a3-a665-5a2069ea606e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:24:32 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-34b3ac5c-6c76-445a-8c81-edc39b281a75 req-ff5e4ae2-41c9-4316-88a7-3c988293b8ff service nova] Lock "d9d5d476-484e-49a3-a665-5a2069ea606e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:24:32 user nova-compute[72418]: DEBUG nova.compute.manager [req-34b3ac5c-6c76-445a-8c81-edc39b281a75 req-ff5e4ae2-41c9-4316-88a7-3c988293b8ff service nova] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] No waiting events found dispatching network-vif-plugged-2472f1be-ea8f-46b6-a4f3-481f517c7edd {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:24:32 user nova-compute[72418]: WARNING nova.compute.manager [req-34b3ac5c-6c76-445a-8c81-edc39b281a75 req-ff5e4ae2-41c9-4316-88a7-3c988293b8ff service nova] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Received unexpected event network-vif-plugged-2472f1be-ea8f-46b6-a4f3-481f517c7edd for instance with vm_state active and task_state rebuilding.
Aug 09 18:24:32 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:32 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[145c88a8-adc8-4bf6-8032-b68d4d637157]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:32 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:24:32 user nova-compute[72418]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)
Aug 09 18:24:32 user nova-compute[72418]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)
Aug 09 18:24:32 user nova-compute[72418]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)
Aug 09 18:24:32 user nova-compute[72418]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 (non-flash)
Aug 09 18:24:32 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:24:32 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:24:32 user nova-compute[72418]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)
Aug 09 18:24:32 user nova-compute[72418]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)
Aug 09 18:24:32 user nova-compute[72418]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)
Aug 09 18:24:32 user nova-compute[72418]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 (non-flash)
Aug 09 18:24:32 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:24:32 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f42f859cca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424'): ({'sdb'}, set())}) {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 18:24:32 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Removing single pathed devices sdb {{(pid=72418) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 18:24:32 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:32 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:32 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f85506f-e5f9-489c-92fd-154aa0ac5d62]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:32 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:32 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:32 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d836ef2-de92-4621-8e64-3b2615c018d3]: (4, ('ok\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:32 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Flushing IO for device /dev/sdb {{(pid=72418) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 18:24:32 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:32 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:32 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0937255-0bff-4b1f-8894-dd10bb8712b1]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:32 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72418) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 18:24:32 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:32 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:32 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[15618862-26fe-48a6-bbdc-3b41a35f4c32]: (4, ('1', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:32 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 18:24:32 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] SCSI volumes sdb have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 18:24:32 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424')] {{(pid=72418) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 18:24:32 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:32 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:32 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[5700a6ed-5b63-425e-bcfa-ccc7ba9917e8]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:32 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:24:32 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 -p 172.16.0.220:3260 --logout {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:33 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:33 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d497fd-38b3-460b-83d2-bdd1716b6222]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:33 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424, portal: 172.16.0.220,3260]
Aug 09 18:24:33 user nova-compute[72418]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424, portal: 172.16.0.220,3260] successful.
Aug 09 18:24:33 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:24:33 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 -p 172.16.0.220:3260 --op delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:33 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:33 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4e7662-5dfa-457b-84ac-104c62611675]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:33 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:24:33 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:24:33 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] <== disconnect_volume: return (326ms) None {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:24:33 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Disconnected iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 18:24:33 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Deleting instance files /opt/stack/data/nova/instances/d9d5d476-484e-49a3-a665-5a2069ea606e_del
Aug 09 18:24:33 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Deletion of /opt/stack/data/nova/instances/d9d5d476-484e-49a3-a665-5a2069ea606e_del complete
Aug 09 18:24:33 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance d9d5d476-484e-49a3-a665-5a2069ea606e could not be found.
Aug 09 18:24:33 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] calling os-brick to detach iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 18:24:33 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, {'target_iqns': ['iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TUdEGbkO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:24:33 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 18:24:33 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:24:33 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:24:33 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424', 0)] {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 18:24:33 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:33 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:33 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[318c3d29-f55f-43a6-8aad-53a6f94e7ba3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:33 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:33 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:33 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[232604d5-8a72-43f8-aef8-cb6fab82c5c5]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:33 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)
Aug 09 18:24:33 user nova-compute[72418]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)
Aug 09 18:24:33 user nova-compute[72418]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)
Aug 09 18:24:33 user nova-compute[72418]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 (non-flash)
Aug 09 18:24:33 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:24:33 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)
Aug 09 18:24:33 user nova-compute[72418]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)
Aug 09 18:24:33 user nova-compute[72418]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)
Aug 09 18:24:33 user nova-compute[72418]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 (non-flash)
Aug 09 18:24:33 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:24:33 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f42f811b880>, {}) {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 18:24:33 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Disconnecting from: [] {{(pid=72418) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 18:24:33 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.049s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:24:33 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] <== disconnect_volume: return (50ms) None {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:24:33 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Disconnected iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 18:24:34 user nova-compute[72418]: DEBUG nova.compute.manager [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Preparing to wait for external event volume-reimaged-63025fe7-5619-4f33-85cb-044aca432424 {{(pid=72418) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 09 18:24:34 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Acquiring lock "d9d5d476-484e-49a3-a665-5a2069ea606e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:24:34 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Lock "d9d5d476-484e-49a3-a665-5a2069ea606e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:24:34 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Lock "d9d5d476-484e-49a3-a665-5a2069ea606e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:24:37 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:24:37 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:24:40 user nova-compute[72418]: DEBUG nova.compute.manager [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jgxtbFOa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dabfdb24-fc0b-4a00-a229-1ece48e27d18', 'attached_at': '', 'detached_at': '', 'volume_id': '1de0aad7-83ac-4b9b-ba88-3418baa6a1aa', 'serial': '1de0aad7-83ac-4b9b-ba88-3418baa6a1aa'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXyMalNF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'dabfdb24-fc0b-4a00-a229-1ece48e27d18', 'attached_at': '', 'detached_at': '', 'volume_id': '1d982f88-39fb-45e9-a6c9-4a4379a52ea3', 'serial'} {{(pid=72418) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 09 18:24:40 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Calling os-brick to attach iSCSI Volume {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 18:24:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jgxtbFOa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:24:40 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:24:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:24:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:24:40 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:24:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:24:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:24:40 user nova-compute[72418]: INFO os_brick.initiator.connectors.iscsi [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 18:24:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa -p 172.16.0.220:3260 {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:40 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b933be-3118-450f-b4ad-cdef2e8f1cac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 18:24:40 user nova-compute[72418]:  {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:24:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa -p 172.16.0.220:3260 --interface default --op new {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:40 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29ef3c1-0e9c-45f4-a2b6-d688e7ea3789]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa] added\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa] added
Aug 09 18:24:40 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:24:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:40 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[94105273-2514-49f4-a65e-4be71128bb4b]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:24:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:40 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[31eb66dd-994b-4aed-86d0-77b5f4dad427]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:24:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jgxtbFOa {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jgxtbFOa" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:40 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[d840074d-f224-4fed-a432-26bc32dac6f0]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jgxtbFOa'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:24:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:40 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[03dbc74e-d197-41eb-9195-c05e00fffef1]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:24:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:40 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac64bdc-a2d3-43cb-b420-6e7c8380ca4a]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)
Aug 09 18:24:40 user nova-compute[72418]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)
Aug 09 18:24:40 user nova-compute[72418]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)
Aug 09 18:24:40 user nova-compute[72418]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 (non-flash)
Aug 09 18:24:40 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:24:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)
Aug 09 18:24:40 user nova-compute[72418]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)
Aug 09 18:24:40 user nova-compute[72418]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)
Aug 09 18:24:40 user nova-compute[72418]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 (non-flash)
Aug 09 18:24:40 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:24:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa -p 172.16.0.220:3260 --login {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:40 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2515d2a-5a84-4814-ac8d-c5861bda0cb4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa, portal: 172.16.0.220,3260]
Aug 09 18:24:40 user nova-compute[72418]: Login to [iface: default, target: iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa, portal: 172.16.0.220,3260] successful.
Aug 09 18:24:40 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:24:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:40 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc23a5e-43cc-4f43-9b26-70d64d271ee4]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:24:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:40 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f63bce9-145c-471e-b98b-21f9baf04090]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa (non-flash)
Aug 09 18:24:40 user nova-compute[72418]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)
Aug 09 18:24:40 user nova-compute[72418]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)
Aug 09 18:24:40 user nova-compute[72418]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)
Aug 09 18:24:40 user nova-compute[72418]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 (non-flash)
Aug 09 18:24:40 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:24:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa (non-flash)
Aug 09 18:24:40 user nova-compute[72418]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)
Aug 09 18:24:40 user nova-compute[72418]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)
Aug 09 18:24:40 user nova-compute[72418]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)
Aug 09 18:24:40 user nova-compute[72418]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 (non-flash)
Aug 09 18:24:40 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:24:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:24:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Connected to 172.16.0.220:3260 {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 18:24:40 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] HCTL ('33', '-', '-', 0) found on session 10 with lun 0 {{(pid=72418) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 18:24:40 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=72418) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 18:24:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:40 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a92642-51f5-4d37-8bdd-7c2534e618a1]: (4, ('- - 0', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:40 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Searching for a device in session 10 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72418) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 18:24:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jgxtbFOa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 18:24:41 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:24:41 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '26231653864323466', 'path': '/dev/sdb'} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:24:41 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231653864323466', 'path': '/dev/sdb'} {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 18:24:41 user nova-compute[72418]: DEBUG nova.objects.instance [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Lazy-loading 'flavor' on Instance uuid dabfdb24-fc0b-4a00-a229-1ece48e27d18 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:24:42 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:24:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=72418) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 18:24:42 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:24:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] COPY block job progress, current cursor: 188743680 final cursor: 1073741824 {{(pid=72418) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 18:24:43 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] COPY block job progress, current cursor: 373293056 final cursor: 1073741824 {{(pid=72418) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 18:24:43 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] COPY block job progress, current cursor: 481296384 final cursor: 1073741824 {{(pid=72418) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 18:24:43 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:24:43 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:24:44 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] COPY block job progress, current cursor: 649068544 final cursor: 1073741824 {{(pid=72418) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 18:24:44 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] COPY block job progress, current cursor: 828375040 final cursor: 1073741824 {{(pid=72418) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 18:24:45 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] COPY block job progress, current cursor: 1013972992 final cursor: 1073741824 {{(pid=72418) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 18:24:45 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72418) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 18:24:46 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] calling os-brick to detach iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 18:24:46 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, {'target_iqns': ['iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXyMalNF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:24:46 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:24:46 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:24:46 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:24:46 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3', 0)] {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 18:24:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:46 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5918539-3a55-4d4c-9ef3-9563f4460ff7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:46 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad5c137-18e9-4541-b881-547162f1f5f7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:46 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa (non-flash)
Aug 09 18:24:46 user nova-compute[72418]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:24:46 user nova-compute[72418]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)
Aug 09 18:24:46 user nova-compute[72418]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)
Aug 09 18:24:46 user nova-compute[72418]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)
Aug 09 18:24:46 user nova-compute[72418]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 (non-flash)
Aug 09 18:24:46 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:24:46 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa (non-flash)
Aug 09 18:24:46 user nova-compute[72418]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:24:46 user nova-compute[72418]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)
Aug 09 18:24:46 user nova-compute[72418]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)
Aug 09 18:24:46 user nova-compute[72418]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)
Aug 09 18:24:46 user nova-compute[72418]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 (non-flash)
Aug 09 18:24:46 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:24:46 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f42f874c0d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3'): ({'sdf'}, set())}) {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 18:24:46 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Removing single pathed devices sdf {{(pid=72418) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 18:24:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:46 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efb6151-34bf-4d9c-bbb2-4e56cda4b455]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:46 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[15029caf-49ba-446b-9f0a-91ae2473dcab]: (4, ('ok\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:46 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Flushing IO for device /dev/sdf {{(pid=72418) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 18:24:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:46 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf4a2be-07b7-4d44-acee-fcc11a35e995]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:46 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72418) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 18:24:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.052s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:46 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba99501-9914-4e7b-8708-bb1a7d22157d]: (4, ('1', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:46 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 18:24:46 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] SCSI volumes sdf have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 18:24:46 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3')] {{(pid=72418) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 18:24:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:46 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28473c9-5e91-4f1a-ab5a-90e8f8dc24d2]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:46 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:24:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 -p 172.16.0.220:3260 --logout {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:46 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7804b2-725c-4322-abef-8bc3564ee06a]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:46 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3, portal: 172.16.0.220,3260]
Aug 09 18:24:46 user nova-compute[72418]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3, portal: 172.16.0.220,3260] successful.
Aug 09 18:24:46 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:24:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 -p 172.16.0.220:3260 --op delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:46 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[b846531b-ffeb-4bb5-aeed-672991191747]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:46 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:24:46 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:24:46 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] <== disconnect_volume: return (310ms) None {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:24:46 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Disconnected iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 18:24:46 user nova-compute[72418]: DEBUG nova.compute.manager [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jgxtbFOa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'dabfdb24-fc0b-4a00-a229-1ece48e27d18', 'attached_at': '', 'detached_at': '', 'volume_id': '1de0aad7-83ac-4b9b-ba88-3418baa6a1aa', 'serial'} {{(pid=72418) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 09 18:24:46 user nova-compute[72418]: DEBUG nova.compute.manager [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] swap_volume: removing Cinder connection for volume 1d982f88-39fb-45e9-a6c9-4a4379a52ea3 {{(pid=72418) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 09 18:24:46 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:24:47 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:24:47 user nova-compute[72418]: DEBUG nova.compute.manager [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] swap_volume: Updating volume 1d982f88-39fb-45e9-a6c9-4a4379a52ea3 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "jgxtbFOa", "auth_password": "EopF9g1ZDXMlJP", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "1de0aad7-83ac-4b9b-ba88-3418baa6a1aa"}, "status": "reserved", "instance": "dabfdb24-fc0b-4a00-a229-1ece48e27d18", "attached_at": "", "detached_at": "", "volume_id": "1de0aad7-83ac-4b9b-ba88-3418baa6a1aa", "serial": "1de0aad7-83ac-4b9b-ba88-3418baa6a1aa"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '1de0aad7-83ac-4b9b-ba88-3418baa6a1aa', 'no_device': None, 'attachment_id': 'a628873c-7066-4fe5-aa54-19d181f51941'} {{(pid=72418) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 09 18:24:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-2e612f2e-7966-469f-bd20-c98b8a9464b8 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Lock "dabfdb24-fc0b-4a00-a229-1ece48e27d18" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 16.039s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:24:47 user nova-compute[72418]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691605472.7326162, d9d5d476-484e-49a3-a665-5a2069ea606e => Stopped> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:24:47 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] VM Stopped (Lifecycle Event)
Aug 09 18:24:47 user nova-compute[72418]: DEBUG nova.compute.manager [None req-6bb23a0d-d8ab-4327-a1f9-80c12765348b None None] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:24:47 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:24:47 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:24:47 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:24:47 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:24:47 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:24:47 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72418) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 18:24:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Acquiring lock "dabfdb24-fc0b-4a00-a229-1ece48e27d18" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:24:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Lock "dabfdb24-fc0b-4a00-a229-1ece48e27d18" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:24:47 user nova-compute[72418]: DEBUG os_brick.utils [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:24:47 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:48 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f037e0-30e1-4348-832a-7ee313b48ab1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ad56b243ad71\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:48 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96c6669-81c2-45fa-bc29-aa71a69293bb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:48 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b577410-009c-4ce5-95da-b2b75709c7c4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:48 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[e234280e-97ee-4227-aba1-ec8a31a5c8be]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Running cmd (subprocess): nvme version {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:24:48 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.nvmeof [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] nvme not present on system {{(pid=72418) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 18:24:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:24:48 user nova-compute[72418]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 18:24:48 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf38323-5d6d-43bb-9e50-75e8b7f2f83e]: (4, '') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:48 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72418) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 18:24:48 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 18:24:48 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] LIGHTOS: no hostnqn found. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 18:24:48 user nova-compute[72418]: DEBUG os_brick.utils [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ad56b243ad71', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:24:48 user nova-compute[72418]: INFO nova.compute.manager [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Swapping volume 1de0aad7-83ac-4b9b-ba88-3418baa6a1aa for 1d982f88-39fb-45e9-a6c9-4a4379a52ea3
Aug 09 18:24:48 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:24:48 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:24:48 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:24:48 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:24:48 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Auditing locally available compute resources for user (node: user) {{(pid=72418) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 18:24:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:24:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:24:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:24:49 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/479ea4c3-ad7f-4da0-a901-defe46d96065/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:49 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/479ea4c3-ad7f-4da0-a901-defe46d96065/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:49 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/479ea4c3-ad7f-4da0-a901-defe46d96065/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:49 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/479ea4c3-ad7f-4da0-a901-defe46d96065/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:49 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28dad451-f27e-4c62-8353-e3b89e0196cd/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:49 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28dad451-f27e-4c62-8353-e3b89e0196cd/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:49 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28dad451-f27e-4c62-8353-e3b89e0196cd/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:49 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28dad451-f27e-4c62-8353-e3b89e0196cd/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:49 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6927390-e0f7-43cf-8a83-d3c004865129/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:49 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6927390-e0f7-43cf-8a83-d3c004865129/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:49 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6927390-e0f7-43cf-8a83-d3c004865129/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6927390-e0f7-43cf-8a83-d3c004865129/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dabfdb24-fc0b-4a00-a229-1ece48e27d18/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dabfdb24-fc0b-4a00-a229-1ece48e27d18/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dabfdb24-fc0b-4a00-a229-1ece48e27d18/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dabfdb24-fc0b-4a00-a229-1ece48e27d18/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:50 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:24:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6084e681-01c4-4a6c-beb3-dcda4a990a51/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:51 user nova-compute[72418]: DEBUG nova.compute.manager [req-ade588ac-a591-4e67-9337-d70c50d69163 req-9349fb2e-7ca2-4ba6-a0cb-cc6728d92e3f service nova] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Received event volume-reimaged-63025fe7-5619-4f33-85cb-044aca432424 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:24:51 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-ade588ac-a591-4e67-9337-d70c50d69163 req-9349fb2e-7ca2-4ba6-a0cb-cc6728d92e3f service nova] Acquiring lock "d9d5d476-484e-49a3-a665-5a2069ea606e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:24:51 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-ade588ac-a591-4e67-9337-d70c50d69163 req-9349fb2e-7ca2-4ba6-a0cb-cc6728d92e3f service nova] Lock "d9d5d476-484e-49a3-a665-5a2069ea606e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:24:51 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-ade588ac-a591-4e67-9337-d70c50d69163 req-9349fb2e-7ca2-4ba6-a0cb-cc6728d92e3f service nova] Lock "d9d5d476-484e-49a3-a665-5a2069ea606e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:24:51 user nova-compute[72418]: DEBUG nova.compute.manager [req-ade588ac-a591-4e67-9337-d70c50d69163 req-9349fb2e-7ca2-4ba6-a0cb-cc6728d92e3f service nova] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Processing event volume-reimaged-63025fe7-5619-4f33-85cb-044aca432424 {{(pid=72418) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 09 18:24:51 user nova-compute[72418]: DEBUG nova.compute.manager [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Instance event wait completed in 17 seconds for volume-reimaged {{(pid=72418) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 18:24:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6084e681-01c4-4a6c-beb3-dcda4a990a51/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6084e681-01c4-4a6c-beb3-dcda4a990a51/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:51 user nova-compute[72418]: INFO nova.virt.block_device [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Booting with volume 63025fe7-5619-4f33-85cb-044aca432424 at /dev/vda
Aug 09 18:24:52 user nova-compute[72418]: DEBUG os_brick.utils [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:24:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:52 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db338f4-0241-4f97-adf6-b6a7cf1c6007]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ad56b243ad71\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6084e681-01c4-4a6c-beb3-dcda4a990a51/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aab087ae-c46e-46c8-baa0-d754dc29947f/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:52 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15ad5bb-06f5-4980-96f1-048755cfbebc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:52 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3231a0-0095-4df0-af58-0ca1ca327a3d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:52 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[94314468-4a18-488c-98b3-2a7c2980cb8a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Running cmd (subprocess): nvme version {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] 'nvme version' failed. Not Retrying. {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:24:52 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] nvme not present on system {{(pid=72418) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 18:24:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:24:52 user nova-compute[72418]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 18:24:52 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[036b662d-4ce4-4cd7-aede-698ddbe394c2]: (4, '') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:52 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72418) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 18:24:52 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 18:24:52 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] LIGHTOS: no hostnqn found. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 18:24:52 user nova-compute[72418]: DEBUG os_brick.utils [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ad56b243ad71', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:24:52 user nova-compute[72418]: DEBUG nova.virt.block_device [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Updating existing volume attachment record: 56a7bde8-2ab6-4c72-bc13-8eae169f8864 {{(pid=72418) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 18:24:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aab087ae-c46e-46c8-baa0-d754dc29947f/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aab087ae-c46e-46c8-baa0-d754dc29947f/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:52 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:24:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aab087ae-c46e-46c8-baa0-d754dc29947f/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:52 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:24:52 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:24:52 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:24:52 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Hypervisor/Node resource view: name=user free_ram=6773MB free_disk=25.75048065185547GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72418) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 18:24:52 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:24:52 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:24:53 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 6af7918a-ce90-45ab-93d8-684e1489e891 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:24:53 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 8fe41968-a219-4a5a-afdb-32eb2082bb40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:24:53 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 01c46b33-6788-44a5-a43c-88ee4acc4d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:24:53 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 479ea4c3-ad7f-4da0-a901-defe46d96065 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:24:53 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 6084e681-01c4-4a6c-beb3-dcda4a990a51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:24:53 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:24:53 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance dabfdb24-fc0b-4a00-a229-1ece48e27d18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:24:53 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance d9d5d476-484e-49a3-a665-5a2069ea606e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:24:53 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 2b284735-40f6-403f-8c72-a70a4da1ef95 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:24:53 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 28dad451-f27e-4c62-8353-e3b89e0196cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:24:53 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance aab087ae-c46e-46c8-baa0-d754dc29947f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:24:53 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance b6927390-e0f7-43cf-8a83-d3c004865129 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:24:53 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 18:24:53 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 18:24:53 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:24:53 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:24:53 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Compute_service record updated for user:user {{(pid=72418) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 18:24:53 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.577s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:24:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquiring lock "e019064c-955e-4f80-9b00-6b32b3835d58" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:24:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "e019064c-955e-4f80-9b00-6b32b3835d58" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:24:54 user nova-compute[72418]: DEBUG nova.compute.manager [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Starting instance... {{(pid=72418) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 18:24:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:24:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:24:54 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72418) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 18:24:54 user nova-compute[72418]: INFO nova.compute.claims [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Claim successful on node user
Aug 09 18:24:55 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:24:55 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:24:55 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.579s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:24:55 user nova-compute[72418]: DEBUG nova.compute.manager [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Start building networks asynchronously for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 18:24:55 user nova-compute[72418]: DEBUG nova.compute.manager [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Allocating IP information in the background. {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 18:24:55 user nova-compute[72418]: DEBUG nova.network.neutron [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] allocate_for_instance() {{(pid=72418) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 18:24:55 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 18:24:55 user nova-compute[72418]: DEBUG nova.compute.manager [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Start building block device mappings for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 18:24:55 user nova-compute[72418]: INFO nova.virt.block_device [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Booting with blank volume at /dev/vda
Aug 09 18:24:55 user nova-compute[72418]: DEBUG nova.policy [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '621fd2b971c543d197a354c38e0d1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e5863cda54487682a4edcc24202c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72418) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 18:24:56 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:24:56 user nova-compute[72418]: DEBUG nova.network.neutron [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Successfully created port: 4c6c632a-142b-4cda-92c8-77026645af09 {{(pid=72418) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 18:24:56 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:24:56 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Starting heal instance info cache {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 18:24:56 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "refresh_cache-01c46b33-6788-44a5-a43c-88ee4acc4d39" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:24:56 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquired lock "refresh_cache-01c46b33-6788-44a5-a43c-88ee4acc4d39" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:24:56 user nova-compute[72418]: DEBUG nova.network.neutron [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Forcefully refreshing network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 18:24:56 user nova-compute[72418]: DEBUG nova.network.neutron [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Successfully updated port: 4c6c632a-142b-4cda-92c8-77026645af09 {{(pid=72418) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 18:24:56 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquiring lock "refresh_cache-e019064c-955e-4f80-9b00-6b32b3835d58" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:24:56 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquired lock "refresh_cache-e019064c-955e-4f80-9b00-6b32b3835d58" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:24:56 user nova-compute[72418]: DEBUG nova.network.neutron [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:24:56 user nova-compute[72418]: DEBUG nova.compute.manager [req-8a854965-eac3-4687-aa02-6542ddc7700a req-17c3c712-ea9d-48dd-8025-5e6da4193fb6 service nova] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Received event network-changed-4c6c632a-142b-4cda-92c8-77026645af09 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:24:56 user nova-compute[72418]: DEBUG nova.compute.manager [req-8a854965-eac3-4687-aa02-6542ddc7700a req-17c3c712-ea9d-48dd-8025-5e6da4193fb6 service nova] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Refreshing instance network info cache due to event network-changed-4c6c632a-142b-4cda-92c8-77026645af09. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:24:56 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-8a854965-eac3-4687-aa02-6542ddc7700a req-17c3c712-ea9d-48dd-8025-5e6da4193fb6 service nova] Acquiring lock "refresh_cache-e019064c-955e-4f80-9b00-6b32b3835d58" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:24:56 user nova-compute[72418]: DEBUG nova.network.neutron [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Instance cache missing network info. {{(pid=72418) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 18:24:57 user nova-compute[72418]: DEBUG nova.network.neutron [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Updating instance_info_cache with network_info: [{"id": "4c6c632a-142b-4cda-92c8-77026645af09", "address": "fa:16:3e:15:18:a4", "network": {"id": "beaefb5c-f5e4-47e7-ab68-60131f532ade", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e5863cda54487682a4edcc24202c91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c6c632a-14", "ovs_interfaceid": "4c6c632a-142b-4cda-92c8-77026645af09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:24:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Releasing lock "refresh_cache-e019064c-955e-4f80-9b00-6b32b3835d58" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:24:57 user nova-compute[72418]: DEBUG nova.compute.manager [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Instance network_info: |[{"id": "4c6c632a-142b-4cda-92c8-77026645af09", "address": "fa:16:3e:15:18:a4", "network": {"id": "beaefb5c-f5e4-47e7-ab68-60131f532ade", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e5863cda54487682a4edcc24202c91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c6c632a-14", "ovs_interfaceid": "4c6c632a-142b-4cda-92c8-77026645af09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 18:24:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-8a854965-eac3-4687-aa02-6542ddc7700a req-17c3c712-ea9d-48dd-8025-5e6da4193fb6 service nova] Acquired lock "refresh_cache-e019064c-955e-4f80-9b00-6b32b3835d58" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:24:57 user nova-compute[72418]: DEBUG nova.network.neutron [req-8a854965-eac3-4687-aa02-6542ddc7700a req-17c3c712-ea9d-48dd-8025-5e6da4193fb6 service nova] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Refreshing network info cache for port 4c6c632a-142b-4cda-92c8-77026645af09 {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:24:57 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:24:57 user nova-compute[72418]: DEBUG nova.network.neutron [req-8a854965-eac3-4687-aa02-6542ddc7700a req-17c3c712-ea9d-48dd-8025-5e6da4193fb6 service nova] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Updated VIF entry in instance network info cache for port 4c6c632a-142b-4cda-92c8-77026645af09. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:24:57 user nova-compute[72418]: DEBUG nova.network.neutron [req-8a854965-eac3-4687-aa02-6542ddc7700a req-17c3c712-ea9d-48dd-8025-5e6da4193fb6 service nova] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Updating instance_info_cache with network_info: [{"id": "4c6c632a-142b-4cda-92c8-77026645af09", "address": "fa:16:3e:15:18:a4", "network": {"id": "beaefb5c-f5e4-47e7-ab68-60131f532ade", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e5863cda54487682a4edcc24202c91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c6c632a-14", "ovs_interfaceid": "4c6c632a-142b-4cda-92c8-77026645af09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:24:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-8a854965-eac3-4687-aa02-6542ddc7700a req-17c3c712-ea9d-48dd-8025-5e6da4193fb6 service nova] Releasing lock "refresh_cache-e019064c-955e-4f80-9b00-6b32b3835d58" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:24:57 user nova-compute[72418]: DEBUG nova.compute.manager [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXyMalNF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dabfdb24-fc0b-4a00-a229-1ece48e27d18', 'attached_at': '', 'detached_at': '', 'volume_id': '1d982f88-39fb-45e9-a6c9-4a4379a52ea3', 'serial': '1d982f88-39fb-45e9-a6c9-4a4379a52ea3'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jgxtbFOa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '1de0aad7-83ac-4b9b-ba88-3418baa6a1aa'}, 'status': 'reserved', 'instance': 'dabfdb24-fc0b-4a00-a229-1ece48e27d18', 'attached_at': '', 'detached_at': '', 'volume_id': '1de0aad7-83ac-4b9b-ba88-3418baa6a1aa', 'serial'} {{(pid=72418) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 09 18:24:57 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:24:57 user nova-compute[72418]: DEBUG nova.network.neutron [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Updating instance_info_cache with network_info: [{"id": "1487cbc0-54ec-4134-9e08-88f02ff870f5", "address": "fa:16:3e:b3:6b:21", "network": {"id": "15a49d9b-3c0d-449b-9473-29f219960e2c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c68622cd79472ba6ad14a6876aeaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1487cbc0-54", "ovs_interfaceid": "1487cbc0-54ec-4134-9e08-88f02ff870f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:24:57 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Calling os-brick to attach iSCSI Volume {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 18:24:57 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXyMalNF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:24:57 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:24:57 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:24:57 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:24:57 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:24:57 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:24:57 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:24:57 user nova-compute[72418]: INFO os_brick.initiator.connectors.iscsi [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 18:24:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 -p 172.16.0.220:3260 {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Releasing lock "refresh_cache-01c46b33-6788-44a5-a43c-88ee4acc4d39" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:24:57 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Updated the network info_cache for instance {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 18:24:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:57 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1b8de6-7e2b-43ab-a776-01ce2d2977a8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:57 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 18:24:57 user nova-compute[72418]:  {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:24:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:58 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[223e865f-dfe3-4b54-9cad-5508ca927867]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3] added\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3] added
Aug 09 18:24:58 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:24:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:58 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2000401-e637-48b8-a5c5-c35fc986f96c]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:24:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:58 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[9947f30a-c82b-40d8-b879-a4cc6ea78536]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:24:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EXyMalNF {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EXyMalNF" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:58 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a876090a-d7de-4b43-a714-b0e01591b3ae]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EXyMalNF'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:24:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:58 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0bd0d3-5f40-4411-9729-7ab2f7bad867]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:24:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:58 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[6548ae37-e36b-453f-8124-14a6f31c6172]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa (non-flash)
Aug 09 18:24:58 user nova-compute[72418]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)
Aug 09 18:24:58 user nova-compute[72418]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)
Aug 09 18:24:58 user nova-compute[72418]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)
Aug 09 18:24:58 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:24:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa (non-flash)
Aug 09 18:24:58 user nova-compute[72418]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)
Aug 09 18:24:58 user nova-compute[72418]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)
Aug 09 18:24:58 user nova-compute[72418]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)
Aug 09 18:24:58 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:24:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 -p 172.16.0.220:3260 --login {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:58 user nova-compute[72418]: DEBUG nova.compute.manager [req-936ddac9-b82e-4d8f-b8a1-f00c9ff76a34 req-56229eb8-dcb4-41e6-b326-6cf25b4a5584 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received event network-changed-f148ea7a-87e0-482f-bd2f-d3fcaa50fd4f {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:24:58 user nova-compute[72418]: DEBUG nova.compute.manager [req-936ddac9-b82e-4d8f-b8a1-f00c9ff76a34 req-56229eb8-dcb4-41e6-b326-6cf25b4a5584 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Refreshing instance network info cache due to event network-changed-f148ea7a-87e0-482f-bd2f-d3fcaa50fd4f. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:24:58 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-936ddac9-b82e-4d8f-b8a1-f00c9ff76a34 req-56229eb8-dcb4-41e6-b326-6cf25b4a5584 service nova] Acquiring lock "refresh_cache-2b284735-40f6-403f-8c72-a70a4da1ef95" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:24:58 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-936ddac9-b82e-4d8f-b8a1-f00c9ff76a34 req-56229eb8-dcb4-41e6-b326-6cf25b4a5584 service nova] Acquired lock "refresh_cache-2b284735-40f6-403f-8c72-a70a4da1ef95" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:24:58 user nova-compute[72418]: DEBUG nova.network.neutron [req-936ddac9-b82e-4d8f-b8a1-f00c9ff76a34 req-56229eb8-dcb4-41e6-b326-6cf25b4a5584 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Refreshing network info cache for port f148ea7a-87e0-482f-bd2f-d3fcaa50fd4f {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:24:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:58 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[5faf7045-b60b-44f3-928b-86dfec53d91e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3, portal: 172.16.0.220,3260]
Aug 09 18:24:58 user nova-compute[72418]: Login to [iface: default, target: iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3, portal: 172.16.0.220,3260] successful.
Aug 09 18:24:58 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:24:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:58 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7d8a34-9751-4364-808b-6910435cbe36]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:24:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:58 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[5937b835-0fcd-4255-84b6-b150ab7dc5e7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa (non-flash)
Aug 09 18:24:58 user nova-compute[72418]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 (non-flash)
Aug 09 18:24:58 user nova-compute[72418]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)
Aug 09 18:24:58 user nova-compute[72418]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)
Aug 09 18:24:58 user nova-compute[72418]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)
Aug 09 18:24:58 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:24:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa (non-flash)
Aug 09 18:24:58 user nova-compute[72418]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 (non-flash)
Aug 09 18:24:58 user nova-compute[72418]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)
Aug 09 18:24:58 user nova-compute[72418]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)
Aug 09 18:24:58 user nova-compute[72418]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)
Aug 09 18:24:58 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:24:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:24:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Connected to 172.16.0.220:3260 {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 18:24:58 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] HCTL ('37', '-', '-', 0) found on session 12 with lun 0 {{(pid=72418) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 18:24:58 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=72418) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 18:24:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:24:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:24:58 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[1088d8a0-f55f-48f7-aca5-fa33e781d300]: (4, ('- - 0', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:24:58 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Searching for a device in session 12 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72418) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 18:24:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXyMalNF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 18:24:58 user nova-compute[72418]: DEBUG nova.network.neutron [req-936ddac9-b82e-4d8f-b8a1-f00c9ff76a34 req-56229eb8-dcb4-41e6-b326-6cf25b4a5584 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Updated VIF entry in instance network info cache for port f148ea7a-87e0-482f-bd2f-d3fcaa50fd4f. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:24:58 user nova-compute[72418]: DEBUG nova.network.neutron [req-936ddac9-b82e-4d8f-b8a1-f00c9ff76a34 req-56229eb8-dcb4-41e6-b326-6cf25b4a5584 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Updating instance_info_cache with network_info: [{"id": "f148ea7a-87e0-482f-bd2f-d3fcaa50fd4f", "address": "fa:16:3e:5c:b3:39", "network": {"id": "1b2af6fe-348e-4d75-9967-f6e70cb5e625", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1372910455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf148ea7a-87", "ovs_interfaceid": "f148ea7a-87e0-482f-bd2f-d3fcaa50fd4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "92f457ac-3ac1-426a-ac45-854d9e2ca180", "address": "fa:16:3e:1e:50:a4", "network": {"id": "a4e74890-7ab4-4e52-8297-5c27f2cb6497", "bridge": "br-int", "label": "tempest-device-tagging-net1-428079376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f457ac-3a", "ovs_interfaceid": "92f457ac-3ac1-426a-ac45-854d9e2ca180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a0900115-d746-4910-aafd-a6da02efe287", "address": "fa:16:3e:fa:8a:82", "network": {"id": "a4e74890-7ab4-4e52-8297-5c27f2cb6497", "bridge": "br-int", "label": "tempest-device-tagging-net1-428079376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0900115-d7", "ovs_interfaceid": "a0900115-d746-4910-aafd-a6da02efe287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cb99cdec-40f2-4666-bc12-0c825431db5f", "address": "fa:16:3e:39:ba:42", "network": {"id": "a4e74890-7ab4-4e52-8297-5c27f2cb6497", "bridge": "br-int", "label": "tempest-device-tagging-net1-428079376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb99cdec-40", "ovs_interfaceid": "cb99cdec-40f2-4666-bc12-0c825431db5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "af01e732-21ed-4815-842e-90e7b3591398", "address": "fa:16:3e:ab:fe:ca", "network": {"id": "a4e74890-7ab4-4e52-8297-5c27f2cb6497", "bridge": "br-int", "label": "tempest-device-tagging-net1-428079376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf01e732-21", "ovs_interfaceid": "af01e732-21ed-4815-842e-90e7b3591398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "692db581-bf1f-4295-a18d-65ab40120c7a", "address": "fa:16:3e:fb:c8:98", "network": {"id": "7f7c8970-9e06-4944-bfac-ac7ea2073cee", "bridge": "br-int", "label": "tempest-device-tagging-net2-2000981143", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap692db581-bf", "ovs_interfaceid": "692db581-bf1f-4295-a18d-65ab40120c7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "875b1fd5-6595-48dc-83b1-95ebeee70bb2", "address": "fa:16:3e:e1:90:74", "network": {"id": "7f7c8970-9e06-4944-bfac-ac7ea2073cee", "bridge": "br-int", "label": "tempest-device-tagging-net2-2000981143", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875b1fd5-65", "ovs_interfaceid": "875b1fd5-6595-48dc-83b1-95ebeee70bb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:24:58 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-936ddac9-b82e-4d8f-b8a1-f00c9ff76a34 req-56229eb8-dcb4-41e6-b326-6cf25b4a5584 service nova] Releasing lock "refresh_cache-2b284735-40f6-403f-8c72-a70a4da1ef95" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:24:59 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:24:59 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23265303064323639', 'path': '/dev/sdf'} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:24:59 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265303064323639', 'path': '/dev/sdf'} {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 18:24:59 user nova-compute[72418]: DEBUG nova.objects.instance [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Lazy-loading 'flavor' on Instance uuid dabfdb24-fc0b-4a00-a229-1ece48e27d18 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:24:59 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] COPY block job progress, current cursor: 6291456 final cursor: 1073741824 {{(pid=72418) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 18:25:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] COPY block job progress, current cursor: 170917888 final cursor: 1073741824 {{(pid=72418) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 18:25:00 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Acquiring lock "2b284735-40f6-403f-8c72-a70a4da1ef95" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:00 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:00 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Acquiring lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:00 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:00 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:00 user nova-compute[72418]: INFO nova.compute.manager [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Terminating instance
Aug 09 18:25:00 user nova-compute[72418]: DEBUG nova.compute.manager [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Start destroying the instance on the hypervisor. {{(pid=72418) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 18:25:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] COPY block job progress, current cursor: 314572800 final cursor: 1073741824 {{(pid=72418) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 18:25:00 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:00 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:00 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:00 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:00 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:01 user nova-compute[72418]: DEBUG os_brick.utils [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:25:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:01 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5d39f6-bb96-406a-a71e-7541190cbf66]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ad56b243ad71\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:01 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8de7cfd-eae1-44e0-956c-a72acbb0eb19]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:01 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[6246d118-f507-49ec-963f-4e9b17f76c3e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:01 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a2e49c-1d32-45c9-b76d-4912191994c8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Running cmd (subprocess): nvme version {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] 'nvme version' failed. Not Retrying. {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:25:01 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] nvme not present on system {{(pid=72418) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 18:25:01 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] COPY block job progress, current cursor: 478150656 final cursor: 1073741824 {{(pid=72418) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 18:25:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:25:01 user nova-compute[72418]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 18:25:01 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[9950c7cc-93f1-4993-820c-36f2f0958b5c]: (4, '') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:01 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72418) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 18:25:01 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 18:25:01 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] LIGHTOS: no hostnqn found. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 18:25:01 user nova-compute[72418]: DEBUG os_brick.utils [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] <== get_connector_properties: return (204ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ad56b243ad71', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:25:01 user nova-compute[72418]: DEBUG nova.virt.block_device [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Updating existing volume attachment record: 95659ef3-c2cd-499d-bbf4-c85323fd49ae {{(pid=72418) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 18:25:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:01 user nova-compute[72418]: DEBUG nova.compute.manager [req-ee7a9441-2830-4b35-9dc7-6364d9fc96fe req-83ce8b9f-5fc6-4e8a-b804-a3a3f0cb2f05 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received event network-vif-unplugged-f148ea7a-87e0-482f-bd2f-d3fcaa50fd4f {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:25:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-ee7a9441-2830-4b35-9dc7-6364d9fc96fe req-83ce8b9f-5fc6-4e8a-b804-a3a3f0cb2f05 service nova] Acquiring lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-ee7a9441-2830-4b35-9dc7-6364d9fc96fe req-83ce8b9f-5fc6-4e8a-b804-a3a3f0cb2f05 service nova] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-ee7a9441-2830-4b35-9dc7-6364d9fc96fe req-83ce8b9f-5fc6-4e8a-b804-a3a3f0cb2f05 service nova] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:01 user nova-compute[72418]: DEBUG nova.compute.manager [req-ee7a9441-2830-4b35-9dc7-6364d9fc96fe req-83ce8b9f-5fc6-4e8a-b804-a3a3f0cb2f05 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] No waiting events found dispatching network-vif-unplugged-f148ea7a-87e0-482f-bd2f-d3fcaa50fd4f {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:25:01 user nova-compute[72418]: DEBUG nova.compute.manager [req-ee7a9441-2830-4b35-9dc7-6364d9fc96fe req-83ce8b9f-5fc6-4e8a-b804-a3a3f0cb2f05 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received event network-vif-unplugged-f148ea7a-87e0-482f-bd2f-d3fcaa50fd4f for instance with task_state deleting. {{(pid=72418) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 18:25:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:01 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] COPY block job progress, current cursor: 657457152 final cursor: 1073741824 {{(pid=72418) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 18:25:01 user nova-compute[72418]: DEBUG nova.compute.manager [req-513ee363-0ef4-4b0e-a82c-8a6f397a5490 req-33e50890-93fd-40e4-a042-781e5ca540c0 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received event network-vif-unplugged-cb99cdec-40f2-4666-bc12-0c825431db5f {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:25:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-513ee363-0ef4-4b0e-a82c-8a6f397a5490 req-33e50890-93fd-40e4-a042-781e5ca540c0 service nova] Acquiring lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-513ee363-0ef4-4b0e-a82c-8a6f397a5490 req-33e50890-93fd-40e4-a042-781e5ca540c0 service nova] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.010s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-513ee363-0ef4-4b0e-a82c-8a6f397a5490 req-33e50890-93fd-40e4-a042-781e5ca540c0 service nova] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:01 user nova-compute[72418]: DEBUG nova.compute.manager [req-513ee363-0ef4-4b0e-a82c-8a6f397a5490 req-33e50890-93fd-40e4-a042-781e5ca540c0 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] No waiting events found dispatching network-vif-unplugged-cb99cdec-40f2-4666-bc12-0c825431db5f {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:25:01 user nova-compute[72418]: DEBUG nova.compute.manager [req-513ee363-0ef4-4b0e-a82c-8a6f397a5490 req-33e50890-93fd-40e4-a042-781e5ca540c0 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received event network-vif-unplugged-cb99cdec-40f2-4666-bc12-0c825431db5f for instance with task_state deleting. {{(pid=72418) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 18:25:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:02 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:02 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:02 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:02 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] COPY block job progress, current cursor: 783286272 final cursor: 1073741824 {{(pid=72418) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 18:25:02 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:02 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Instance destroyed successfully.
Aug 09 18:25:02 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:02 user nova-compute[72418]: DEBUG nova.objects.instance [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Lazy-loading 'resources' on Instance uuid 2b284735-40f6-403f-8c72-a70a4da1ef95 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:25:02 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:02 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T18:23:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-68181259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-68181259',id=10,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEje+5G8l0zUFPb9efwBnHt0ZCgCM3Tx0KnXOqSoP3aJ2QZUzCV1jaoIRZpidY8jgKBIJGhaAf4cFXsD98WOVIAvSJDOu2fqOlZNRQf70eApwdMsLd5pz1Ic1XdRFAlkw==',key_name='tempest-keypair-508730491',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:23:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='56236651c71b4e3f99128436cdf94710',ramdisk_id='',reservation_id='r-kuvfi2b9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-766454510',owner_user_name='tempest-TaggedBootDevicesTest-766454510-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:23:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ebed3edc7b9488bbfa6d11f8441773a',uuid=2b284735-40f6-403f-8c72-a70a4da1ef95,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f148ea7a-87e0-482f-bd2f-d3fcaa50fd4f", "address": "fa:16:3e:5c:b3:39", "network": {"id": "1b2af6fe-348e-4d75-9967-f6e70cb5e625", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1372910455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf148ea7a-87", "ovs_interfaceid": "f148ea7a-87e0-482f-bd2f-d3fcaa50fd4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 18:25:02 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Converting VIF {"id": "f148ea7a-87e0-482f-bd2f-d3fcaa50fd4f", "address": "fa:16:3e:5c:b3:39", "network": {"id": "1b2af6fe-348e-4d75-9967-f6e70cb5e625", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1372910455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf148ea7a-87", "ovs_interfaceid": "f148ea7a-87e0-482f-bd2f-d3fcaa50fd4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:25:02 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:b3:39,bridge_name='br-int',has_traffic_filtering=True,id=f148ea7a-87e0-482f-bd2f-d3fcaa50fd4f,network=Network(1b2af6fe-348e-4d75-9967-f6e70cb5e625),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf148ea7a-87') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:25:02 user nova-compute[72418]: DEBUG os_vif [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:b3:39,bridge_name='br-int',has_traffic_filtering=True,id=f148ea7a-87e0-482f-bd2f-d3fcaa50fd4f,network=Network(1b2af6fe-348e-4d75-9967-f6e70cb5e625),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf148ea7a-87') {{(pid=72418) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 18:25:02 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:02 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf148ea7a-87, bridge=br-int, if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:25:02 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:02 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:25:02 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] COPY block job progress, current cursor: 899678208 final cursor: 1073741824 {{(pid=72418) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 18:25:02 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:02 user nova-compute[72418]: INFO os_vif [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:b3:39,bridge_name='br-int',has_traffic_filtering=True,id=f148ea7a-87e0-482f-bd2f-d3fcaa50fd4f,network=Network(1b2af6fe-348e-4d75-9967-f6e70cb5e625),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf148ea7a-87')
Aug 09 18:25:02 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T18:23:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-68181259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-68181259',id=10,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEje+5G8l0zUFPb9efwBnHt0ZCgCM3Tx0KnXOqSoP3aJ2QZUzCV1jaoIRZpidY8jgKBIJGhaAf4cFXsD98WOVIAvSJDOu2fqOlZNRQf70eApwdMsLd5pz1Ic1XdRFAlkw==',key_name='tempest-keypair-508730491',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:23:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='56236651c71b4e3f99128436cdf94710',ramdisk_id='',reservation_id='r-kuvfi2b9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-766454510',owner_user_name='tempest-TaggedBootDevicesTest-766454510-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:23:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ebed3edc7b9488bbfa6d11f8441773a',uuid=2b284735-40f6-403f-8c72-a70a4da1ef95,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "92f457ac-3ac1-426a-ac45-854d9e2ca180", "address": "fa:16:3e:1e:50:a4", "network": {"id": "a4e74890-7ab4-4e52-8297-5c27f2cb6497", "bridge": "br-int", "label": "tempest-device-tagging-net1-428079376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f457ac-3a", "ovs_interfaceid": "92f457ac-3ac1-426a-ac45-854d9e2ca180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72418) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 18:25:02 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Converting VIF {"id": "92f457ac-3ac1-426a-ac45-854d9e2ca180", "address": "fa:16:3e:1e:50:a4", "network": {"id": "a4e74890-7ab4-4e52-8297-5c27f2cb6497", "bridge": "br-int", "label": "tempest-device-tagging-net1-428079376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f457ac-3a", "ovs_interfaceid": "92f457ac-3ac1-426a-ac45-854d9e2ca180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:25:02 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:50:a4,bridge_name='br-int',has_traffic_filtering=True,id=92f457ac-3ac1-426a-ac45-854d9e2ca180,network=Network(a4e74890-7ab4-4e52-8297-5c27f2cb6497),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap92f457ac-3a') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:25:02 user nova-compute[72418]: DEBUG os_vif [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:50:a4,bridge_name='br-int',has_traffic_filtering=True,id=92f457ac-3ac1-426a-ac45-854d9e2ca180,network=Network(a4e74890-7ab4-4e52-8297-5c27f2cb6497),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap92f457ac-3a') {{(pid=72418) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 18:25:02 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:02 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap92f457ac-3a, bridge=br-int, if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:25:02 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Creating instance directory {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 18:25:03 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Creating image(s)
Aug 09 18:25:03 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Did not create local disks {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Ensure instance console log exists: /opt/stack/data/nova/instances/d9d5d476-484e-49a3-a665-5a2069ea606e/console.log {{(pid=72418) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Start _get_guest_xml network_info=[{"id": "2472f1be-ea8f-46b6-a4f3-481f517c7edd", "address": "fa:16:3e:86:93:dc", "network": {"id": "eddf3956-c192-42b3-b928-5e9cf4f07f5f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1344000484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64ada6c609434916beb7b6a1d117a993", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2472f1be-ea", "ovs_interfaceid": "2472f1be-ea8f-46b6-a4f3-481f517c7edd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '56a7bde8-2ab6-4c72-bc13-8eae169f8864', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TUdEGbkO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd9d5d476-484e-49a3-a665-5a2069ea606e', 'attached_at': '', 'detached_at': '', 'volume_id': '63025fe7-5619-4f33-85cb-044aca432424', 'serial': '63025fe7-5619-4f33-85cb-044aca432424'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:03 user nova-compute[72418]: INFO os_vif [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:50:a4,bridge_name='br-int',has_traffic_filtering=True,id=92f457ac-3ac1-426a-ac45-854d9e2ca180,network=Network(a4e74890-7ab4-4e52-8297-5c27f2cb6497),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap92f457ac-3a')
Aug 09 18:25:03 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T18:23:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-68181259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-68181259',id=10,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEje+5G8l0zUFPb9efwBnHt0ZCgCM3Tx0KnXOqSoP3aJ2QZUzCV1jaoIRZpidY8jgKBIJGhaAf4cFXsD98WOVIAvSJDOu2fqOlZNRQf70eApwdMsLd5pz1Ic1XdRFAlkw==',key_name='tempest-keypair-508730491',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:23:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='56236651c71b4e3f99128436cdf94710',ramdisk_id='',reservation_id='r-kuvfi2b9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-766454510',owner_user_name='tempest-TaggedBootDevicesTest-766454510-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:23:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ebed3edc7b9488bbfa6d11f8441773a',uuid=2b284735-40f6-403f-8c72-a70a4da1ef95,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a0900115-d746-4910-aafd-a6da02efe287", "address": "fa:16:3e:fa:8a:82", "network": {"id": "a4e74890-7ab4-4e52-8297-5c27f2cb6497", "bridge": "br-int", "label": "tempest-device-tagging-net1-428079376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0900115-d7", "ovs_interfaceid": "a0900115-d746-4910-aafd-a6da02efe287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72418) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Converting VIF {"id": "a0900115-d746-4910-aafd-a6da02efe287", "address": "fa:16:3e:fa:8a:82", "network": {"id": "a4e74890-7ab4-4e52-8297-5c27f2cb6497", "bridge": "br-int", "label": "tempest-device-tagging-net1-428079376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0900115-d7", "ovs_interfaceid": "a0900115-d746-4910-aafd-a6da02efe287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:8a:82,bridge_name='br-int',has_traffic_filtering=True,id=a0900115-d746-4910-aafd-a6da02efe287,network=Network(a4e74890-7ab4-4e52-8297-5c27f2cb6497),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa0900115-d7') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG os_vif [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:8a:82,bridge_name='br-int',has_traffic_filtering=True,id=a0900115-d746-4910-aafd-a6da02efe287,network=Network(a4e74890-7ab4-4e52-8297-5c27f2cb6497),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa0900115-d7') {{(pid=72418) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 18:25:03 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 09 18:25:03 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 09 18:25:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa0900115-d7, bridge=br-int, if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] CPU controller missing on host. {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] CPU controller found on host. {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72418) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T18:17:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Flavor limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Image limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Flavor pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Image pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Got 1 possible topologies {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG nova.objects.instance [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Lazy-loading 'vcpu_model' on Instance uuid d9d5d476-484e-49a3-a665-5a2069ea606e {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:03 user nova-compute[72418]: INFO os_vif [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:8a:82,bridge_name='br-int',has_traffic_filtering=True,id=a0900115-d746-4910-aafd-a6da02efe287,network=Network(a4e74890-7ab4-4e52-8297-5c27f2cb6497),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa0900115-d7')
Aug 09 18:25:03 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T18:23:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-68181259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-68181259',id=10,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEje+5G8l0zUFPb9efwBnHt0ZCgCM3Tx0KnXOqSoP3aJ2QZUzCV1jaoIRZpidY8jgKBIJGhaAf4cFXsD98WOVIAvSJDOu2fqOlZNRQf70eApwdMsLd5pz1Ic1XdRFAlkw==',key_name='tempest-keypair-508730491',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:23:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='56236651c71b4e3f99128436cdf94710',ramdisk_id='',reservation_id='r-kuvfi2b9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-766454510',owner_user_name='tempest-TaggedBootDevicesTest-766454510-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:23:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ebed3edc7b9488bbfa6d11f8441773a',uuid=2b284735-40f6-403f-8c72-a70a4da1ef95,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb99cdec-40f2-4666-bc12-0c825431db5f", "address": "fa:16:3e:39:ba:42", "network": {"id": "a4e74890-7ab4-4e52-8297-5c27f2cb6497", "bridge": "br-int", "label": "tempest-device-tagging-net1-428079376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb99cdec-40", "ovs_interfaceid": "cb99cdec-40f2-4666-bc12-0c825431db5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Converting VIF {"id": "cb99cdec-40f2-4666-bc12-0c825431db5f", "address": "fa:16:3e:39:ba:42", "network": {"id": "a4e74890-7ab4-4e52-8297-5c27f2cb6497", "bridge": "br-int", "label": "tempest-device-tagging-net1-428079376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb99cdec-40", "ovs_interfaceid": "cb99cdec-40f2-4666-bc12-0c825431db5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:ba:42,bridge_name='br-int',has_traffic_filtering=True,id=cb99cdec-40f2-4666-bc12-0c825431db5f,network=Network(a4e74890-7ab4-4e52-8297-5c27f2cb6497),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb99cdec-40') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG os_vif [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:ba:42,bridge_name='br-int',has_traffic_filtering=True,id=cb99cdec-40f2-4666-bc12-0c825431db5f,network=Network(a4e74890-7ab4-4e52-8297-5c27f2cb6497),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb99cdec-40') {{(pid=72418) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Calling os-brick to attach iSCSI Volume {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TUdEGbkO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:25:03 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 18:25:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:25:03 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 18:25:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:25:03 user nova-compute[72418]: INFO os_brick.initiator.connectors.iscsi [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 18:25:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb99cdec-40, bridge=br-int, if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 -p 172.16.0.220:3260 {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[be87c1dc-2697-45f5-9cf6-f9ddc5628f97]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 18:25:03 user nova-compute[72418]:  {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 -p 172.16.0.220:3260 --interface default --op new {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:03 user nova-compute[72418]: INFO os_vif [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:ba:42,bridge_name='br-int',has_traffic_filtering=True,id=cb99cdec-40f2-4666-bc12-0c825431db5f,network=Network(a4e74890-7ab4-4e52-8297-5c27f2cb6497),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb99cdec-40')
Aug 09 18:25:03 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T18:23:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-68181259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-68181259',id=10,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEje+5G8l0zUFPb9efwBnHt0ZCgCM3Tx0KnXOqSoP3aJ2QZUzCV1jaoIRZpidY8jgKBIJGhaAf4cFXsD98WOVIAvSJDOu2fqOlZNRQf70eApwdMsLd5pz1Ic1XdRFAlkw==',key_name='tempest-keypair-508730491',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:23:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='56236651c71b4e3f99128436cdf94710',ramdisk_id='',reservation_id='r-kuvfi2b9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-766454510',owner_user_name='tempest-TaggedBootDevicesTest-766454510-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:23:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ebed3edc7b9488bbfa6d11f8441773a',uuid=2b284735-40f6-403f-8c72-a70a4da1ef95,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af01e732-21ed-4815-842e-90e7b3591398", "address": "fa:16:3e:ab:fe:ca", "network": {"id": "a4e74890-7ab4-4e52-8297-5c27f2cb6497", "bridge": "br-int", "label": "tempest-device-tagging-net1-428079376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf01e732-21", "ovs_interfaceid": "af01e732-21ed-4815-842e-90e7b3591398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Converting VIF {"id": "af01e732-21ed-4815-842e-90e7b3591398", "address": "fa:16:3e:ab:fe:ca", "network": {"id": "a4e74890-7ab4-4e52-8297-5c27f2cb6497", "bridge": "br-int", "label": "tempest-device-tagging-net1-428079376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf01e732-21", "ovs_interfaceid": "af01e732-21ed-4815-842e-90e7b3591398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:fe:ca,bridge_name='br-int',has_traffic_filtering=True,id=af01e732-21ed-4815-842e-90e7b3591398,network=Network(a4e74890-7ab4-4e52-8297-5c27f2cb6497),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf01e732-21') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG os_vif [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:fe:ca,bridge_name='br-int',has_traffic_filtering=True,id=af01e732-21ed-4815-842e-90e7b3591398,network=Network(a4e74890-7ab4-4e52-8297-5c27f2cb6497),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf01e732-21') {{(pid=72418) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf01e732-21, bridge=br-int, if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.033s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b059f48-bd24-4cfe-bb35-55c7dc934fbf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424] added\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424] added
Aug 09 18:25:03 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:03 user nova-compute[72418]: INFO os_vif [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:fe:ca,bridge_name='br-int',has_traffic_filtering=True,id=af01e732-21ed-4815-842e-90e7b3591398,network=Network(a4e74890-7ab4-4e52-8297-5c27f2cb6497),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf01e732-21')
Aug 09 18:25:03 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T18:23:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-68181259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-68181259',id=10,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEje+5G8l0zUFPb9efwBnHt0ZCgCM3Tx0KnXOqSoP3aJ2QZUzCV1jaoIRZpidY8jgKBIJGhaAf4cFXsD98WOVIAvSJDOu2fqOlZNRQf70eApwdMsLd5pz1Ic1XdRFAlkw==',key_name='tempest-keypair-508730491',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:23:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='56236651c71b4e3f99128436cdf94710',ramdisk_id='',reservation_id='r-kuvfi2b9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-766454510',owner_user_name='tempest-TaggedBootDevicesTest-766454510-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:23:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ebed3edc7b9488bbfa6d11f8441773a',uuid=2b284735-40f6-403f-8c72-a70a4da1ef95,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "692db581-bf1f-4295-a18d-65ab40120c7a", "address": "fa:16:3e:fb:c8:98", "network": {"id": "7f7c8970-9e06-4944-bfac-ac7ea2073cee", "bridge": "br-int", "label": "tempest-device-tagging-net2-2000981143", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap692db581-bf", "ovs_interfaceid": "692db581-bf1f-4295-a18d-65ab40120c7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Converting VIF {"id": "692db581-bf1f-4295-a18d-65ab40120c7a", "address": "fa:16:3e:fb:c8:98", "network": {"id": "7f7c8970-9e06-4944-bfac-ac7ea2073cee", "bridge": "br-int", "label": "tempest-device-tagging-net2-2000981143", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap692db581-bf", "ovs_interfaceid": "692db581-bf1f-4295-a18d-65ab40120c7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:c8:98,bridge_name='br-int',has_traffic_filtering=True,id=692db581-bf1f-4295-a18d-65ab40120c7a,network=Network(7f7c8970-9e06-4944-bfac-ac7ea2073cee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap692db581-bf') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG os_vif [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:c8:98,bridge_name='br-int',has_traffic_filtering=True,id=692db581-bf1f-4295-a18d-65ab40120c7a,network=Network(7f7c8970-9e06-4944-bfac-ac7ea2073cee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap692db581-bf') {{(pid=72418) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b1bfe5-14a4-495b-9ae3-e8b7498e4d05]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap692db581-bf, bridge=br-int, if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:03 user nova-compute[72418]: INFO os_vif [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:c8:98,bridge_name='br-int',has_traffic_filtering=True,id=692db581-bf1f-4295-a18d-65ab40120c7a,network=Network(7f7c8970-9e06-4944-bfac-ac7ea2073cee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap692db581-bf')
Aug 09 18:25:03 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T18:23:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-68181259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-68181259',id=10,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEje+5G8l0zUFPb9efwBnHt0ZCgCM3Tx0KnXOqSoP3aJ2QZUzCV1jaoIRZpidY8jgKBIJGhaAf4cFXsD98WOVIAvSJDOu2fqOlZNRQf70eApwdMsLd5pz1Ic1XdRFAlkw==',key_name='tempest-keypair-508730491',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:23:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='56236651c71b4e3f99128436cdf94710',ramdisk_id='',reservation_id='r-kuvfi2b9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-766454510',owner_user_name='tempest-TaggedBootDevicesTest-766454510-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:23:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ebed3edc7b9488bbfa6d11f8441773a',uuid=2b284735-40f6-403f-8c72-a70a4da1ef95,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "875b1fd5-6595-48dc-83b1-95ebeee70bb2", "address": "fa:16:3e:e1:90:74", "network": {"id": "7f7c8970-9e06-4944-bfac-ac7ea2073cee", "bridge": "br-int", "label": "tempest-device-tagging-net2-2000981143", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875b1fd5-65", "ovs_interfaceid": "875b1fd5-6595-48dc-83b1-95ebeee70bb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Converting VIF {"id": "875b1fd5-6595-48dc-83b1-95ebeee70bb2", "address": "fa:16:3e:e1:90:74", "network": {"id": "7f7c8970-9e06-4944-bfac-ac7ea2073cee", "bridge": "br-int", "label": "tempest-device-tagging-net2-2000981143", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875b1fd5-65", "ovs_interfaceid": "875b1fd5-6595-48dc-83b1-95ebeee70bb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:90:74,bridge_name='br-int',has_traffic_filtering=True,id=875b1fd5-6595-48dc-83b1-95ebeee70bb2,network=Network(7f7c8970-9e06-4944-bfac-ac7ea2073cee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap875b1fd5-65') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG os_vif [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:90:74,bridge_name='br-int',has_traffic_filtering=True,id=875b1fd5-6595-48dc-83b1-95ebeee70bb2,network=Network(7f7c8970-9e06-4944-bfac-ac7ea2073cee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap875b1fd5-65') {{(pid=72418) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[df34f064-e70b-4326-ab91-a3c07d6f2dff]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap875b1fd5-65, bridge=br-int, if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TUdEGbkO {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:25:03 user nova-compute[72418]: INFO os_vif [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:90:74,bridge_name='br-int',has_traffic_filtering=True,id=875b1fd5-6595-48dc-83b1-95ebeee70bb2,network=Network(7f7c8970-9e06-4944-bfac-ac7ea2073cee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap875b1fd5-65')
Aug 09 18:25:03 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] calling os-brick to detach iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, {'target_iqns': ['iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'akgYnryP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:25:03 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:25:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TUdEGbkO" returned: 0 in 0.032s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[070786bb-4b7a-43fb-b17e-21a570d25d71]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TUdEGbkO'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] COPY block job progress, current cursor: 1061158912 final cursor: 1073741824 {{(pid=72418) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[89881d36-1de6-4e9b-925f-c2d54b0b9930]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b72beae-778b-457c-afdd-ec0f8ea1d5ad]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa (non-flash)
Aug 09 18:25:03 user nova-compute[72418]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 (non-flash)
Aug 09 18:25:03 user nova-compute[72418]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)
Aug 09 18:25:03 user nova-compute[72418]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)
Aug 09 18:25:03 user nova-compute[72418]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)
Aug 09 18:25:03 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa (non-flash)
Aug 09 18:25:03 user nova-compute[72418]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 (non-flash)
Aug 09 18:25:03 user nova-compute[72418]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)
Aug 09 18:25:03 user nova-compute[72418]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)
Aug 09 18:25:03 user nova-compute[72418]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)
Aug 09 18:25:03 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 -p 172.16.0.220:3260 --login {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG nova.compute.manager [req-33e66c37-1af6-4231-aa31-6d2798401f69 req-35228a5a-0c88-472f-8252-24fa05713d31 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received event network-vif-plugged-f148ea7a-87e0-482f-bd2f-d3fcaa50fd4f {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-33e66c37-1af6-4231-aa31-6d2798401f69 req-35228a5a-0c88-472f-8252-24fa05713d31 service nova] Acquiring lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-33e66c37-1af6-4231-aa31-6d2798401f69 req-35228a5a-0c88-472f-8252-24fa05713d31 service nova] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-33e66c37-1af6-4231-aa31-6d2798401f69 req-35228a5a-0c88-472f-8252-24fa05713d31 service nova] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG nova.compute.manager [req-33e66c37-1af6-4231-aa31-6d2798401f69 req-35228a5a-0c88-472f-8252-24fa05713d31 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] No waiting events found dispatching network-vif-plugged-f148ea7a-87e0-482f-bd2f-d3fcaa50fd4f {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:25:03 user nova-compute[72418]: WARNING nova.compute.manager [req-33e66c37-1af6-4231-aa31-6d2798401f69 req-35228a5a-0c88-472f-8252-24fa05713d31 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received unexpected event network-vif-plugged-f148ea7a-87e0-482f-bd2f-d3fcaa50fd4f for instance with vm_state active and task_state deleting.
Aug 09 18:25:03 user nova-compute[72418]: DEBUG nova.compute.manager [req-33e66c37-1af6-4231-aa31-6d2798401f69 req-35228a5a-0c88-472f-8252-24fa05713d31 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received event network-vif-unplugged-92f457ac-3ac1-426a-ac45-854d9e2ca180 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-33e66c37-1af6-4231-aa31-6d2798401f69 req-35228a5a-0c88-472f-8252-24fa05713d31 service nova] Acquiring lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-33e66c37-1af6-4231-aa31-6d2798401f69 req-35228a5a-0c88-472f-8252-24fa05713d31 service nova] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-33e66c37-1af6-4231-aa31-6d2798401f69 req-35228a5a-0c88-472f-8252-24fa05713d31 service nova] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG nova.compute.manager [req-33e66c37-1af6-4231-aa31-6d2798401f69 req-35228a5a-0c88-472f-8252-24fa05713d31 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] No waiting events found dispatching network-vif-unplugged-92f457ac-3ac1-426a-ac45-854d9e2ca180 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG nova.compute.manager [req-33e66c37-1af6-4231-aa31-6d2798401f69 req-35228a5a-0c88-472f-8252-24fa05713d31 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received event network-vif-unplugged-92f457ac-3ac1-426a-ac45-854d9e2ca180 for instance with task_state deleting. {{(pid=72418) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG nova.compute.manager [req-33e66c37-1af6-4231-aa31-6d2798401f69 req-35228a5a-0c88-472f-8252-24fa05713d31 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received event network-vif-plugged-92f457ac-3ac1-426a-ac45-854d9e2ca180 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-33e66c37-1af6-4231-aa31-6d2798401f69 req-35228a5a-0c88-472f-8252-24fa05713d31 service nova] Acquiring lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-33e66c37-1af6-4231-aa31-6d2798401f69 req-35228a5a-0c88-472f-8252-24fa05713d31 service nova] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-33e66c37-1af6-4231-aa31-6d2798401f69 req-35228a5a-0c88-472f-8252-24fa05713d31 service nova] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG nova.compute.manager [req-33e66c37-1af6-4231-aa31-6d2798401f69 req-35228a5a-0c88-472f-8252-24fa05713d31 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] No waiting events found dispatching network-vif-plugged-92f457ac-3ac1-426a-ac45-854d9e2ca180 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:25:03 user nova-compute[72418]: WARNING nova.compute.manager [req-33e66c37-1af6-4231-aa31-6d2798401f69 req-35228a5a-0c88-472f-8252-24fa05713d31 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received unexpected event network-vif-plugged-92f457ac-3ac1-426a-ac45-854d9e2ca180 for instance with vm_state active and task_state deleting.
Aug 09 18:25:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 -p 172.16.0.220:3260 --login" returned: 0 in 0.097s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af7abb9-d352-4295-888a-73aca3473ab4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424, portal: 172.16.0.220,3260]
Aug 09 18:25:03 user nova-compute[72418]: Login to [iface: default, target: iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424, portal: 172.16.0.220,3260] successful.
Aug 09 18:25:03 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a05900-1753-4ec5-9f50-e31d05f6dcd8]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab5b463-eaac-4b0b-b16f-2f74cf9f7da6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa (non-flash)
Aug 09 18:25:03 user nova-compute[72418]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 (non-flash)
Aug 09 18:25:03 user nova-compute[72418]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:25:03 user nova-compute[72418]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)
Aug 09 18:25:03 user nova-compute[72418]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)
Aug 09 18:25:03 user nova-compute[72418]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)
Aug 09 18:25:03 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa (non-flash)
Aug 09 18:25:03 user nova-compute[72418]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 (non-flash)
Aug 09 18:25:03 user nova-compute[72418]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:25:03 user nova-compute[72418]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)
Aug 09 18:25:03 user nova-compute[72418]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)
Aug 09 18:25:03 user nova-compute[72418]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)
Aug 09 18:25:03 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.421s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Connected to 172.16.0.220:3260 {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] HCTL ('38', '-', '-', 0) found on session 13 with lun 0 {{(pid=72418) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72418) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.027s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[1576ad18-bba1-47c0-8309-97d22fa89c85]: (4, ('- - 0', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Searching for a device in session 13 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72418) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TUdEGbkO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 18:25:03 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72418) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 18:25:04 user nova-compute[72418]: DEBUG nova.compute.manager [req-2866e39f-2864-4443-8d5a-4bdd98792df3 req-c6d95bdd-3067-4b8b-bcd4-323f54de061b service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received event network-vif-plugged-cb99cdec-40f2-4666-bc12-0c825431db5f {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:25:04 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-2866e39f-2864-4443-8d5a-4bdd98792df3 req-c6d95bdd-3067-4b8b-bcd4-323f54de061b service nova] Acquiring lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:04 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-2866e39f-2864-4443-8d5a-4bdd98792df3 req-c6d95bdd-3067-4b8b-bcd4-323f54de061b service nova] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:04 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-2866e39f-2864-4443-8d5a-4bdd98792df3 req-c6d95bdd-3067-4b8b-bcd4-323f54de061b service nova] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:04 user nova-compute[72418]: DEBUG nova.compute.manager [req-2866e39f-2864-4443-8d5a-4bdd98792df3 req-c6d95bdd-3067-4b8b-bcd4-323f54de061b service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] No waiting events found dispatching network-vif-plugged-cb99cdec-40f2-4666-bc12-0c825431db5f {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:25:04 user nova-compute[72418]: WARNING nova.compute.manager [req-2866e39f-2864-4443-8d5a-4bdd98792df3 req-c6d95bdd-3067-4b8b-bcd4-323f54de061b service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received unexpected event network-vif-plugged-cb99cdec-40f2-4666-bc12-0c825431db5f for instance with vm_state active and task_state deleting.
Aug 09 18:25:04 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] calling os-brick to detach iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 18:25:04 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, {'target_iqns': ['iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jgxtbFOa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '1de0aad7-83ac-4b9b-ba88-3418baa6a1aa'}, None), 'kwargs': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:25:04 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:25:04 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:25:04 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.470s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:25:04 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] <== connect_volume: return (1473ms) {'type': 'block', 'scsi_wwn': '26438643834633063', 'path': '/dev/sdg'} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:25:04 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438643834633063', 'path': '/dev/sdg'} {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 18:25:04 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.282s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:25:04 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561', 0)] {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 18:25:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:04 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f2ac38-0c4b-4569-b676-258dde107249]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:04 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T18:22:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1508281415',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-575459132',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTlpxVeNhPxeJuW8zTxzwBKwT/CA/qFwbFSyGFFQ5WBC/z6rTuUG5Drvoef5DHSqpEg+qFNytmw3WteLGcKSZH4mMFqTcywv5Hy3vANpNfa+6Xl/MY5tiOWNwwb6BRwFw==',key_name='tempest-keypair-546529688',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:23:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='64ada6c609434916beb7b6a1d117a993',ramdisk_id='',reservation_id='r-fnsl4oak',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1647763299',owner_user_name='tempest-ServerActionsV293TestJSON-1647763299-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:24:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3a35ad1146840949d0f1cc4780efa2b',uuid=d9d5d476-484e-49a3-a665-5a2069ea606e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2472f1be-ea8f-46b6-a4f3-481f517c7edd", "address": "fa:16:3e:86:93:dc", "network": {"id": "eddf3956-c192-42b3-b928-5e9cf4f07f5f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1344000484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64ada6c609434916beb7b6a1d117a993", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2472f1be-ea", "ovs_interfaceid": "2472f1be-ea8f-46b6-a4f3-481f517c7edd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:25:04 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Converting VIF {"id": "2472f1be-ea8f-46b6-a4f3-481f517c7edd", "address": "fa:16:3e:86:93:dc", "network": {"id": "eddf3956-c192-42b3-b928-5e9cf4f07f5f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1344000484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64ada6c609434916beb7b6a1d117a993", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2472f1be-ea", "ovs_interfaceid": "2472f1be-ea8f-46b6-a4f3-481f517c7edd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:25:04 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:93:dc,bridge_name='br-int',has_traffic_filtering=True,id=2472f1be-ea8f-46b6-a4f3-481f517c7edd,network=Network(eddf3956-c192-42b3-b928-5e9cf4f07f5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2472f1be-ea') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:25:04 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] End _get_guest_xml xml=<domain type="kvm">
Aug 09 18:25:04 user nova-compute[72418]:   <uuid>d9d5d476-484e-49a3-a665-5a2069ea606e</uuid>
Aug 09 18:25:04 user nova-compute[72418]:   <name>instance-00000009</name>
Aug 09 18:25:04 user nova-compute[72418]:   <memory>524288</memory>
Aug 09 18:25:04 user nova-compute[72418]:   <vcpu>1</vcpu>
Aug 09 18:25:04 user nova-compute[72418]:   <metadata>
Aug 09 18:25:04 user nova-compute[72418]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:25:04 user nova-compute[72418]:       <nova:package version="0.0.0"/>
Aug 09 18:25:04 user nova-compute[72418]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1508281415</nova:name>
Aug 09 18:25:04 user nova-compute[72418]:       <nova:creationTime>2023-08-09 18:25:03</nova:creationTime>
Aug 09 18:25:04 user nova-compute[72418]:       <nova:flavor name="m1.tiny">
Aug 09 18:25:04 user nova-compute[72418]:         <nova:memory>512</nova:memory>
Aug 09 18:25:04 user nova-compute[72418]:         <nova:disk>1</nova:disk>
Aug 09 18:25:04 user nova-compute[72418]:         <nova:swap>0</nova:swap>
Aug 09 18:25:04 user nova-compute[72418]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:25:04 user nova-compute[72418]:         <nova:vcpus>1</nova:vcpus>
Aug 09 18:25:04 user nova-compute[72418]:       </nova:flavor>
Aug 09 18:25:04 user nova-compute[72418]:       <nova:owner>
Aug 09 18:25:04 user nova-compute[72418]:         <nova:user uuid="b3a35ad1146840949d0f1cc4780efa2b">tempest-ServerActionsV293TestJSON-1647763299-project-member</nova:user>
Aug 09 18:25:04 user nova-compute[72418]:         <nova:project uuid="64ada6c609434916beb7b6a1d117a993">tempest-ServerActionsV293TestJSON-1647763299</nova:project>
Aug 09 18:25:04 user nova-compute[72418]:       </nova:owner>
Aug 09 18:25:04 user nova-compute[72418]:       <nova:ports>
Aug 09 18:25:04 user nova-compute[72418]:         <nova:port uuid="2472f1be-ea8f-46b6-a4f3-481f517c7edd">
Aug 09 18:25:04 user nova-compute[72418]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 18:25:04 user nova-compute[72418]:         </nova:port>
Aug 09 18:25:04 user nova-compute[72418]:       </nova:ports>
Aug 09 18:25:04 user nova-compute[72418]:     </nova:instance>
Aug 09 18:25:04 user nova-compute[72418]:   </metadata>
Aug 09 18:25:04 user nova-compute[72418]:   <sysinfo type="smbios">
Aug 09 18:25:04 user nova-compute[72418]:     <system>
Aug 09 18:25:04 user nova-compute[72418]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 18:25:04 user nova-compute[72418]:       <entry name="product">OpenStack Nova</entry>
Aug 09 18:25:04 user nova-compute[72418]:       <entry name="version">0.0.0</entry>
Aug 09 18:25:04 user nova-compute[72418]:       <entry name="serial">d9d5d476-484e-49a3-a665-5a2069ea606e</entry>
Aug 09 18:25:04 user nova-compute[72418]:       <entry name="uuid">d9d5d476-484e-49a3-a665-5a2069ea606e</entry>
Aug 09 18:25:04 user nova-compute[72418]:       <entry name="family">Virtual Machine</entry>
Aug 09 18:25:04 user nova-compute[72418]:     </system>
Aug 09 18:25:04 user nova-compute[72418]:   </sysinfo>
Aug 09 18:25:04 user nova-compute[72418]:   <os>
Aug 09 18:25:04 user nova-compute[72418]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 18:25:04 user nova-compute[72418]:     <boot dev="hd"/>
Aug 09 18:25:04 user nova-compute[72418]:     <smbios mode="sysinfo"/>
Aug 09 18:25:04 user nova-compute[72418]:   </os>
Aug 09 18:25:04 user nova-compute[72418]:   <features>
Aug 09 18:25:04 user nova-compute[72418]:     <acpi/>
Aug 09 18:25:04 user nova-compute[72418]:     <apic/>
Aug 09 18:25:04 user nova-compute[72418]:     <vmcoreinfo/>
Aug 09 18:25:04 user nova-compute[72418]:   </features>
Aug 09 18:25:04 user nova-compute[72418]:   <clock offset="utc">
Aug 09 18:25:04 user nova-compute[72418]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 18:25:04 user nova-compute[72418]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 18:25:04 user nova-compute[72418]:     <timer name="hpet" present="no"/>
Aug 09 18:25:04 user nova-compute[72418]:   </clock>
Aug 09 18:25:04 user nova-compute[72418]:   <cpu mode="custom" match="exact">
Aug 09 18:25:04 user nova-compute[72418]:     <model>Nehalem</model>
Aug 09 18:25:04 user nova-compute[72418]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 18:25:04 user nova-compute[72418]:   </cpu>
Aug 09 18:25:04 user nova-compute[72418]:   <devices>
Aug 09 18:25:04 user nova-compute[72418]:     <disk type="block" device="disk">
Aug 09 18:25:04 user nova-compute[72418]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:25:04 user nova-compute[72418]:       <source dev="/dev/sdg"/>
Aug 09 18:25:04 user nova-compute[72418]:       <target dev="vda" bus="virtio"/>
Aug 09 18:25:04 user nova-compute[72418]:       <serial>63025fe7-5619-4f33-85cb-044aca432424</serial>
Aug 09 18:25:04 user nova-compute[72418]:     </disk>
Aug 09 18:25:04 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:25:04 user nova-compute[72418]:       <mac address="fa:16:3e:86:93:dc"/>
Aug 09 18:25:04 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:25:04 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:25:04 user nova-compute[72418]:       <target dev="tap2472f1be-ea"/>
Aug 09 18:25:04 user nova-compute[72418]:     </interface>
Aug 09 18:25:04 user nova-compute[72418]:     <serial type="pty">
Aug 09 18:25:04 user nova-compute[72418]:       <log file="/opt/stack/data/nova/instances/d9d5d476-484e-49a3-a665-5a2069ea606e/console.log" append="off"/>
Aug 09 18:25:04 user nova-compute[72418]:     </serial>
Aug 09 18:25:04 user nova-compute[72418]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 18:25:04 user nova-compute[72418]:     <video>
Aug 09 18:25:04 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:25:04 user nova-compute[72418]:     </video>
Aug 09 18:25:04 user nova-compute[72418]:     <rng model="virtio">
Aug 09 18:25:04 user nova-compute[72418]:       <backend model="random">/dev/urandom</backend>
Aug 09 18:25:04 user nova-compute[72418]:     </rng>
Aug 09 18:25:04 user nova-compute[72418]:     <controller type="usb" index="0" model="none"/>
Aug 09 18:25:04 user nova-compute[72418]:     <memballoon model="virtio">
Aug 09 18:25:04 user nova-compute[72418]:       <stats period="10"/>
Aug 09 18:25:04 user nova-compute[72418]:     </memballoon>
Aug 09 18:25:04 user nova-compute[72418]:   </devices>
Aug 09 18:25:04 user nova-compute[72418]: </domain>
Aug 09 18:25:04 user nova-compute[72418]:  {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 18:25:04 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T18:22:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1508281415',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-575459132',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTlpxVeNhPxeJuW8zTxzwBKwT/CA/qFwbFSyGFFQ5WBC/z6rTuUG5Drvoef5DHSqpEg+qFNytmw3WteLGcKSZH4mMFqTcywv5Hy3vANpNfa+6Xl/MY5tiOWNwwb6BRwFw==',key_name='tempest-keypair-546529688',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:23:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='64ada6c609434916beb7b6a1d117a993',ramdisk_id='',reservation_id='r-fnsl4oak',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1647763299',owner_user_name='tempest-ServerActionsV293TestJSON-1647763299-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:24:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3a35ad1146840949d0f1cc4780efa2b',uuid=d9d5d476-484e-49a3-a665-5a2069ea606e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2472f1be-ea8f-46b6-a4f3-481f517c7edd", "address": "fa:16:3e:86:93:dc", "network": {"id": "eddf3956-c192-42b3-b928-5e9cf4f07f5f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1344000484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64ada6c609434916beb7b6a1d117a993", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2472f1be-ea", "ovs_interfaceid": "2472f1be-ea8f-46b6-a4f3-481f517c7edd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:25:04 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Converting VIF {"id": "2472f1be-ea8f-46b6-a4f3-481f517c7edd", "address": "fa:16:3e:86:93:dc", "network": {"id": "eddf3956-c192-42b3-b928-5e9cf4f07f5f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1344000484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64ada6c609434916beb7b6a1d117a993", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2472f1be-ea", "ovs_interfaceid": "2472f1be-ea8f-46b6-a4f3-481f517c7edd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:25:04 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:93:dc,bridge_name='br-int',has_traffic_filtering=True,id=2472f1be-ea8f-46b6-a4f3-481f517c7edd,network=Network(eddf3956-c192-42b3-b928-5e9cf4f07f5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2472f1be-ea') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:25:04 user nova-compute[72418]: DEBUG os_vif [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:93:dc,bridge_name='br-int',has_traffic_filtering=True,id=2472f1be-ea8f-46b6-a4f3-481f517c7edd,network=Network(eddf3956-c192-42b3-b928-5e9cf4f07f5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2472f1be-ea') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:25:04 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:04 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:25:04 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:25:04 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:04 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2472f1be-ea, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:25:04 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2472f1be-ea, col_values=(('external_ids', {'iface-id': '2472f1be-ea8f-46b6-a4f3-481f517c7edd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:93:dc', 'vm-uuid': 'd9d5d476-484e-49a3-a665-5a2069ea606e'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:25:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:04 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7d2b4b-d5d2-4064-8a9d-fa6c29233ac2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:04 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa (non-flash)
Aug 09 18:25:04 user nova-compute[72418]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 (non-flash)
Aug 09 18:25:04 user nova-compute[72418]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:25:04 user nova-compute[72418]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)
Aug 09 18:25:04 user nova-compute[72418]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)
Aug 09 18:25:04 user nova-compute[72418]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)
Aug 09 18:25:04 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:25:04 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa (non-flash)
Aug 09 18:25:04 user nova-compute[72418]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 (non-flash)
Aug 09 18:25:04 user nova-compute[72418]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:25:04 user nova-compute[72418]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 (non-flash)
Aug 09 18:25:04 user nova-compute[72418]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)
Aug 09 18:25:04 user nova-compute[72418]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)
Aug 09 18:25:04 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:25:04 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f42f84204c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561'): ({'sdc'}, set())}) {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 18:25:04 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Removing single pathed devices sdc {{(pid=72418) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 18:25:04 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:04 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:25:04 user nova-compute[72418]: INFO os_vif [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:93:dc,bridge_name='br-int',has_traffic_filtering=True,id=2472f1be-ea8f-46b6-a4f3-481f517c7edd,network=Network(eddf3956-c192-42b3-b928-5e9cf4f07f5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2472f1be-ea')
Aug 09 18:25:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:04 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[65651d21-9217-42a2-8619-14f3a6b6feed]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:04 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[082bb7cd-2742-4943-a730-a721f8fc8100]: (4, ('ok\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:04 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Flushing IO for device /dev/sdc {{(pid=72418) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 18:25:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:04 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[300ccc85-941a-43e6-be3e-2139dd4057ea]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:04 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72418) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 18:25:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:04 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:25:04 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] No VIF found with MAC fa:16:3e:86:93:dc, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:25:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.055s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:04 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae701a3-9776-44f1-9645-117913fa835d]: (4, ('1', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:04 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 18:25:04 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] SCSI volumes sdc have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 18:25:04 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561')] {{(pid=72418) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 18:25:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b3677a-6e96-41ef-b5b7-85f98db82e11]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 -p 172.16.0.220:3260 --logout {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ecd319-e632-4f3f-9347-33d5a65d3fad]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561, portal: 172.16.0.220,3260]
Aug 09 18:25:05 user nova-compute[72418]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561, portal: 172.16.0.220,3260] successful.
Aug 09 18:25:05 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 -p 172.16.0.220:3260 --op delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e1058f2-9030-499b-bb70-208cb531c561 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc88befd-f889-4116-a6e0-5652b7590606]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.436s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] <== disconnect_volume: return (1718ms) None {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Disconnected iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.043s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa', 0)] {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] calling os-brick to detach iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, {'target_iqns': ['iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sgtVQXOc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:25:05 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:25:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1f301c-87f5-4a87-92b6-cddb6ac2ff6c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c73a44-c303-420c-9634-ddfa463cc155]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa (non-flash)
Aug 09 18:25:05 user nova-compute[72418]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 (non-flash)
Aug 09 18:25:05 user nova-compute[72418]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:25:05 user nova-compute[72418]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)
Aug 09 18:25:05 user nova-compute[72418]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)
Aug 09 18:25:05 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa (non-flash)
Aug 09 18:25:05 user nova-compute[72418]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 (non-flash)
Aug 09 18:25:05 user nova-compute[72418]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:25:05 user nova-compute[72418]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)
Aug 09 18:25:05 user nova-compute[72418]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)
Aug 09 18:25:05 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f42f84231c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa'): ({'sdb'}, set())}) {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Removing single pathed devices sdb {{(pid=72418) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f37651-8462-4a0d-b6de-6221aa6ba0da]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d8a15b-3909-4632-acc0-30aa733b655c]: (4, ('ok\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Flushing IO for device /dev/sdb {{(pid=72418) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[285e39c9-cd80-46dd-a790-26733689064e]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72418) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[363a11a8-a76d-4b1e-9652-f90926cd2b6f]: (4, ('1', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] SCSI volumes sdb have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa')] {{(pid=72418) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda80d3e-4c9b-4529-ba1b-c4007ad2ae2d]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa -p 172.16.0.220:3260 --logout {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41a7699-7542-485c-befd-1f51d571c97d]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa, portal: 172.16.0.220,3260]
Aug 09 18:25:05 user nova-compute[72418]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa, portal: 172.16.0.220,3260] successful.
Aug 09 18:25:05 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa -p 172.16.0.220:3260 --op delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1de0aad7-83ac-4b9b-ba88-3418baa6a1aa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6fa1e6-dcb9-4d56-8ae4-b968b48f8733]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] <== disconnect_volume: return (1350ms) None {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Disconnected iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.307s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a', 0)] {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4df4d0-05f1-4afe-be00-987e402fa25a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf147fa-1cb3-4f5e-98af-8b720a3466c6]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 (non-flash)
Aug 09 18:25:05 user nova-compute[72418]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:25:05 user nova-compute[72418]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)
Aug 09 18:25:05 user nova-compute[72418]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)
Aug 09 18:25:05 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 (non-flash)
Aug 09 18:25:05 user nova-compute[72418]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:25:05 user nova-compute[72418]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a (non-flash)
Aug 09 18:25:05 user nova-compute[72418]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)
Aug 09 18:25:05 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f42f874dc60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a'): ({'sdd'}, set())}) {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Removing single pathed devices sdd {{(pid=72418) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG nova.compute.manager [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXyMalNF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'dabfdb24-fc0b-4a00-a229-1ece48e27d18', 'attached_at': '', 'detached_at': '', 'volume_id': '1d982f88-39fb-45e9-a6c9-4a4379a52ea3', 'serial'} {{(pid=72418) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG nova.compute.manager [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] swap_volume: removing Cinder connection for volume 1de0aad7-83ac-4b9b-ba88-3418baa6a1aa {{(pid=72418) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[957331b4-4aac-433b-8f34-5349dd5832a7]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2692083-9826-4cdf-a4d0-b8ddc3093096]: (4, ('ok\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Flushing IO for device /dev/sdd {{(pid=72418) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[65852cef-c798-4fac-9179-b6448d03566a]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72418) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58ed207-1162-4e5f-9984-0c4e929358b1]: (4, ('1', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] SCSI volumes sdd have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a')] {{(pid=72418) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG nova.compute.manager [req-e7c30825-313e-448b-9543-4db2fcae33e4 req-83443cb6-575a-45ec-aedb-d1f4842aac0e service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received event network-vif-unplugged-a0900115-d746-4910-aafd-a6da02efe287 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-e7c30825-313e-448b-9543-4db2fcae33e4 req-83443cb6-575a-45ec-aedb-d1f4842aac0e service nova] Acquiring lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-e7c30825-313e-448b-9543-4db2fcae33e4 req-83443cb6-575a-45ec-aedb-d1f4842aac0e service nova] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-e7c30825-313e-448b-9543-4db2fcae33e4 req-83443cb6-575a-45ec-aedb-d1f4842aac0e service nova] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG nova.compute.manager [req-e7c30825-313e-448b-9543-4db2fcae33e4 req-83443cb6-575a-45ec-aedb-d1f4842aac0e service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] No waiting events found dispatching network-vif-unplugged-a0900115-d746-4910-aafd-a6da02efe287 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG nova.compute.manager [req-e7c30825-313e-448b-9543-4db2fcae33e4 req-83443cb6-575a-45ec-aedb-d1f4842aac0e service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received event network-vif-unplugged-a0900115-d746-4910-aafd-a6da02efe287 for instance with task_state deleting. {{(pid=72418) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG nova.compute.manager [req-e7c30825-313e-448b-9543-4db2fcae33e4 req-83443cb6-575a-45ec-aedb-d1f4842aac0e service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received event network-vif-plugged-a0900115-d746-4910-aafd-a6da02efe287 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-e7c30825-313e-448b-9543-4db2fcae33e4 req-83443cb6-575a-45ec-aedb-d1f4842aac0e service nova] Acquiring lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-e7c30825-313e-448b-9543-4db2fcae33e4 req-83443cb6-575a-45ec-aedb-d1f4842aac0e service nova] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-e7c30825-313e-448b-9543-4db2fcae33e4 req-83443cb6-575a-45ec-aedb-d1f4842aac0e service nova] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG nova.compute.manager [req-e7c30825-313e-448b-9543-4db2fcae33e4 req-83443cb6-575a-45ec-aedb-d1f4842aac0e service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] No waiting events found dispatching network-vif-plugged-a0900115-d746-4910-aafd-a6da02efe287 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:25:05 user nova-compute[72418]: WARNING nova.compute.manager [req-e7c30825-313e-448b-9543-4db2fcae33e4 req-83443cb6-575a-45ec-aedb-d1f4842aac0e service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received unexpected event network-vif-plugged-a0900115-d746-4910-aafd-a6da02efe287 for instance with vm_state active and task_state deleting.
Aug 09 18:25:05 user nova-compute[72418]: DEBUG nova.compute.manager [req-e7c30825-313e-448b-9543-4db2fcae33e4 req-83443cb6-575a-45ec-aedb-d1f4842aac0e service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received event network-vif-unplugged-af01e732-21ed-4815-842e-90e7b3591398 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-e7c30825-313e-448b-9543-4db2fcae33e4 req-83443cb6-575a-45ec-aedb-d1f4842aac0e service nova] Acquiring lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-e7c30825-313e-448b-9543-4db2fcae33e4 req-83443cb6-575a-45ec-aedb-d1f4842aac0e service nova] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-e7c30825-313e-448b-9543-4db2fcae33e4 req-83443cb6-575a-45ec-aedb-d1f4842aac0e service nova] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG nova.compute.manager [req-e7c30825-313e-448b-9543-4db2fcae33e4 req-83443cb6-575a-45ec-aedb-d1f4842aac0e service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] No waiting events found dispatching network-vif-unplugged-af01e732-21ed-4815-842e-90e7b3591398 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG nova.compute.manager [req-e7c30825-313e-448b-9543-4db2fcae33e4 req-83443cb6-575a-45ec-aedb-d1f4842aac0e service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received event network-vif-unplugged-af01e732-21ed-4815-842e-90e7b3591398 for instance with task_state deleting. {{(pid=72418) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG nova.compute.manager [req-e7c30825-313e-448b-9543-4db2fcae33e4 req-83443cb6-575a-45ec-aedb-d1f4842aac0e service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received event network-vif-plugged-af01e732-21ed-4815-842e-90e7b3591398 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-e7c30825-313e-448b-9543-4db2fcae33e4 req-83443cb6-575a-45ec-aedb-d1f4842aac0e service nova] Acquiring lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-e7c30825-313e-448b-9543-4db2fcae33e4 req-83443cb6-575a-45ec-aedb-d1f4842aac0e service nova] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-e7c30825-313e-448b-9543-4db2fcae33e4 req-83443cb6-575a-45ec-aedb-d1f4842aac0e service nova] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG nova.compute.manager [req-e7c30825-313e-448b-9543-4db2fcae33e4 req-83443cb6-575a-45ec-aedb-d1f4842aac0e service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] No waiting events found dispatching network-vif-plugged-af01e732-21ed-4815-842e-90e7b3591398 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:25:05 user nova-compute[72418]: WARNING nova.compute.manager [req-e7c30825-313e-448b-9543-4db2fcae33e4 req-83443cb6-575a-45ec-aedb-d1f4842aac0e service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received unexpected event network-vif-plugged-af01e732-21ed-4815-842e-90e7b3591398 for instance with vm_state active and task_state deleting.
Aug 09 18:25:05 user nova-compute[72418]: DEBUG nova.compute.manager [req-e7c30825-313e-448b-9543-4db2fcae33e4 req-83443cb6-575a-45ec-aedb-d1f4842aac0e service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received event network-vif-unplugged-692db581-bf1f-4295-a18d-65ab40120c7a {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-e7c30825-313e-448b-9543-4db2fcae33e4 req-83443cb6-575a-45ec-aedb-d1f4842aac0e service nova] Acquiring lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-e7c30825-313e-448b-9543-4db2fcae33e4 req-83443cb6-575a-45ec-aedb-d1f4842aac0e service nova] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-e7c30825-313e-448b-9543-4db2fcae33e4 req-83443cb6-575a-45ec-aedb-d1f4842aac0e service nova] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG nova.compute.manager [req-e7c30825-313e-448b-9543-4db2fcae33e4 req-83443cb6-575a-45ec-aedb-d1f4842aac0e service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] No waiting events found dispatching network-vif-unplugged-692db581-bf1f-4295-a18d-65ab40120c7a {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG nova.compute.manager [req-e7c30825-313e-448b-9543-4db2fcae33e4 req-83443cb6-575a-45ec-aedb-d1f4842aac0e service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received event network-vif-unplugged-692db581-bf1f-4295-a18d-65ab40120c7a for instance with task_state deleting. {{(pid=72418) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG nova.compute.manager [req-e7c30825-313e-448b-9543-4db2fcae33e4 req-83443cb6-575a-45ec-aedb-d1f4842aac0e service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received event network-vif-plugged-692db581-bf1f-4295-a18d-65ab40120c7a {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-e7c30825-313e-448b-9543-4db2fcae33e4 req-83443cb6-575a-45ec-aedb-d1f4842aac0e service nova] Acquiring lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-e7c30825-313e-448b-9543-4db2fcae33e4 req-83443cb6-575a-45ec-aedb-d1f4842aac0e service nova] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-e7c30825-313e-448b-9543-4db2fcae33e4 req-83443cb6-575a-45ec-aedb-d1f4842aac0e service nova] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG nova.compute.manager [req-e7c30825-313e-448b-9543-4db2fcae33e4 req-83443cb6-575a-45ec-aedb-d1f4842aac0e service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] No waiting events found dispatching network-vif-plugged-692db581-bf1f-4295-a18d-65ab40120c7a {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:25:05 user nova-compute[72418]: WARNING nova.compute.manager [req-e7c30825-313e-448b-9543-4db2fcae33e4 req-83443cb6-575a-45ec-aedb-d1f4842aac0e service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received unexpected event network-vif-plugged-692db581-bf1f-4295-a18d-65ab40120c7a for instance with vm_state active and task_state deleting.
Aug 09 18:25:05 user nova-compute[72418]: DEBUG nova.compute.manager [req-e7c30825-313e-448b-9543-4db2fcae33e4 req-83443cb6-575a-45ec-aedb-d1f4842aac0e service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received event network-vif-unplugged-875b1fd5-6595-48dc-83b1-95ebeee70bb2 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-e7c30825-313e-448b-9543-4db2fcae33e4 req-83443cb6-575a-45ec-aedb-d1f4842aac0e service nova] Acquiring lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-e7c30825-313e-448b-9543-4db2fcae33e4 req-83443cb6-575a-45ec-aedb-d1f4842aac0e service nova] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-e7c30825-313e-448b-9543-4db2fcae33e4 req-83443cb6-575a-45ec-aedb-d1f4842aac0e service nova] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG nova.compute.manager [req-e7c30825-313e-448b-9543-4db2fcae33e4 req-83443cb6-575a-45ec-aedb-d1f4842aac0e service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] No waiting events found dispatching network-vif-unplugged-875b1fd5-6595-48dc-83b1-95ebeee70bb2 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG nova.compute.manager [req-e7c30825-313e-448b-9543-4db2fcae33e4 req-83443cb6-575a-45ec-aedb-d1f4842aac0e service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received event network-vif-unplugged-875b1fd5-6595-48dc-83b1-95ebeee70bb2 for instance with task_state deleting. {{(pid=72418) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG nova.compute.manager [req-e7c30825-313e-448b-9543-4db2fcae33e4 req-83443cb6-575a-45ec-aedb-d1f4842aac0e service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received event network-vif-plugged-875b1fd5-6595-48dc-83b1-95ebeee70bb2 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-e7c30825-313e-448b-9543-4db2fcae33e4 req-83443cb6-575a-45ec-aedb-d1f4842aac0e service nova] Acquiring lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-e7c30825-313e-448b-9543-4db2fcae33e4 req-83443cb6-575a-45ec-aedb-d1f4842aac0e service nova] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-e7c30825-313e-448b-9543-4db2fcae33e4 req-83443cb6-575a-45ec-aedb-d1f4842aac0e service nova] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG nova.compute.manager [req-e7c30825-313e-448b-9543-4db2fcae33e4 req-83443cb6-575a-45ec-aedb-d1f4842aac0e service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] No waiting events found dispatching network-vif-plugged-875b1fd5-6595-48dc-83b1-95ebeee70bb2 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:25:05 user nova-compute[72418]: WARNING nova.compute.manager [req-e7c30825-313e-448b-9543-4db2fcae33e4 req-83443cb6-575a-45ec-aedb-d1f4842aac0e service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received unexpected event network-vif-plugged-875b1fd5-6595-48dc-83b1-95ebeee70bb2 for instance with vm_state active and task_state deleting.
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a817851-c285-42d4-8fc6-30eeedfa9cb0]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a -p 172.16.0.220:3260 --logout {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4cb6654-0010-4f2e-950a-f90342120720]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a, portal: 172.16.0.220,3260]
Aug 09 18:25:05 user nova-compute[72418]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a, portal: 172.16.0.220,3260] successful.
Aug 09 18:25:05 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a -p 172.16.0.220:3260 --op delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:112f7914-2b2f-49cc-9390-76303f64928a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f499dc-c6f3-4e53-a380-1a6513685705]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] <== disconnect_volume: return (640ms) None {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Disconnected iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] calling os-brick to detach iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, {'target_iqns': ['iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RxFCqfYU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:25:05 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:25:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff', 0)] {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[2219f846-120a-4b6e-86b5-b9b005c4c0e3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e01c12-d5b8-4fe3-8867-f430b24e014e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 (non-flash)
Aug 09 18:25:05 user nova-compute[72418]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:25:05 user nova-compute[72418]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)
Aug 09 18:25:05 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 (non-flash)
Aug 09 18:25:05 user nova-compute[72418]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:25:05 user nova-compute[72418]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff (non-flash)
Aug 09 18:25:05 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f42f811ae60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff'): ({'sde'}, set())}) {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Removing single pathed devices sde {{(pid=72418) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[f913786a-0d64-4878-b0c7-f292b580c0e1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b0dd16-dc1d-4f71-83d6-bce30df10e0e]: (4, ('ok\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Flushing IO for device /dev/sde {{(pid=72418) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[553ac53f-b888-4909-ac57-d4cb9c3f8307]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72418) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[032c6e95-e4db-451b-8510-0a0843f3d659]: (4, ('1', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] SCSI volumes sde have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff')] {{(pid=72418) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[48491bf1-27ec-42e2-84e5-5591f3f2e272]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:25:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff -p 172.16.0.220:3260 --logout {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:06 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[519381d3-591c-49fa-8e91-5e5480bfc6b0]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:06 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff, portal: 172.16.0.220,3260]
Aug 09 18:25:06 user nova-compute[72418]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff, portal: 172.16.0.220,3260] successful.
Aug 09 18:25:06 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:25:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff -p 172.16.0.220:3260 --op delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac8573d2-6da6-4c83-b6ab-72de440eefff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:06 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72a904c-ed20-46d5-929e-5ac91e4f1e7a]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:06 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:25:06 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:25:06 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] <== disconnect_volume: return (302ms) None {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:25:06 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Disconnected iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 18:25:06 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Deleting instance files /opt/stack/data/nova/instances/2b284735-40f6-403f-8c72-a70a4da1ef95_del
Aug 09 18:25:06 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Deletion of /opt/stack/data/nova/instances/2b284735-40f6-403f-8c72-a70a4da1ef95_del complete
Aug 09 18:25:06 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:06 user nova-compute[72418]: INFO nova.compute.manager [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Took 5.53 seconds to destroy the instance on the hypervisor.
Aug 09 18:25:06 user nova-compute[72418]: DEBUG oslo.service.loopingcall [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72418) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 18:25:06 user nova-compute[72418]: DEBUG nova.compute.manager [-] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Deallocating network for instance {{(pid=72418) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 18:25:06 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] deallocate_for_instance() {{(pid=72418) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 18:25:06 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:06 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:06 user nova-compute[72418]: DEBUG nova.compute.manager [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] swap_volume: Updating volume 1de0aad7-83ac-4b9b-ba88-3418baa6a1aa BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "EXyMalNF", "auth_password": "z2s4UpmMqkftDO", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "1d982f88-39fb-45e9-a6c9-4a4379a52ea3"}, "status": "reserved", "instance": "dabfdb24-fc0b-4a00-a229-1ece48e27d18", "attached_at": "", "detached_at": "", "volume_id": "1d982f88-39fb-45e9-a6c9-4a4379a52ea3", "serial": "1d982f88-39fb-45e9-a6c9-4a4379a52ea3"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '1d982f88-39fb-45e9-a6c9-4a4379a52ea3', 'no_device': None, 'attachment_id': '515db82d-4c4a-4be9-93f3-9d75c6ee61df'} {{(pid=72418) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 09 18:25:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-77381648-e9a1-4f76-b438-40b942895c17 tempest-TestVolumeSwap-479435051 tempest-TestVolumeSwap-479435051-project-admin] Lock "dabfdb24-fc0b-4a00-a229-1ece48e27d18" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 18.363s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:06 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:06 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:06 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-e60121fd-5ad1-4919-a4aa-570035ec77a2 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Acquiring lock "dabfdb24-fc0b-4a00-a229-1ece48e27d18" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-e60121fd-5ad1-4919-a4aa-570035ec77a2 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Lock "dabfdb24-fc0b-4a00-a229-1ece48e27d18" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:06 user nova-compute[72418]: INFO nova.compute.manager [None req-e60121fd-5ad1-4919-a4aa-570035ec77a2 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Detaching volume 1d982f88-39fb-45e9-a6c9-4a4379a52ea3
Aug 09 18:25:07 user nova-compute[72418]: INFO nova.virt.block_device [None req-e60121fd-5ad1-4919-a4aa-570035ec77a2 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Attempting to driver detach volume 1d982f88-39fb-45e9-a6c9-4a4379a52ea3 from mountpoint /dev/vdb
Aug 09 18:25:07 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-e60121fd-5ad1-4919-a4aa-570035ec77a2 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Attempting to detach device vdb from instance dabfdb24-fc0b-4a00-a229-1ece48e27d18 from the persistent domain config. {{(pid=72418) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-e60121fd-5ad1-4919-a4aa-570035ec77a2 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 18:25:07 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:25:07 user nova-compute[72418]:   <source dev="/dev/sdf"/>
Aug 09 18:25:07 user nova-compute[72418]:   <target dev="vdb" bus="virtio"/>
Aug 09 18:25:07 user nova-compute[72418]:   <serial>1d982f88-39fb-45e9-a6c9-4a4379a52ea3</serial>
Aug 09 18:25:07 user nova-compute[72418]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 18:25:07 user nova-compute[72418]: </disk>
Aug 09 18:25:07 user nova-compute[72418]:  {{(pid=72418) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 18:25:07 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-e60121fd-5ad1-4919-a4aa-570035ec77a2 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Successfully detached device vdb from instance dabfdb24-fc0b-4a00-a229-1ece48e27d18 from the persistent domain config.
Aug 09 18:25:07 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-e60121fd-5ad1-4919-a4aa-570035ec77a2 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dabfdb24-fc0b-4a00-a229-1ece48e27d18 from the live domain config. {{(pid=72418) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-e60121fd-5ad1-4919-a4aa-570035ec77a2 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 18:25:07 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:25:07 user nova-compute[72418]:   <source dev="/dev/sdf"/>
Aug 09 18:25:07 user nova-compute[72418]:   <target dev="vdb" bus="virtio"/>
Aug 09 18:25:07 user nova-compute[72418]:   <serial>1d982f88-39fb-45e9-a6c9-4a4379a52ea3</serial>
Aug 09 18:25:07 user nova-compute[72418]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 18:25:07 user nova-compute[72418]: </disk>
Aug 09 18:25:07 user nova-compute[72418]:  {{(pid=72418) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Received event <DeviceRemovedEvent: 1691605507.5039709, dabfdb24-fc0b-4a00-a229-1ece48e27d18 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72418) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-e60121fd-5ad1-4919-a4aa-570035ec77a2 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dabfdb24-fc0b-4a00-a229-1ece48e27d18 {{(pid=72418) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 18:25:07 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-e60121fd-5ad1-4919-a4aa-570035ec77a2 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Successfully detached device vdb from instance dabfdb24-fc0b-4a00-a229-1ece48e27d18 from the live domain config.
Aug 09 18:25:07 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e60121fd-5ad1-4919-a4aa-570035ec77a2 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] calling os-brick to detach iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60121fd-5ad1-4919-a4aa-570035ec77a2 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, {'target_iqns': ['iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXyMalNF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '1d982f88-39fb-45e9-a6c9-4a4379a52ea3'}, None), 'kwargs': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:25:07 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-e60121fd-5ad1-4919-a4aa-570035ec77a2 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:25:07 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-e60121fd-5ad1-4919-a4aa-570035ec77a2 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-e60121fd-5ad1-4919-a4aa-570035ec77a2 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60121fd-5ad1-4919-a4aa-570035ec77a2 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3', 0)] {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae079863-df20-4546-9a8d-8b506a8823e6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8afdb0-a944-449c-bcc9-f73138bbdc29]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60121fd-5ad1-4919-a4aa-570035ec77a2 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 (non-flash)
Aug 09 18:25:07 user nova-compute[72418]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:25:07 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60121fd-5ad1-4919-a4aa-570035ec77a2 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 (non-flash)
Aug 09 18:25:07 user nova-compute[72418]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:25:07 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60121fd-5ad1-4919-a4aa-570035ec77a2 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f42f818dea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3'): ({'sdf'}, set())}) {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-e60121fd-5ad1-4919-a4aa-570035ec77a2 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Removing single pathed devices sdf {{(pid=72418) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8073db-daa6-47ee-bb4e-98959b496799]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cb76de-f75c-491c-8ad8-c2896617b0e7]: (4, ('ok\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-e60121fd-5ad1-4919-a4aa-570035ec77a2 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Flushing IO for device /dev/sdf {{(pid=72418) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4490bf-010b-4ae3-900d-907751b6b9fb]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-e60121fd-5ad1-4919-a4aa-570035ec77a2 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72418) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b740a2-3fb5-4ff7-8e36-07c0ec00f2ff]: (4, ('1', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-e60121fd-5ad1-4919-a4aa-570035ec77a2 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-e60121fd-5ad1-4919-a4aa-570035ec77a2 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] SCSI volumes sdf have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60121fd-5ad1-4919-a4aa-570035ec77a2 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3')] {{(pid=72418) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG nova.compute.manager [req-0e74b9cb-9c4f-43cb-b441-e3216a9e0cb6 req-c017fc81-ecdf-4551-8d36-f393c0f06832 service nova] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Received event network-vif-plugged-2472f1be-ea8f-46b6-a4f3-481f517c7edd {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-0e74b9cb-9c4f-43cb-b441-e3216a9e0cb6 req-c017fc81-ecdf-4551-8d36-f393c0f06832 service nova] Acquiring lock "d9d5d476-484e-49a3-a665-5a2069ea606e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-0e74b9cb-9c4f-43cb-b441-e3216a9e0cb6 req-c017fc81-ecdf-4551-8d36-f393c0f06832 service nova] Lock "d9d5d476-484e-49a3-a665-5a2069ea606e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-0e74b9cb-9c4f-43cb-b441-e3216a9e0cb6 req-c017fc81-ecdf-4551-8d36-f393c0f06832 service nova] Lock "d9d5d476-484e-49a3-a665-5a2069ea606e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG nova.compute.manager [req-0e74b9cb-9c4f-43cb-b441-e3216a9e0cb6 req-c017fc81-ecdf-4551-8d36-f393c0f06832 service nova] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] No waiting events found dispatching network-vif-plugged-2472f1be-ea8f-46b6-a4f3-481f517c7edd {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:25:07 user nova-compute[72418]: WARNING nova.compute.manager [req-0e74b9cb-9c4f-43cb-b441-e3216a9e0cb6 req-c017fc81-ecdf-4551-8d36-f393c0f06832 service nova] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Received unexpected event network-vif-plugged-2472f1be-ea8f-46b6-a4f3-481f517c7edd for instance with vm_state active and task_state rebuild_spawning.
Aug 09 18:25:07 user nova-compute[72418]: DEBUG nova.compute.manager [req-0e74b9cb-9c4f-43cb-b441-e3216a9e0cb6 req-c017fc81-ecdf-4551-8d36-f393c0f06832 service nova] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Received event network-vif-plugged-2472f1be-ea8f-46b6-a4f3-481f517c7edd {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-0e74b9cb-9c4f-43cb-b441-e3216a9e0cb6 req-c017fc81-ecdf-4551-8d36-f393c0f06832 service nova] Acquiring lock "d9d5d476-484e-49a3-a665-5a2069ea606e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-0e74b9cb-9c4f-43cb-b441-e3216a9e0cb6 req-c017fc81-ecdf-4551-8d36-f393c0f06832 service nova] Lock "d9d5d476-484e-49a3-a665-5a2069ea606e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-0e74b9cb-9c4f-43cb-b441-e3216a9e0cb6 req-c017fc81-ecdf-4551-8d36-f393c0f06832 service nova] Lock "d9d5d476-484e-49a3-a665-5a2069ea606e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG nova.compute.manager [req-0e74b9cb-9c4f-43cb-b441-e3216a9e0cb6 req-c017fc81-ecdf-4551-8d36-f393c0f06832 service nova] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] No waiting events found dispatching network-vif-plugged-2472f1be-ea8f-46b6-a4f3-481f517c7edd {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:25:07 user nova-compute[72418]: WARNING nova.compute.manager [req-0e74b9cb-9c4f-43cb-b441-e3216a9e0cb6 req-c017fc81-ecdf-4551-8d36-f393c0f06832 service nova] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Received unexpected event network-vif-plugged-2472f1be-ea8f-46b6-a4f3-481f517c7edd for instance with vm_state active and task_state rebuild_spawning.
Aug 09 18:25:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8a1073-2762-4b1a-bc72-637e4ead515d]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60121fd-5ad1-4919-a4aa-570035ec77a2 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 -p 172.16.0.220:3260 --logout {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[50798edf-e310-41d0-83e1-f766885203d4]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60121fd-5ad1-4919-a4aa-570035ec77a2 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3, portal: 172.16.0.220,3260]
Aug 09 18:25:07 user nova-compute[72418]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3, portal: 172.16.0.220,3260] successful.
Aug 09 18:25:07 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 -p 172.16.0.220:3260 --op delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d982f88-39fb-45e9-a6c9-4a4379a52ea3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c55ed2-7666-4478-bada-c9aadb261348]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60121fd-5ad1-4919-a4aa-570035ec77a2 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-e60121fd-5ad1-4919-a4aa-570035ec77a2 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60121fd-5ad1-4919-a4aa-570035ec77a2 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] <== disconnect_volume: return (276ms) None {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:25:07 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e60121fd-5ad1-4919-a4aa-570035ec77a2 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Disconnected iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 18:25:08 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605508.405959, d9d5d476-484e-49a3-a665-5a2069ea606e => Resumed> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:25:08 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] VM Resumed (Lifecycle Event)
Aug 09 18:25:08 user nova-compute[72418]: DEBUG nova.compute.manager [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Instance event wait completed in 0 seconds for  {{(pid=72418) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 18:25:08 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Guest created on hypervisor {{(pid=72418) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 18:25:08 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Instance spawned successfully.
Aug 09 18:25:08 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 18:25:08 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:25:08 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Found default for hw_cdrom_bus of ide {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:25:08 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Found default for hw_disk_bus of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:25:08 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Found default for hw_input_bus of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:25:08 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Found default for hw_pointer_model of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:25:08 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Found default for hw_video_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:25:08 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Found default for hw_vif_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:25:08 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:25:08 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 09 18:25:08 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605508.4060984, d9d5d476-484e-49a3-a665-5a2069ea606e => Started> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:25:08 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] VM Started (Lifecycle Event)
Aug 09 18:25:08 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:25:08 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:25:08 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 09 18:25:08 user nova-compute[72418]: DEBUG nova.compute.manager [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:25:08 user nova-compute[72418]: DEBUG nova.objects.instance [None req-e60121fd-5ad1-4919-a4aa-570035ec77a2 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Lazy-loading 'flavor' on Instance uuid dabfdb24-fc0b-4a00-a229-1ece48e27d18 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:25:08 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:08 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:08 user nova-compute[72418]: DEBUG nova.objects.instance [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72418) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 09 18:25:08 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-e60121fd-5ad1-4919-a4aa-570035ec77a2 tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Lock "dabfdb24-fc0b-4a00-a229-1ece48e27d18" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.740s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:08 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ade588ac-a591-4e67-9337-d70c50d69163 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.127s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:09 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:10 user nova-compute[72418]: DEBUG nova.compute.manager [req-0c7f1c35-c7e4-4783-b757-7d1a7ae0d544 req-4bf8d9a4-d1c3-4f51-b908-1b40812539d8 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received event network-vif-deleted-af01e732-21ed-4815-842e-90e7b3591398 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:25:10 user nova-compute[72418]: INFO nova.compute.manager [req-0c7f1c35-c7e4-4783-b757-7d1a7ae0d544 req-4bf8d9a4-d1c3-4f51-b908-1b40812539d8 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Neutron deleted interface af01e732-21ed-4815-842e-90e7b3591398; detaching it from the instance and deleting it from the info cache
Aug 09 18:25:10 user nova-compute[72418]: DEBUG nova.network.neutron [req-0c7f1c35-c7e4-4783-b757-7d1a7ae0d544 req-4bf8d9a4-d1c3-4f51-b908-1b40812539d8 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Updating instance_info_cache with network_info: [{"id": "f148ea7a-87e0-482f-bd2f-d3fcaa50fd4f", "address": "fa:16:3e:5c:b3:39", "network": {"id": "1b2af6fe-348e-4d75-9967-f6e70cb5e625", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1372910455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf148ea7a-87", "ovs_interfaceid": "f148ea7a-87e0-482f-bd2f-d3fcaa50fd4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "92f457ac-3ac1-426a-ac45-854d9e2ca180", "address": "fa:16:3e:1e:50:a4", "network": {"id": "a4e74890-7ab4-4e52-8297-5c27f2cb6497", "bridge": "br-int", "label": "tempest-device-tagging-net1-428079376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f457ac-3a", "ovs_interfaceid": "92f457ac-3ac1-426a-ac45-854d9e2ca180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a0900115-d746-4910-aafd-a6da02efe287", "address": "fa:16:3e:fa:8a:82", "network": {"id": "a4e74890-7ab4-4e52-8297-5c27f2cb6497", "bridge": "br-int", "label": "tempest-device-tagging-net1-428079376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0900115-d7", "ovs_interfaceid": "a0900115-d746-4910-aafd-a6da02efe287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cb99cdec-40f2-4666-bc12-0c825431db5f", "address": "fa:16:3e:39:ba:42", "network": {"id": "a4e74890-7ab4-4e52-8297-5c27f2cb6497", "bridge": "br-int", "label": "tempest-device-tagging-net1-428079376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb99cdec-40", "ovs_interfaceid": "cb99cdec-40f2-4666-bc12-0c825431db5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "692db581-bf1f-4295-a18d-65ab40120c7a", "address": "fa:16:3e:fb:c8:98", "network": {"id": "7f7c8970-9e06-4944-bfac-ac7ea2073cee", "bridge": "br-int", "label": "tempest-device-tagging-net2-2000981143", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap692db581-bf", "ovs_interfaceid": "692db581-bf1f-4295-a18d-65ab40120c7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "875b1fd5-6595-48dc-83b1-95ebeee70bb2", "address": "fa:16:3e:e1:90:74", "network": {"id": "7f7c8970-9e06-4944-bfac-ac7ea2073cee", "bridge": "br-int", "label": "tempest-device-tagging-net2-2000981143", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875b1fd5-65", "ovs_interfaceid": "875b1fd5-6595-48dc-83b1-95ebeee70bb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:25:10 user nova-compute[72418]: DEBUG nova.compute.manager [req-0c7f1c35-c7e4-4783-b757-7d1a7ae0d544 req-4bf8d9a4-d1c3-4f51-b908-1b40812539d8 service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Detach interface failed, port_id=af01e732-21ed-4815-842e-90e7b3591398, reason: Instance 2b284735-40f6-403f-8c72-a70a4da1ef95 could not be found. {{(pid=72418) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG nova.compute.manager [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Start spawning the instance on the hypervisor. {{(pid=72418) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Creating instance directory {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 18:25:12 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Creating image(s)
Aug 09 18:25:12 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Did not create local disks {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Ensure instance console log exists: /opt/stack/data/nova/instances/e019064c-955e-4f80-9b00-6b32b3835d58/console.log {{(pid=72418) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Start _get_guest_xml network_info=[{"id": "4c6c632a-142b-4cda-92c8-77026645af09", "address": "fa:16:3e:15:18:a4", "network": {"id": "beaefb5c-f5e4-47e7-ab68-60131f532ade", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e5863cda54487682a4edcc24202c91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c6c632a-14", "ovs_interfaceid": "4c6c632a-142b-4cda-92c8-77026645af09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '95659ef3-c2cd-499d-bbf4-c85323fd49ae', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EYQJoplb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e019064c-955e-4f80-9b00-6b32b3835d58', 'attached_at': '', 'detached_at': '', 'volume_id': 'bf6e1fe4-e93e-4920-bdab-02a219161292', 'serial': 'bf6e1fe4-e93e-4920-bdab-02a219161292'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 18:25:12 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:25:12 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:25:12 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] CPU controller missing on host. {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] CPU controller found on host. {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72418) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T18:17:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Flavor limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Image limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Flavor pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Image pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Got 1 possible topologies {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Calling os-brick to attach iSCSI Volume {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EYQJoplb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:25:12 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:25:12 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:25:12 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:25:12 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:25:12 user nova-compute[72418]: INFO os_brick.initiator.connectors.iscsi [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 18:25:12 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 -p 172.16.0.220:3260 {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[507461fe-38b4-4264-a494-e7885ce29008]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 18:25:12 user nova-compute[72418]:  {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 -p 172.16.0.220:3260 --interface default --op new {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG nova.compute.manager [req-5a16b101-fb59-4bb2-92a3-8913bdf2caa1 req-b9db993d-4d00-4aad-82d6-d9617b6c067d service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received event network-vif-deleted-875b1fd5-6595-48dc-83b1-95ebeee70bb2 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:25:12 user nova-compute[72418]: INFO nova.compute.manager [req-5a16b101-fb59-4bb2-92a3-8913bdf2caa1 req-b9db993d-4d00-4aad-82d6-d9617b6c067d service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Neutron deleted interface 875b1fd5-6595-48dc-83b1-95ebeee70bb2; detaching it from the instance and deleting it from the info cache
Aug 09 18:25:12 user nova-compute[72418]: DEBUG nova.network.neutron [req-5a16b101-fb59-4bb2-92a3-8913bdf2caa1 req-b9db993d-4d00-4aad-82d6-d9617b6c067d service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Updating instance_info_cache with network_info: [{"id": "f148ea7a-87e0-482f-bd2f-d3fcaa50fd4f", "address": "fa:16:3e:5c:b3:39", "network": {"id": "1b2af6fe-348e-4d75-9967-f6e70cb5e625", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1372910455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf148ea7a-87", "ovs_interfaceid": "f148ea7a-87e0-482f-bd2f-d3fcaa50fd4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "92f457ac-3ac1-426a-ac45-854d9e2ca180", "address": "fa:16:3e:1e:50:a4", "network": {"id": "a4e74890-7ab4-4e52-8297-5c27f2cb6497", "bridge": "br-int", "label": "tempest-device-tagging-net1-428079376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f457ac-3a", "ovs_interfaceid": "92f457ac-3ac1-426a-ac45-854d9e2ca180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a0900115-d746-4910-aafd-a6da02efe287", "address": "fa:16:3e:fa:8a:82", "network": {"id": "a4e74890-7ab4-4e52-8297-5c27f2cb6497", "bridge": "br-int", "label": "tempest-device-tagging-net1-428079376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0900115-d7", "ovs_interfaceid": "a0900115-d746-4910-aafd-a6da02efe287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cb99cdec-40f2-4666-bc12-0c825431db5f", "address": "fa:16:3e:39:ba:42", "network": {"id": "a4e74890-7ab4-4e52-8297-5c27f2cb6497", "bridge": "br-int", "label": "tempest-device-tagging-net1-428079376", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb99cdec-40", "ovs_interfaceid": "cb99cdec-40f2-4666-bc12-0c825431db5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "692db581-bf1f-4295-a18d-65ab40120c7a", "address": "fa:16:3e:fb:c8:98", "network": {"id": "7f7c8970-9e06-4944-bfac-ac7ea2073cee", "bridge": "br-int", "label": "tempest-device-tagging-net2-2000981143", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "56236651c71b4e3f99128436cdf94710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap692db581-bf", "ovs_interfaceid": "692db581-bf1f-4295-a18d-65ab40120c7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[59108edb-8b3b-4c0e-80a1-af64692d7d5d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292] added\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292] added
Aug 09 18:25:12 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG nova.compute.manager [req-5a16b101-fb59-4bb2-92a3-8913bdf2caa1 req-b9db993d-4d00-4aad-82d6-d9617b6c067d service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Detach interface failed, port_id=875b1fd5-6595-48dc-83b1-95ebeee70bb2, reason: Instance 2b284735-40f6-403f-8c72-a70a4da1ef95 could not be found. {{(pid=72418) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6000c0d-120b-4a65-b608-aae2e22fd060]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f61adf-a3f8-4168-9cae-1039243af8b6]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EYQJoplb {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EYQJoplb" returned: 0 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58d3e3d-772f-49f7-8260-2140ec4e5681]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EYQJoplb'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[6791386b-ae70-4d80-a561-1123c10c661a]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d894903-3f9c-4eac-b072-b574a5e03a9f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:25:12 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:25:12 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 -p 172.16.0.220:3260 --login {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ad9b4f-f65e-4392-819b-4134e3d666e9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292, portal: 172.16.0.220,3260]
Aug 09 18:25:12 user nova-compute[72418]: Login to [iface: default, target: iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292, portal: 172.16.0.220,3260] successful.
Aug 09 18:25:12 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a47d387-b001-42c3-8b70-09e7fdfec4ca]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d0c1eb-451c-4470-bc15-a1ec206e5b2a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:25:12 user nova-compute[72418]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:25:12 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:25:12 user nova-compute[72418]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:25:12 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Connected to 172.16.0.220:3260 {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=72418) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72418) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de50c01-dc57-4bcd-943d-092b807b8b9d]: (4, ('- - 0', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72418) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 18:25:12 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EYQJoplb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 18:25:13 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:13 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:25:13 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23465646465323466', 'path': '/dev/sdb'} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:25:13 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23465646465323466', 'path': '/dev/sdb'} {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 18:25:13 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:24:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1312766715',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1312766715',id=14,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52e5863cda54487682a4edcc24202c91',ramdisk_id='',reservation_id='r-k5vy0lqf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1120385592',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:24:55Z,user_data=None,user_id='621fd2b971c543d197a354c38e0d1867',uuid=e019064c-955e-4f80-9b00-6b32b3835d58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c6c632a-142b-4cda-92c8-77026645af09", "address": "fa:16:3e:15:18:a4", "network": {"id": "beaefb5c-f5e4-47e7-ab68-60131f532ade", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e5863cda54487682a4edcc24202c91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c6c632a-14", "ovs_interfaceid": "4c6c632a-142b-4cda-92c8-77026645af09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:25:13 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Converting VIF {"id": "4c6c632a-142b-4cda-92c8-77026645af09", "address": "fa:16:3e:15:18:a4", "network": {"id": "beaefb5c-f5e4-47e7-ab68-60131f532ade", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e5863cda54487682a4edcc24202c91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c6c632a-14", "ovs_interfaceid": "4c6c632a-142b-4cda-92c8-77026645af09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:25:13 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:18:a4,bridge_name='br-int',has_traffic_filtering=True,id=4c6c632a-142b-4cda-92c8-77026645af09,network=Network(beaefb5c-f5e4-47e7-ab68-60131f532ade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c6c632a-14') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:25:13 user nova-compute[72418]: DEBUG nova.objects.instance [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lazy-loading 'pci_devices' on Instance uuid e019064c-955e-4f80-9b00-6b32b3835d58 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:25:13 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] End _get_guest_xml xml=<domain type="kvm">
Aug 09 18:25:13 user nova-compute[72418]:   <uuid>e019064c-955e-4f80-9b00-6b32b3835d58</uuid>
Aug 09 18:25:13 user nova-compute[72418]:   <name>instance-0000000e</name>
Aug 09 18:25:13 user nova-compute[72418]:   <memory>524288</memory>
Aug 09 18:25:13 user nova-compute[72418]:   <vcpu>1</vcpu>
Aug 09 18:25:13 user nova-compute[72418]:   <metadata>
Aug 09 18:25:13 user nova-compute[72418]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:25:13 user nova-compute[72418]:       <nova:package version="0.0.0"/>
Aug 09 18:25:13 user nova-compute[72418]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1312766715</nova:name>
Aug 09 18:25:13 user nova-compute[72418]:       <nova:creationTime>2023-08-09 18:25:12</nova:creationTime>
Aug 09 18:25:13 user nova-compute[72418]:       <nova:flavor name="m1.tiny">
Aug 09 18:25:13 user nova-compute[72418]:         <nova:memory>512</nova:memory>
Aug 09 18:25:13 user nova-compute[72418]:         <nova:disk>1</nova:disk>
Aug 09 18:25:13 user nova-compute[72418]:         <nova:swap>0</nova:swap>
Aug 09 18:25:13 user nova-compute[72418]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:25:13 user nova-compute[72418]:         <nova:vcpus>1</nova:vcpus>
Aug 09 18:25:13 user nova-compute[72418]:       </nova:flavor>
Aug 09 18:25:13 user nova-compute[72418]:       <nova:owner>
Aug 09 18:25:13 user nova-compute[72418]:         <nova:user uuid="621fd2b971c543d197a354c38e0d1867">tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member</nova:user>
Aug 09 18:25:13 user nova-compute[72418]:         <nova:project uuid="52e5863cda54487682a4edcc24202c91">tempest-ServerBootFromVolumeStableRescueTest-1120385592</nova:project>
Aug 09 18:25:13 user nova-compute[72418]:       </nova:owner>
Aug 09 18:25:13 user nova-compute[72418]:       <nova:root type="image" uuid="8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e"/>
Aug 09 18:25:13 user nova-compute[72418]:       <nova:ports>
Aug 09 18:25:13 user nova-compute[72418]:         <nova:port uuid="4c6c632a-142b-4cda-92c8-77026645af09">
Aug 09 18:25:13 user nova-compute[72418]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 18:25:13 user nova-compute[72418]:         </nova:port>
Aug 09 18:25:13 user nova-compute[72418]:       </nova:ports>
Aug 09 18:25:13 user nova-compute[72418]:     </nova:instance>
Aug 09 18:25:13 user nova-compute[72418]:   </metadata>
Aug 09 18:25:13 user nova-compute[72418]:   <sysinfo type="smbios">
Aug 09 18:25:13 user nova-compute[72418]:     <system>
Aug 09 18:25:13 user nova-compute[72418]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 18:25:13 user nova-compute[72418]:       <entry name="product">OpenStack Nova</entry>
Aug 09 18:25:13 user nova-compute[72418]:       <entry name="version">0.0.0</entry>
Aug 09 18:25:13 user nova-compute[72418]:       <entry name="serial">e019064c-955e-4f80-9b00-6b32b3835d58</entry>
Aug 09 18:25:13 user nova-compute[72418]:       <entry name="uuid">e019064c-955e-4f80-9b00-6b32b3835d58</entry>
Aug 09 18:25:13 user nova-compute[72418]:       <entry name="family">Virtual Machine</entry>
Aug 09 18:25:13 user nova-compute[72418]:     </system>
Aug 09 18:25:13 user nova-compute[72418]:   </sysinfo>
Aug 09 18:25:13 user nova-compute[72418]:   <os>
Aug 09 18:25:13 user nova-compute[72418]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 18:25:13 user nova-compute[72418]:     <boot dev="hd"/>
Aug 09 18:25:13 user nova-compute[72418]:     <smbios mode="sysinfo"/>
Aug 09 18:25:13 user nova-compute[72418]:   </os>
Aug 09 18:25:13 user nova-compute[72418]:   <features>
Aug 09 18:25:13 user nova-compute[72418]:     <acpi/>
Aug 09 18:25:13 user nova-compute[72418]:     <apic/>
Aug 09 18:25:13 user nova-compute[72418]:     <vmcoreinfo/>
Aug 09 18:25:13 user nova-compute[72418]:   </features>
Aug 09 18:25:13 user nova-compute[72418]:   <clock offset="utc">
Aug 09 18:25:13 user nova-compute[72418]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 18:25:13 user nova-compute[72418]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 18:25:13 user nova-compute[72418]:     <timer name="hpet" present="no"/>
Aug 09 18:25:13 user nova-compute[72418]:   </clock>
Aug 09 18:25:13 user nova-compute[72418]:   <cpu mode="custom" match="exact">
Aug 09 18:25:13 user nova-compute[72418]:     <model>Nehalem</model>
Aug 09 18:25:13 user nova-compute[72418]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 18:25:13 user nova-compute[72418]:   </cpu>
Aug 09 18:25:13 user nova-compute[72418]:   <devices>
Aug 09 18:25:13 user nova-compute[72418]:     <disk type="block" device="disk">
Aug 09 18:25:13 user nova-compute[72418]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:25:13 user nova-compute[72418]:       <source dev="/dev/sdb"/>
Aug 09 18:25:13 user nova-compute[72418]:       <target dev="vda" bus="virtio"/>
Aug 09 18:25:13 user nova-compute[72418]:       <serial>bf6e1fe4-e93e-4920-bdab-02a219161292</serial>
Aug 09 18:25:13 user nova-compute[72418]:     </disk>
Aug 09 18:25:13 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:25:13 user nova-compute[72418]:       <mac address="fa:16:3e:15:18:a4"/>
Aug 09 18:25:13 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:25:13 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:25:13 user nova-compute[72418]:       <target dev="tap4c6c632a-14"/>
Aug 09 18:25:13 user nova-compute[72418]:     </interface>
Aug 09 18:25:13 user nova-compute[72418]:     <serial type="pty">
Aug 09 18:25:13 user nova-compute[72418]:       <log file="/opt/stack/data/nova/instances/e019064c-955e-4f80-9b00-6b32b3835d58/console.log" append="off"/>
Aug 09 18:25:13 user nova-compute[72418]:     </serial>
Aug 09 18:25:13 user nova-compute[72418]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 18:25:13 user nova-compute[72418]:     <video>
Aug 09 18:25:13 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:25:13 user nova-compute[72418]:     </video>
Aug 09 18:25:13 user nova-compute[72418]:     <rng model="virtio">
Aug 09 18:25:13 user nova-compute[72418]:       <backend model="random">/dev/urandom</backend>
Aug 09 18:25:13 user nova-compute[72418]:     </rng>
Aug 09 18:25:13 user nova-compute[72418]:     <controller type="usb" index="0" model="none"/>
Aug 09 18:25:13 user nova-compute[72418]:     <memballoon model="virtio">
Aug 09 18:25:13 user nova-compute[72418]:       <stats period="10"/>
Aug 09 18:25:13 user nova-compute[72418]:     </memballoon>
Aug 09 18:25:13 user nova-compute[72418]:   </devices>
Aug 09 18:25:13 user nova-compute[72418]: </domain>
Aug 09 18:25:13 user nova-compute[72418]:  {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 18:25:13 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:24:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1312766715',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1312766715',id=14,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52e5863cda54487682a4edcc24202c91',ramdisk_id='',reservation_id='r-k5vy0lqf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1120385592',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:24:55Z,user_data=None,user_id='621fd2b971c543d197a354c38e0d1867',uuid=e019064c-955e-4f80-9b00-6b32b3835d58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c6c632a-142b-4cda-92c8-77026645af09", "address": "fa:16:3e:15:18:a4", "network": {"id": "beaefb5c-f5e4-47e7-ab68-60131f532ade", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e5863cda54487682a4edcc24202c91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c6c632a-14", "ovs_interfaceid": "4c6c632a-142b-4cda-92c8-77026645af09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:25:13 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Converting VIF {"id": "4c6c632a-142b-4cda-92c8-77026645af09", "address": "fa:16:3e:15:18:a4", "network": {"id": "beaefb5c-f5e4-47e7-ab68-60131f532ade", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e5863cda54487682a4edcc24202c91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c6c632a-14", "ovs_interfaceid": "4c6c632a-142b-4cda-92c8-77026645af09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:25:13 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:18:a4,bridge_name='br-int',has_traffic_filtering=True,id=4c6c632a-142b-4cda-92c8-77026645af09,network=Network(beaefb5c-f5e4-47e7-ab68-60131f532ade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c6c632a-14') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:25:13 user nova-compute[72418]: DEBUG os_vif [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:18:a4,bridge_name='br-int',has_traffic_filtering=True,id=4c6c632a-142b-4cda-92c8-77026645af09,network=Network(beaefb5c-f5e4-47e7-ab68-60131f532ade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c6c632a-14') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:25:13 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:13 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:25:13 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:25:13 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:13 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c6c632a-14, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:25:13 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4c6c632a-14, col_values=(('external_ids', {'iface-id': '4c6c632a-142b-4cda-92c8-77026645af09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:18:a4', 'vm-uuid': 'e019064c-955e-4f80-9b00-6b32b3835d58'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:25:13 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:25:13 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:13 user nova-compute[72418]: INFO os_vif [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:18:a4,bridge_name='br-int',has_traffic_filtering=True,id=4c6c632a-142b-4cda-92c8-77026645af09,network=Network(beaefb5c-f5e4-47e7-ab68-60131f532ade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c6c632a-14')
Aug 09 18:25:13 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:25:13 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] No VIF found with MAC fa:16:3e:15:18:a4, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:25:14 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:25:14 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Took 8.07 seconds to deallocate network for instance.
Aug 09 18:25:14 user nova-compute[72418]: DEBUG nova.compute.manager [req-3716e7a6-7d2e-4cfd-8572-a31576aca5bb req-0c5bf2ca-8b5e-467b-9b85-381820a940ee service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received event network-vif-deleted-f148ea7a-87e0-482f-bd2f-d3fcaa50fd4f {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:25:14 user nova-compute[72418]: DEBUG nova.compute.manager [req-3716e7a6-7d2e-4cfd-8572-a31576aca5bb req-0c5bf2ca-8b5e-467b-9b85-381820a940ee service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received event network-vif-deleted-cb99cdec-40f2-4666-bc12-0c825431db5f {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:25:14 user nova-compute[72418]: DEBUG nova.compute.manager [req-3716e7a6-7d2e-4cfd-8572-a31576aca5bb req-0c5bf2ca-8b5e-467b-9b85-381820a940ee service nova] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Received event network-vif-deleted-692db581-bf1f-4295-a18d-65ab40120c7a {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:25:15 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:15 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:15 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Acquiring lock "bd87d56d-3aa5-43cf-ac55-fb3c41e092b1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Lock "bd87d56d-3aa5-43cf-ac55-fb3c41e092b1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:15 user nova-compute[72418]: DEBUG nova.compute.manager [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Starting instance... {{(pid=72418) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 18:25:15 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:15 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72418) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 18:25:15 user nova-compute[72418]: INFO nova.compute.claims [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Claim successful on node user
Aug 09 18:25:16 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-289ebf6e-caec-4a43-99ac-ba9f6431bb35 tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Acquiring lock "6084e681-01c4-4a6c-beb3-dcda4a990a51" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:16 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-289ebf6e-caec-4a43-99ac-ba9f6431bb35 tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Lock "6084e681-01c4-4a6c-beb3-dcda4a990a51" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.007s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:16 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-289ebf6e-caec-4a43-99ac-ba9f6431bb35 tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Acquiring lock "6084e681-01c4-4a6c-beb3-dcda4a990a51-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:16 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-289ebf6e-caec-4a43-99ac-ba9f6431bb35 tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Lock "6084e681-01c4-4a6c-beb3-dcda4a990a51-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:16 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-289ebf6e-caec-4a43-99ac-ba9f6431bb35 tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Lock "6084e681-01c4-4a6c-beb3-dcda4a990a51-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:16 user nova-compute[72418]: INFO nova.compute.manager [None req-289ebf6e-caec-4a43-99ac-ba9f6431bb35 tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Terminating instance
Aug 09 18:25:16 user nova-compute[72418]: DEBUG nova.compute.manager [None req-289ebf6e-caec-4a43-99ac-ba9f6431bb35 tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Start destroying the instance on the hypervisor. {{(pid=72418) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 18:25:16 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:16 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:16 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:16 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:16 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:16 user nova-compute[72418]: DEBUG nova.compute.manager [req-0cded8de-5751-4fe5-9391-cca5dfe2fe67 req-ec5a2a66-a239-493e-8751-63919b50058b service nova] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Received event network-vif-plugged-4c6c632a-142b-4cda-92c8-77026645af09 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:25:16 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-0cded8de-5751-4fe5-9391-cca5dfe2fe67 req-ec5a2a66-a239-493e-8751-63919b50058b service nova] Acquiring lock "e019064c-955e-4f80-9b00-6b32b3835d58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:16 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-0cded8de-5751-4fe5-9391-cca5dfe2fe67 req-ec5a2a66-a239-493e-8751-63919b50058b service nova] Lock "e019064c-955e-4f80-9b00-6b32b3835d58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:16 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-0cded8de-5751-4fe5-9391-cca5dfe2fe67 req-ec5a2a66-a239-493e-8751-63919b50058b service nova] Lock "e019064c-955e-4f80-9b00-6b32b3835d58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:16 user nova-compute[72418]: DEBUG nova.compute.manager [req-0cded8de-5751-4fe5-9391-cca5dfe2fe67 req-ec5a2a66-a239-493e-8751-63919b50058b service nova] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] No waiting events found dispatching network-vif-plugged-4c6c632a-142b-4cda-92c8-77026645af09 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:25:16 user nova-compute[72418]: WARNING nova.compute.manager [req-0cded8de-5751-4fe5-9391-cca5dfe2fe67 req-ec5a2a66-a239-493e-8751-63919b50058b service nova] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Received unexpected event network-vif-plugged-4c6c632a-142b-4cda-92c8-77026645af09 for instance with vm_state building and task_state spawning.
Aug 09 18:25:16 user nova-compute[72418]: DEBUG nova.compute.manager [req-0cded8de-5751-4fe5-9391-cca5dfe2fe67 req-ec5a2a66-a239-493e-8751-63919b50058b service nova] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Received event network-vif-plugged-4c6c632a-142b-4cda-92c8-77026645af09 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:25:16 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-0cded8de-5751-4fe5-9391-cca5dfe2fe67 req-ec5a2a66-a239-493e-8751-63919b50058b service nova] Acquiring lock "e019064c-955e-4f80-9b00-6b32b3835d58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:16 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-0cded8de-5751-4fe5-9391-cca5dfe2fe67 req-ec5a2a66-a239-493e-8751-63919b50058b service nova] Lock "e019064c-955e-4f80-9b00-6b32b3835d58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:16 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-0cded8de-5751-4fe5-9391-cca5dfe2fe67 req-ec5a2a66-a239-493e-8751-63919b50058b service nova] Lock "e019064c-955e-4f80-9b00-6b32b3835d58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:16 user nova-compute[72418]: DEBUG nova.compute.manager [req-0cded8de-5751-4fe5-9391-cca5dfe2fe67 req-ec5a2a66-a239-493e-8751-63919b50058b service nova] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] No waiting events found dispatching network-vif-plugged-4c6c632a-142b-4cda-92c8-77026645af09 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:25:16 user nova-compute[72418]: WARNING nova.compute.manager [req-0cded8de-5751-4fe5-9391-cca5dfe2fe67 req-ec5a2a66-a239-493e-8751-63919b50058b service nova] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Received unexpected event network-vif-plugged-4c6c632a-142b-4cda-92c8-77026645af09 for instance with vm_state building and task_state spawning.
Aug 09 18:25:16 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:25:16 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:25:16 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.970s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:16 user nova-compute[72418]: DEBUG nova.compute.manager [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Start building networks asynchronously for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 18:25:16 user nova-compute[72418]: DEBUG nova.compute.manager [req-a8fe9339-be03-4a40-a725-1d1d157f9ae0 req-d1fa58ea-7f39-4e11-abdb-bcad97d7b4b2 service nova] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Received event network-vif-unplugged-ae43991a-cb38-4bb3-ae7e-9c72684dcdd9 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:25:16 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a8fe9339-be03-4a40-a725-1d1d157f9ae0 req-d1fa58ea-7f39-4e11-abdb-bcad97d7b4b2 service nova] Acquiring lock "6084e681-01c4-4a6c-beb3-dcda4a990a51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:16 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a8fe9339-be03-4a40-a725-1d1d157f9ae0 req-d1fa58ea-7f39-4e11-abdb-bcad97d7b4b2 service nova] Lock "6084e681-01c4-4a6c-beb3-dcda4a990a51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:16 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a8fe9339-be03-4a40-a725-1d1d157f9ae0 req-d1fa58ea-7f39-4e11-abdb-bcad97d7b4b2 service nova] Lock "6084e681-01c4-4a6c-beb3-dcda4a990a51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:16 user nova-compute[72418]: DEBUG nova.compute.manager [req-a8fe9339-be03-4a40-a725-1d1d157f9ae0 req-d1fa58ea-7f39-4e11-abdb-bcad97d7b4b2 service nova] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] No waiting events found dispatching network-vif-unplugged-ae43991a-cb38-4bb3-ae7e-9c72684dcdd9 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:25:16 user nova-compute[72418]: DEBUG nova.compute.manager [req-a8fe9339-be03-4a40-a725-1d1d157f9ae0 req-d1fa58ea-7f39-4e11-abdb-bcad97d7b4b2 service nova] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Received event network-vif-unplugged-ae43991a-cb38-4bb3-ae7e-9c72684dcdd9 for instance with task_state deleting. {{(pid=72418) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 18:25:16 user nova-compute[72418]: DEBUG nova.compute.manager [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Allocating IP information in the background. {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 18:25:16 user nova-compute[72418]: DEBUG nova.network.neutron [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] allocate_for_instance() {{(pid=72418) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 18:25:16 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 18:25:16 user nova-compute[72418]: DEBUG nova.compute.manager [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Start building block device mappings for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 18:25:16 user nova-compute[72418]: DEBUG nova.policy [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3edbabbb69494929a4d671b4113f7753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f09f1028304efd84f2e694efdae063', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72418) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 18:25:16 user nova-compute[72418]: DEBUG nova.compute.manager [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Start spawning the instance on the hypervisor. {{(pid=72418) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 18:25:16 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Creating instance directory {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 18:25:16 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Creating image(s)
Aug 09 18:25:16 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Acquiring lock "/opt/stack/data/nova/instances/bd87d56d-3aa5-43cf-ac55-fb3c41e092b1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:16 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Lock "/opt/stack/data/nova/instances/bd87d56d-3aa5-43cf-ac55-fb3c41e092b1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:16 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Lock "/opt/stack/data/nova/instances/bd87d56d-3aa5-43cf-ac55-fb3c41e092b1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:16 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:17 user nova-compute[72418]: INFO nova.compute.manager [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Took 2.76 seconds to detach 3 volumes for instance.
Aug 09 18:25:17 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:17 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:17 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:17 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.175s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:17 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Acquiring lock "458773cfa7230b717e41c60277832e9f83806d71" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:17 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:17 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:17 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:17 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:17 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:17 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Instance destroyed successfully.
Aug 09 18:25:17 user nova-compute[72418]: DEBUG nova.objects.instance [None req-289ebf6e-caec-4a43-99ac-ba9f6431bb35 tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Lazy-loading 'resources' on Instance uuid 6084e681-01c4-4a6c-beb3-dcda4a990a51 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:25:17 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:17 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-289ebf6e-caec-4a43-99ac-ba9f6431bb35 tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:22:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-2056657652',display_name='tempest-VolumesAssistedSnapshotsTest-server-2056657652',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-2056657652',id=6,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZkMB/830LkZPcI2Kt8lUbObKOtLsYhPKqdlcrSeF2qegOTUMYZvlIcs6L4p/aME+midDB396nzO/MwWAlSe09uVZxbuMtHdUxsp2UurvPwN6bPz2nRJLg3Ys3lUjqtbw==',key_name='tempest-keypair-356632525',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:22:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df6a65ef22db446c9cda523621cda645',ramdisk_id='',reservation_id='r-s2om02p1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-917954092',owner_user_name='tempest-VolumesAssistedSnapshotsTest-917954092-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:22:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f8f0724519049c5815be66bc07892ed',uuid=6084e681-01c4-4a6c-beb3-dcda4a990a51,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae43991a-cb38-4bb3-ae7e-9c72684dcdd9", "address": "fa:16:3e:98:e7:5b", "network": {"id": "625ace3e-82b3-4e9c-b5d2-018f7c686cf4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1965184187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df6a65ef22db446c9cda523621cda645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae43991a-cb", "ovs_interfaceid": "ae43991a-cb38-4bb3-ae7e-9c72684dcdd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 18:25:17 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-289ebf6e-caec-4a43-99ac-ba9f6431bb35 tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Converting VIF {"id": "ae43991a-cb38-4bb3-ae7e-9c72684dcdd9", "address": "fa:16:3e:98:e7:5b", "network": {"id": "625ace3e-82b3-4e9c-b5d2-018f7c686cf4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1965184187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df6a65ef22db446c9cda523621cda645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae43991a-cb", "ovs_interfaceid": "ae43991a-cb38-4bb3-ae7e-9c72684dcdd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:25:17 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-289ebf6e-caec-4a43-99ac-ba9f6431bb35 tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:e7:5b,bridge_name='br-int',has_traffic_filtering=True,id=ae43991a-cb38-4bb3-ae7e-9c72684dcdd9,network=Network(625ace3e-82b3-4e9c-b5d2-018f7c686cf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae43991a-cb') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:25:17 user nova-compute[72418]: DEBUG os_vif [None req-289ebf6e-caec-4a43-99ac-ba9f6431bb35 tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:e7:5b,bridge_name='br-int',has_traffic_filtering=True,id=ae43991a-cb38-4bb3-ae7e-9c72684dcdd9,network=Network(625ace3e-82b3-4e9c-b5d2-018f7c686cf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae43991a-cb') {{(pid=72418) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 18:25:17 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:17 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae43991a-cb, bridge=br-int, if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:25:17 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:17 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:25:17 user nova-compute[72418]: INFO os_vif [None req-289ebf6e-caec-4a43-99ac-ba9f6431bb35 tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:e7:5b,bridge_name='br-int',has_traffic_filtering=True,id=ae43991a-cb38-4bb3-ae7e-9c72684dcdd9,network=Network(625ace3e-82b3-4e9c-b5d2-018f7c686cf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae43991a-cb')
Aug 09 18:25:17 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-289ebf6e-caec-4a43-99ac-ba9f6431bb35 tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Deleting instance files /opt/stack/data/nova/instances/6084e681-01c4-4a6c-beb3-dcda4a990a51_del
Aug 09 18:25:17 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-289ebf6e-caec-4a43-99ac-ba9f6431bb35 tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Deletion of /opt/stack/data/nova/instances/6084e681-01c4-4a6c-beb3-dcda4a990a51_del complete
Aug 09 18:25:17 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.173s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:17 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/bd87d56d-3aa5-43cf-ac55-fb3c41e092b1/disk 1073741824 {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:17 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/bd87d56d-3aa5-43cf-ac55-fb3c41e092b1/disk 1073741824" returned: 0 in 0.094s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:17 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:17 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:17 user nova-compute[72418]: INFO nova.compute.manager [None req-289ebf6e-caec-4a43-99ac-ba9f6431bb35 tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Took 1.16 seconds to destroy the instance on the hypervisor.
Aug 09 18:25:17 user nova-compute[72418]: DEBUG oslo.service.loopingcall [None req-289ebf6e-caec-4a43-99ac-ba9f6431bb35 tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72418) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 18:25:17 user nova-compute[72418]: DEBUG nova.compute.manager [-] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Deallocating network for instance {{(pid=72418) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 18:25:17 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] deallocate_for_instance() {{(pid=72418) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 18:25:17 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:17 user nova-compute[72418]: DEBUG nova.network.neutron [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Successfully created port: 616dd3b1-68e6-47e9-b7ff-a4b63c3e702f {{(pid=72418) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 18:25:17 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.169s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:17 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bd87d56d-3aa5-43cf-ac55-fb3c41e092b1/disk. size=1073741824 {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 18:25:17 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd87d56d-3aa5-43cf-ac55-fb3c41e092b1/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:17 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd87d56d-3aa5-43cf-ac55-fb3c41e092b1/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:17 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Cannot resize image /opt/stack/data/nova/instances/bd87d56d-3aa5-43cf-ac55-fb3c41e092b1/disk to a smaller size. {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 18:25:17 user nova-compute[72418]: DEBUG nova.objects.instance [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Lazy-loading 'migration_context' on Instance uuid bd87d56d-3aa5-43cf-ac55-fb3c41e092b1 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:25:17 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Created local disks {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 18:25:17 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Ensure instance console log exists: /opt/stack/data/nova/instances/bd87d56d-3aa5-43cf-ac55-fb3c41e092b1/console.log {{(pid=72418) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 18:25:17 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:17 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:17 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:17 user nova-compute[72418]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691605502.78791, 2b284735-40f6-403f-8c72-a70a4da1ef95 => Stopped> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:25:17 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] VM Stopped (Lifecycle Event)
Aug 09 18:25:17 user nova-compute[72418]: DEBUG nova.compute.manager [None req-ed147208-2139-4f6b-b27a-7a4b3b273e44 None None] [instance: 2b284735-40f6-403f-8c72-a70a4da1ef95] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:25:17 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605517.859311, e019064c-955e-4f80-9b00-6b32b3835d58 => Resumed> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:25:17 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] VM Resumed (Lifecycle Event)
Aug 09 18:25:17 user nova-compute[72418]: DEBUG nova.compute.manager [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Instance event wait completed in 0 seconds for  {{(pid=72418) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 18:25:17 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Guest created on hypervisor {{(pid=72418) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 18:25:17 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Instance spawned successfully.
Aug 09 18:25:17 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:17 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 18:25:17 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:25:17 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:25:17 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:17 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:25:17 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:25:18 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Found default for hw_cdrom_bus of ide {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:25:18 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Found default for hw_disk_bus of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:25:18 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Found default for hw_input_bus of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:25:18 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Found default for hw_pointer_model of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:25:18 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Found default for hw_video_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:25:18 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Found default for hw_vif_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:25:18 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:18 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.857s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:18 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:25:18 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605517.8666873, e019064c-955e-4f80-9b00-6b32b3835d58 => Started> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:25:18 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] VM Started (Lifecycle Event)
Aug 09 18:25:18 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:18 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:25:18 user nova-compute[72418]: INFO nova.scheduler.client.report [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Deleted allocations for instance 2b284735-40f6-403f-8c72-a70a4da1ef95
Aug 09 18:25:18 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:25:18 user nova-compute[72418]: INFO nova.compute.manager [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Took 5.93 seconds to spawn the instance on the hypervisor.
Aug 09 18:25:18 user nova-compute[72418]: DEBUG nova.compute.manager [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:25:18 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:25:18 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-98a56e92-933c-4e7f-b11f-a95479d44125 tempest-TaggedBootDevicesTest-766454510 tempest-TaggedBootDevicesTest-766454510-project-member] Lock "2b284735-40f6-403f-8c72-a70a4da1ef95" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 17.602s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:18 user nova-compute[72418]: INFO nova.compute.manager [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Took 23.63 seconds to build instance.
Aug 09 18:25:18 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-dda0ae3a-0f52-42fa-bbf2-19410f1a1e54 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "e019064c-955e-4f80-9b00-6b32b3835d58" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.764s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:18 user nova-compute[72418]: DEBUG nova.network.neutron [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Successfully updated port: 616dd3b1-68e6-47e9-b7ff-a4b63c3e702f {{(pid=72418) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 18:25:18 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Acquiring lock "refresh_cache-bd87d56d-3aa5-43cf-ac55-fb3c41e092b1" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:25:18 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Acquired lock "refresh_cache-bd87d56d-3aa5-43cf-ac55-fb3c41e092b1" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:25:18 user nova-compute[72418]: DEBUG nova.network.neutron [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:25:18 user nova-compute[72418]: DEBUG nova.network.neutron [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Instance cache missing network info. {{(pid=72418) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 18:25:18 user nova-compute[72418]: DEBUG nova.compute.manager [req-24bca0b8-e5d3-47c2-a4d9-50c3457fc487 req-efef29e4-aaa6-49bd-83be-8e4058f39140 service nova] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Received event network-changed-616dd3b1-68e6-47e9-b7ff-a4b63c3e702f {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:25:18 user nova-compute[72418]: DEBUG nova.compute.manager [req-24bca0b8-e5d3-47c2-a4d9-50c3457fc487 req-efef29e4-aaa6-49bd-83be-8e4058f39140 service nova] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Refreshing instance network info cache due to event network-changed-616dd3b1-68e6-47e9-b7ff-a4b63c3e702f. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:25:18 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-24bca0b8-e5d3-47c2-a4d9-50c3457fc487 req-efef29e4-aaa6-49bd-83be-8e4058f39140 service nova] Acquiring lock "refresh_cache-bd87d56d-3aa5-43cf-ac55-fb3c41e092b1" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:25:18 user nova-compute[72418]: DEBUG nova.compute.manager [req-afe8d7db-4f17-44c5-84c0-8adcde541be5 req-56331980-b7f6-43d7-b609-156d71f688d6 service nova] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Received event network-vif-plugged-ae43991a-cb38-4bb3-ae7e-9c72684dcdd9 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:25:18 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-afe8d7db-4f17-44c5-84c0-8adcde541be5 req-56331980-b7f6-43d7-b609-156d71f688d6 service nova] Acquiring lock "6084e681-01c4-4a6c-beb3-dcda4a990a51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:18 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-afe8d7db-4f17-44c5-84c0-8adcde541be5 req-56331980-b7f6-43d7-b609-156d71f688d6 service nova] Lock "6084e681-01c4-4a6c-beb3-dcda4a990a51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:18 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-afe8d7db-4f17-44c5-84c0-8adcde541be5 req-56331980-b7f6-43d7-b609-156d71f688d6 service nova] Lock "6084e681-01c4-4a6c-beb3-dcda4a990a51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:18 user nova-compute[72418]: DEBUG nova.compute.manager [req-afe8d7db-4f17-44c5-84c0-8adcde541be5 req-56331980-b7f6-43d7-b609-156d71f688d6 service nova] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] No waiting events found dispatching network-vif-plugged-ae43991a-cb38-4bb3-ae7e-9c72684dcdd9 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:25:18 user nova-compute[72418]: WARNING nova.compute.manager [req-afe8d7db-4f17-44c5-84c0-8adcde541be5 req-56331980-b7f6-43d7-b609-156d71f688d6 service nova] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Received unexpected event network-vif-plugged-ae43991a-cb38-4bb3-ae7e-9c72684dcdd9 for instance with vm_state active and task_state deleting.
Aug 09 18:25:18 user nova-compute[72418]: DEBUG nova.compute.manager [req-afe8d7db-4f17-44c5-84c0-8adcde541be5 req-56331980-b7f6-43d7-b609-156d71f688d6 service nova] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Received event network-vif-plugged-ae43991a-cb38-4bb3-ae7e-9c72684dcdd9 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:25:18 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-afe8d7db-4f17-44c5-84c0-8adcde541be5 req-56331980-b7f6-43d7-b609-156d71f688d6 service nova] Acquiring lock "6084e681-01c4-4a6c-beb3-dcda4a990a51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:18 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-afe8d7db-4f17-44c5-84c0-8adcde541be5 req-56331980-b7f6-43d7-b609-156d71f688d6 service nova] Lock "6084e681-01c4-4a6c-beb3-dcda4a990a51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:18 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-afe8d7db-4f17-44c5-84c0-8adcde541be5 req-56331980-b7f6-43d7-b609-156d71f688d6 service nova] Lock "6084e681-01c4-4a6c-beb3-dcda4a990a51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:18 user nova-compute[72418]: DEBUG nova.compute.manager [req-afe8d7db-4f17-44c5-84c0-8adcde541be5 req-56331980-b7f6-43d7-b609-156d71f688d6 service nova] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] No waiting events found dispatching network-vif-plugged-ae43991a-cb38-4bb3-ae7e-9c72684dcdd9 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:25:18 user nova-compute[72418]: WARNING nova.compute.manager [req-afe8d7db-4f17-44c5-84c0-8adcde541be5 req-56331980-b7f6-43d7-b609-156d71f688d6 service nova] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Received unexpected event network-vif-plugged-ae43991a-cb38-4bb3-ae7e-9c72684dcdd9 for instance with vm_state active and task_state deleting.
Aug 09 18:25:18 user nova-compute[72418]: DEBUG nova.compute.manager [req-afe8d7db-4f17-44c5-84c0-8adcde541be5 req-56331980-b7f6-43d7-b609-156d71f688d6 service nova] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Received event network-vif-plugged-ae43991a-cb38-4bb3-ae7e-9c72684dcdd9 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:25:18 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-afe8d7db-4f17-44c5-84c0-8adcde541be5 req-56331980-b7f6-43d7-b609-156d71f688d6 service nova] Acquiring lock "6084e681-01c4-4a6c-beb3-dcda4a990a51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:18 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-afe8d7db-4f17-44c5-84c0-8adcde541be5 req-56331980-b7f6-43d7-b609-156d71f688d6 service nova] Lock "6084e681-01c4-4a6c-beb3-dcda4a990a51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:18 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-afe8d7db-4f17-44c5-84c0-8adcde541be5 req-56331980-b7f6-43d7-b609-156d71f688d6 service nova] Lock "6084e681-01c4-4a6c-beb3-dcda4a990a51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:18 user nova-compute[72418]: DEBUG nova.compute.manager [req-afe8d7db-4f17-44c5-84c0-8adcde541be5 req-56331980-b7f6-43d7-b609-156d71f688d6 service nova] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] No waiting events found dispatching network-vif-plugged-ae43991a-cb38-4bb3-ae7e-9c72684dcdd9 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:25:18 user nova-compute[72418]: WARNING nova.compute.manager [req-afe8d7db-4f17-44c5-84c0-8adcde541be5 req-56331980-b7f6-43d7-b609-156d71f688d6 service nova] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Received unexpected event network-vif-plugged-ae43991a-cb38-4bb3-ae7e-9c72684dcdd9 for instance with vm_state active and task_state deleting.
Aug 09 18:25:18 user nova-compute[72418]: DEBUG nova.compute.manager [req-afe8d7db-4f17-44c5-84c0-8adcde541be5 req-56331980-b7f6-43d7-b609-156d71f688d6 service nova] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Received event network-vif-unplugged-ae43991a-cb38-4bb3-ae7e-9c72684dcdd9 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:25:18 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-afe8d7db-4f17-44c5-84c0-8adcde541be5 req-56331980-b7f6-43d7-b609-156d71f688d6 service nova] Acquiring lock "6084e681-01c4-4a6c-beb3-dcda4a990a51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:18 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-afe8d7db-4f17-44c5-84c0-8adcde541be5 req-56331980-b7f6-43d7-b609-156d71f688d6 service nova] Lock "6084e681-01c4-4a6c-beb3-dcda4a990a51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:18 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-afe8d7db-4f17-44c5-84c0-8adcde541be5 req-56331980-b7f6-43d7-b609-156d71f688d6 service nova] Lock "6084e681-01c4-4a6c-beb3-dcda4a990a51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:18 user nova-compute[72418]: DEBUG nova.compute.manager [req-afe8d7db-4f17-44c5-84c0-8adcde541be5 req-56331980-b7f6-43d7-b609-156d71f688d6 service nova] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] No waiting events found dispatching network-vif-unplugged-ae43991a-cb38-4bb3-ae7e-9c72684dcdd9 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:25:18 user nova-compute[72418]: DEBUG nova.compute.manager [req-afe8d7db-4f17-44c5-84c0-8adcde541be5 req-56331980-b7f6-43d7-b609-156d71f688d6 service nova] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Received event network-vif-unplugged-ae43991a-cb38-4bb3-ae7e-9c72684dcdd9 for instance with task_state deleting. {{(pid=72418) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 18:25:19 user nova-compute[72418]: DEBUG nova.network.neutron [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Updating instance_info_cache with network_info: [{"id": "616dd3b1-68e6-47e9-b7ff-a4b63c3e702f", "address": "fa:16:3e:3a:5d:2f", "network": {"id": "57e1bdad-aad5-47b8-854b-68f3c1375325", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1415993909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f09f1028304efd84f2e694efdae063", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap616dd3b1-68", "ovs_interfaceid": "616dd3b1-68e6-47e9-b7ff-a4b63c3e702f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:25:19 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Releasing lock "refresh_cache-bd87d56d-3aa5-43cf-ac55-fb3c41e092b1" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:25:19 user nova-compute[72418]: DEBUG nova.compute.manager [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Instance network_info: |[{"id": "616dd3b1-68e6-47e9-b7ff-a4b63c3e702f", "address": "fa:16:3e:3a:5d:2f", "network": {"id": "57e1bdad-aad5-47b8-854b-68f3c1375325", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1415993909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f09f1028304efd84f2e694efdae063", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap616dd3b1-68", "ovs_interfaceid": "616dd3b1-68e6-47e9-b7ff-a4b63c3e702f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 18:25:19 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-24bca0b8-e5d3-47c2-a4d9-50c3457fc487 req-efef29e4-aaa6-49bd-83be-8e4058f39140 service nova] Acquired lock "refresh_cache-bd87d56d-3aa5-43cf-ac55-fb3c41e092b1" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:25:19 user nova-compute[72418]: DEBUG nova.network.neutron [req-24bca0b8-e5d3-47c2-a4d9-50c3457fc487 req-efef29e4-aaa6-49bd-83be-8e4058f39140 service nova] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Refreshing network info cache for port 616dd3b1-68e6-47e9-b7ff-a4b63c3e702f {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:25:19 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Start _get_guest_xml network_info=[{"id": "616dd3b1-68e6-47e9-b7ff-a4b63c3e702f", "address": "fa:16:3e:3a:5d:2f", "network": {"id": "57e1bdad-aad5-47b8-854b-68f3c1375325", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1415993909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f09f1028304efd84f2e694efdae063", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap616dd3b1-68", "ovs_interfaceid": "616dd3b1-68e6-47e9-b7ff-a4b63c3e702f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 18:25:19 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:25:19 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:25:19 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 18:25:19 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] CPU controller missing on host. {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 18:25:19 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 18:25:19 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] CPU controller found on host. {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 18:25:19 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72418) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 18:25:19 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T18:17:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 18:25:19 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Flavor limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 18:25:19 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Image limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 18:25:19 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Flavor pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 18:25:19 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Image pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 18:25:19 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 18:25:19 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 18:25:19 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 18:25:19 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Got 1 possible topologies {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 18:25:19 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 18:25:19 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 18:25:19 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:25:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-357261135',display_name='tempest-VolumesAdminNegativeTest-server-357261135',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-357261135',id=15,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5f09f1028304efd84f2e694efdae063',ramdisk_id='',reservation_id='r-aqa08l3v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-612744035',owner_user_name='tempest-VolumesAdminNegativeTest-612744035-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:25:17Z,user_data=None,user_id='3edbabbb69494929a4d671b4113f7753',uuid=bd87d56d-3aa5-43cf-ac55-fb3c41e092b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "616dd3b1-68e6-47e9-b7ff-a4b63c3e702f", "address": "fa:16:3e:3a:5d:2f", "network": {"id": "57e1bdad-aad5-47b8-854b-68f3c1375325", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1415993909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f09f1028304efd84f2e694efdae063", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap616dd3b1-68", "ovs_interfaceid": "616dd3b1-68e6-47e9-b7ff-a4b63c3e702f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:25:19 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Converting VIF {"id": "616dd3b1-68e6-47e9-b7ff-a4b63c3e702f", "address": "fa:16:3e:3a:5d:2f", "network": {"id": "57e1bdad-aad5-47b8-854b-68f3c1375325", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1415993909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f09f1028304efd84f2e694efdae063", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap616dd3b1-68", "ovs_interfaceid": "616dd3b1-68e6-47e9-b7ff-a4b63c3e702f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:25:19 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:5d:2f,bridge_name='br-int',has_traffic_filtering=True,id=616dd3b1-68e6-47e9-b7ff-a4b63c3e702f,network=Network(57e1bdad-aad5-47b8-854b-68f3c1375325),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap616dd3b1-68') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:25:19 user nova-compute[72418]: DEBUG nova.objects.instance [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Lazy-loading 'pci_devices' on Instance uuid bd87d56d-3aa5-43cf-ac55-fb3c41e092b1 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:25:19 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] End _get_guest_xml xml=<domain type="kvm">
Aug 09 18:25:19 user nova-compute[72418]:   <uuid>bd87d56d-3aa5-43cf-ac55-fb3c41e092b1</uuid>
Aug 09 18:25:19 user nova-compute[72418]:   <name>instance-0000000f</name>
Aug 09 18:25:19 user nova-compute[72418]:   <memory>524288</memory>
Aug 09 18:25:19 user nova-compute[72418]:   <vcpu>1</vcpu>
Aug 09 18:25:19 user nova-compute[72418]:   <metadata>
Aug 09 18:25:19 user nova-compute[72418]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:25:19 user nova-compute[72418]:       <nova:package version="0.0.0"/>
Aug 09 18:25:19 user nova-compute[72418]:       <nova:name>tempest-VolumesAdminNegativeTest-server-357261135</nova:name>
Aug 09 18:25:19 user nova-compute[72418]:       <nova:creationTime>2023-08-09 18:25:19</nova:creationTime>
Aug 09 18:25:19 user nova-compute[72418]:       <nova:flavor name="m1.tiny">
Aug 09 18:25:19 user nova-compute[72418]:         <nova:memory>512</nova:memory>
Aug 09 18:25:19 user nova-compute[72418]:         <nova:disk>1</nova:disk>
Aug 09 18:25:19 user nova-compute[72418]:         <nova:swap>0</nova:swap>
Aug 09 18:25:19 user nova-compute[72418]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:25:19 user nova-compute[72418]:         <nova:vcpus>1</nova:vcpus>
Aug 09 18:25:19 user nova-compute[72418]:       </nova:flavor>
Aug 09 18:25:19 user nova-compute[72418]:       <nova:owner>
Aug 09 18:25:19 user nova-compute[72418]:         <nova:user uuid="3edbabbb69494929a4d671b4113f7753">tempest-VolumesAdminNegativeTest-612744035-project-member</nova:user>
Aug 09 18:25:19 user nova-compute[72418]:         <nova:project uuid="b5f09f1028304efd84f2e694efdae063">tempest-VolumesAdminNegativeTest-612744035</nova:project>
Aug 09 18:25:19 user nova-compute[72418]:       </nova:owner>
Aug 09 18:25:19 user nova-compute[72418]:       <nova:root type="image" uuid="8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e"/>
Aug 09 18:25:19 user nova-compute[72418]:       <nova:ports>
Aug 09 18:25:19 user nova-compute[72418]:         <nova:port uuid="616dd3b1-68e6-47e9-b7ff-a4b63c3e702f">
Aug 09 18:25:19 user nova-compute[72418]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 18:25:19 user nova-compute[72418]:         </nova:port>
Aug 09 18:25:19 user nova-compute[72418]:       </nova:ports>
Aug 09 18:25:19 user nova-compute[72418]:     </nova:instance>
Aug 09 18:25:19 user nova-compute[72418]:   </metadata>
Aug 09 18:25:19 user nova-compute[72418]:   <sysinfo type="smbios">
Aug 09 18:25:19 user nova-compute[72418]:     <system>
Aug 09 18:25:19 user nova-compute[72418]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 18:25:19 user nova-compute[72418]:       <entry name="product">OpenStack Nova</entry>
Aug 09 18:25:19 user nova-compute[72418]:       <entry name="version">0.0.0</entry>
Aug 09 18:25:19 user nova-compute[72418]:       <entry name="serial">bd87d56d-3aa5-43cf-ac55-fb3c41e092b1</entry>
Aug 09 18:25:19 user nova-compute[72418]:       <entry name="uuid">bd87d56d-3aa5-43cf-ac55-fb3c41e092b1</entry>
Aug 09 18:25:19 user nova-compute[72418]:       <entry name="family">Virtual Machine</entry>
Aug 09 18:25:19 user nova-compute[72418]:     </system>
Aug 09 18:25:19 user nova-compute[72418]:   </sysinfo>
Aug 09 18:25:19 user nova-compute[72418]:   <os>
Aug 09 18:25:19 user nova-compute[72418]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 18:25:19 user nova-compute[72418]:     <boot dev="hd"/>
Aug 09 18:25:19 user nova-compute[72418]:     <smbios mode="sysinfo"/>
Aug 09 18:25:19 user nova-compute[72418]:   </os>
Aug 09 18:25:19 user nova-compute[72418]:   <features>
Aug 09 18:25:19 user nova-compute[72418]:     <acpi/>
Aug 09 18:25:19 user nova-compute[72418]:     <apic/>
Aug 09 18:25:19 user nova-compute[72418]:     <vmcoreinfo/>
Aug 09 18:25:19 user nova-compute[72418]:   </features>
Aug 09 18:25:19 user nova-compute[72418]:   <clock offset="utc">
Aug 09 18:25:19 user nova-compute[72418]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 18:25:19 user nova-compute[72418]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 18:25:19 user nova-compute[72418]:     <timer name="hpet" present="no"/>
Aug 09 18:25:19 user nova-compute[72418]:   </clock>
Aug 09 18:25:19 user nova-compute[72418]:   <cpu mode="custom" match="exact">
Aug 09 18:25:19 user nova-compute[72418]:     <model>Nehalem</model>
Aug 09 18:25:19 user nova-compute[72418]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 18:25:19 user nova-compute[72418]:   </cpu>
Aug 09 18:25:19 user nova-compute[72418]:   <devices>
Aug 09 18:25:19 user nova-compute[72418]:     <disk type="file" device="disk">
Aug 09 18:25:19 user nova-compute[72418]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 18:25:19 user nova-compute[72418]:       <source file="/opt/stack/data/nova/instances/bd87d56d-3aa5-43cf-ac55-fb3c41e092b1/disk"/>
Aug 09 18:25:19 user nova-compute[72418]:       <target dev="vda" bus="virtio"/>
Aug 09 18:25:19 user nova-compute[72418]:     </disk>
Aug 09 18:25:19 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:25:19 user nova-compute[72418]:       <mac address="fa:16:3e:3a:5d:2f"/>
Aug 09 18:25:19 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:25:19 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:25:19 user nova-compute[72418]:       <target dev="tap616dd3b1-68"/>
Aug 09 18:25:19 user nova-compute[72418]:     </interface>
Aug 09 18:25:19 user nova-compute[72418]:     <serial type="pty">
Aug 09 18:25:19 user nova-compute[72418]:       <log file="/opt/stack/data/nova/instances/bd87d56d-3aa5-43cf-ac55-fb3c41e092b1/console.log" append="off"/>
Aug 09 18:25:19 user nova-compute[72418]:     </serial>
Aug 09 18:25:19 user nova-compute[72418]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 18:25:19 user nova-compute[72418]:     <video>
Aug 09 18:25:19 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:25:19 user nova-compute[72418]:     </video>
Aug 09 18:25:19 user nova-compute[72418]:     <rng model="virtio">
Aug 09 18:25:19 user nova-compute[72418]:       <backend model="random">/dev/urandom</backend>
Aug 09 18:25:19 user nova-compute[72418]:     </rng>
Aug 09 18:25:19 user nova-compute[72418]:     <controller type="usb" index="0" model="none"/>
Aug 09 18:25:19 user nova-compute[72418]:     <memballoon model="virtio">
Aug 09 18:25:19 user nova-compute[72418]:       <stats period="10"/>
Aug 09 18:25:19 user nova-compute[72418]:     </memballoon>
Aug 09 18:25:19 user nova-compute[72418]:   </devices>
Aug 09 18:25:19 user nova-compute[72418]: </domain>
Aug 09 18:25:19 user nova-compute[72418]:  {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 18:25:19 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:25:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-357261135',display_name='tempest-VolumesAdminNegativeTest-server-357261135',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-357261135',id=15,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5f09f1028304efd84f2e694efdae063',ramdisk_id='',reservation_id='r-aqa08l3v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-612744035',owner_user_name='tempest-VolumesAdminNegativeTest-612744035-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:25:17Z,user_data=None,user_id='3edbabbb69494929a4d671b4113f7753',uuid=bd87d56d-3aa5-43cf-ac55-fb3c41e092b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "616dd3b1-68e6-47e9-b7ff-a4b63c3e702f", "address": "fa:16:3e:3a:5d:2f", "network": {"id": "57e1bdad-aad5-47b8-854b-68f3c1375325", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1415993909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f09f1028304efd84f2e694efdae063", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap616dd3b1-68", "ovs_interfaceid": "616dd3b1-68e6-47e9-b7ff-a4b63c3e702f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:25:19 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Converting VIF {"id": "616dd3b1-68e6-47e9-b7ff-a4b63c3e702f", "address": "fa:16:3e:3a:5d:2f", "network": {"id": "57e1bdad-aad5-47b8-854b-68f3c1375325", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1415993909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f09f1028304efd84f2e694efdae063", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap616dd3b1-68", "ovs_interfaceid": "616dd3b1-68e6-47e9-b7ff-a4b63c3e702f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:25:19 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:5d:2f,bridge_name='br-int',has_traffic_filtering=True,id=616dd3b1-68e6-47e9-b7ff-a4b63c3e702f,network=Network(57e1bdad-aad5-47b8-854b-68f3c1375325),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap616dd3b1-68') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:25:19 user nova-compute[72418]: DEBUG os_vif [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:5d:2f,bridge_name='br-int',has_traffic_filtering=True,id=616dd3b1-68e6-47e9-b7ff-a4b63c3e702f,network=Network(57e1bdad-aad5-47b8-854b-68f3c1375325),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap616dd3b1-68') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:25:19 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:19 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:25:19 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:25:19 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:19 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap616dd3b1-68, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:25:19 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap616dd3b1-68, col_values=(('external_ids', {'iface-id': '616dd3b1-68e6-47e9-b7ff-a4b63c3e702f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:5d:2f', 'vm-uuid': 'bd87d56d-3aa5-43cf-ac55-fb3c41e092b1'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:25:19 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:19 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:25:19 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:19 user nova-compute[72418]: INFO os_vif [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:5d:2f,bridge_name='br-int',has_traffic_filtering=True,id=616dd3b1-68e6-47e9-b7ff-a4b63c3e702f,network=Network(57e1bdad-aad5-47b8-854b-68f3c1375325),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap616dd3b1-68')
Aug 09 18:25:19 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:25:19 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] No VIF found with MAC fa:16:3e:3a:5d:2f, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:25:19 user nova-compute[72418]: DEBUG nova.network.neutron [req-24bca0b8-e5d3-47c2-a4d9-50c3457fc487 req-efef29e4-aaa6-49bd-83be-8e4058f39140 service nova] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Updated VIF entry in instance network info cache for port 616dd3b1-68e6-47e9-b7ff-a4b63c3e702f. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:25:19 user nova-compute[72418]: DEBUG nova.network.neutron [req-24bca0b8-e5d3-47c2-a4d9-50c3457fc487 req-efef29e4-aaa6-49bd-83be-8e4058f39140 service nova] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Updating instance_info_cache with network_info: [{"id": "616dd3b1-68e6-47e9-b7ff-a4b63c3e702f", "address": "fa:16:3e:3a:5d:2f", "network": {"id": "57e1bdad-aad5-47b8-854b-68f3c1375325", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1415993909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f09f1028304efd84f2e694efdae063", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap616dd3b1-68", "ovs_interfaceid": "616dd3b1-68e6-47e9-b7ff-a4b63c3e702f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:25:19 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-24bca0b8-e5d3-47c2-a4d9-50c3457fc487 req-efef29e4-aaa6-49bd-83be-8e4058f39140 service nova] Releasing lock "refresh_cache-bd87d56d-3aa5-43cf-ac55-fb3c41e092b1" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:25:19 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:25:19 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Took 2.48 seconds to deallocate network for instance.
Aug 09 18:25:20 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-289ebf6e-caec-4a43-99ac-ba9f6431bb35 tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:20 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-289ebf6e-caec-4a43-99ac-ba9f6431bb35 tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:20 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-289ebf6e-caec-4a43-99ac-ba9f6431bb35 tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:25:20 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-289ebf6e-caec-4a43-99ac-ba9f6431bb35 tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:25:20 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-289ebf6e-caec-4a43-99ac-ba9f6431bb35 tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.455s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:20 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Acquiring lock "e07beace-59d8-4c02-844b-1db1a6e81198" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:20 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "e07beace-59d8-4c02-844b-1db1a6e81198" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:20 user nova-compute[72418]: DEBUG nova.compute.manager [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Starting instance... {{(pid=72418) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 18:25:20 user nova-compute[72418]: INFO nova.scheduler.client.report [None req-289ebf6e-caec-4a43-99ac-ba9f6431bb35 tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Deleted allocations for instance 6084e681-01c4-4a6c-beb3-dcda4a990a51
Aug 09 18:25:20 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:20 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:20 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:20 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:20 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72418) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 18:25:20 user nova-compute[72418]: INFO nova.compute.claims [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Claim successful on node user
Aug 09 18:25:20 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:20 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:20 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-289ebf6e-caec-4a43-99ac-ba9f6431bb35 tempest-VolumesAssistedSnapshotsTest-917954092 tempest-VolumesAssistedSnapshotsTest-917954092-project-member] Lock "6084e681-01c4-4a6c-beb3-dcda4a990a51" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.349s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:20 user nova-compute[72418]: DEBUG nova.compute.manager [req-c6e196f0-92ad-448b-8b36-0d1037d68521 req-4042b120-f4c4-4714-81a2-6596d5f2a44c service nova] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Received event network-vif-plugged-616dd3b1-68e6-47e9-b7ff-a4b63c3e702f {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:25:20 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-c6e196f0-92ad-448b-8b36-0d1037d68521 req-4042b120-f4c4-4714-81a2-6596d5f2a44c service nova] Acquiring lock "bd87d56d-3aa5-43cf-ac55-fb3c41e092b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:20 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-c6e196f0-92ad-448b-8b36-0d1037d68521 req-4042b120-f4c4-4714-81a2-6596d5f2a44c service nova] Lock "bd87d56d-3aa5-43cf-ac55-fb3c41e092b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:20 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-c6e196f0-92ad-448b-8b36-0d1037d68521 req-4042b120-f4c4-4714-81a2-6596d5f2a44c service nova] Lock "bd87d56d-3aa5-43cf-ac55-fb3c41e092b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:20 user nova-compute[72418]: DEBUG nova.compute.manager [req-c6e196f0-92ad-448b-8b36-0d1037d68521 req-4042b120-f4c4-4714-81a2-6596d5f2a44c service nova] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] No waiting events found dispatching network-vif-plugged-616dd3b1-68e6-47e9-b7ff-a4b63c3e702f {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:25:20 user nova-compute[72418]: WARNING nova.compute.manager [req-c6e196f0-92ad-448b-8b36-0d1037d68521 req-4042b120-f4c4-4714-81a2-6596d5f2a44c service nova] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Received unexpected event network-vif-plugged-616dd3b1-68e6-47e9-b7ff-a4b63c3e702f for instance with vm_state building and task_state spawning.
Aug 09 18:25:20 user nova-compute[72418]: DEBUG nova.compute.manager [req-1db7f362-8cab-4fd8-a7b5-d360faaf3756 req-1666a638-3c75-4d2d-b255-979efcef0772 service nova] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Received event network-vif-plugged-ae43991a-cb38-4bb3-ae7e-9c72684dcdd9 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:25:20 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-1db7f362-8cab-4fd8-a7b5-d360faaf3756 req-1666a638-3c75-4d2d-b255-979efcef0772 service nova] Acquiring lock "6084e681-01c4-4a6c-beb3-dcda4a990a51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:20 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-1db7f362-8cab-4fd8-a7b5-d360faaf3756 req-1666a638-3c75-4d2d-b255-979efcef0772 service nova] Lock "6084e681-01c4-4a6c-beb3-dcda4a990a51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:20 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-1db7f362-8cab-4fd8-a7b5-d360faaf3756 req-1666a638-3c75-4d2d-b255-979efcef0772 service nova] Lock "6084e681-01c4-4a6c-beb3-dcda4a990a51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:20 user nova-compute[72418]: DEBUG nova.compute.manager [req-1db7f362-8cab-4fd8-a7b5-d360faaf3756 req-1666a638-3c75-4d2d-b255-979efcef0772 service nova] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] No waiting events found dispatching network-vif-plugged-ae43991a-cb38-4bb3-ae7e-9c72684dcdd9 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:25:20 user nova-compute[72418]: WARNING nova.compute.manager [req-1db7f362-8cab-4fd8-a7b5-d360faaf3756 req-1666a638-3c75-4d2d-b255-979efcef0772 service nova] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Received unexpected event network-vif-plugged-ae43991a-cb38-4bb3-ae7e-9c72684dcdd9 for instance with vm_state deleted and task_state None.
Aug 09 18:25:20 user nova-compute[72418]: DEBUG nova.compute.manager [req-1db7f362-8cab-4fd8-a7b5-d360faaf3756 req-1666a638-3c75-4d2d-b255-979efcef0772 service nova] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Received event network-vif-deleted-ae43991a-cb38-4bb3-ae7e-9c72684dcdd9 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:25:20 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:20 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:21 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:25:21 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:25:21 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.593s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:21 user nova-compute[72418]: DEBUG nova.compute.manager [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Start building networks asynchronously for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 18:25:21 user nova-compute[72418]: DEBUG nova.compute.manager [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Allocating IP information in the background. {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 18:25:21 user nova-compute[72418]: DEBUG nova.network.neutron [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] allocate_for_instance() {{(pid=72418) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 18:25:21 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 18:25:21 user nova-compute[72418]: DEBUG nova.compute.manager [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Start building block device mappings for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 18:25:21 user nova-compute[72418]: DEBUG nova.policy [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '236307357ebf43bc8150f86f832260ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5242fb37f9664dbf9a8b50449f8dd129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72418) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 18:25:21 user nova-compute[72418]: DEBUG nova.compute.manager [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Start spawning the instance on the hypervisor. {{(pid=72418) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 18:25:21 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Creating instance directory {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 18:25:21 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Creating image(s)
Aug 09 18:25:21 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Acquiring lock "/opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:21 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "/opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:21 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "/opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:21 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:21 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.135s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:21 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Acquiring lock "458773cfa7230b717e41c60277832e9f83806d71" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:21 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:21 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:21 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.143s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:21 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk 1073741824 {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:21 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk 1073741824" returned: 0 in 0.054s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:21 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:21 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:21 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.166s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:21 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk. size=1073741824 {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 18:25:21 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:22 user nova-compute[72418]: DEBUG nova.network.neutron [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Successfully created port: 301d9f8c-022d-4c02-90dd-374ead3daa23 {{(pid=72418) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 18:25:22 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:22 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Cannot resize image /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk to a smaller size. {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 18:25:22 user nova-compute[72418]: DEBUG nova.objects.instance [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lazy-loading 'migration_context' on Instance uuid e07beace-59d8-4c02-844b-1db1a6e81198 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:25:22 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Created local disks {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 18:25:22 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Ensure instance console log exists: /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/console.log {{(pid=72418) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 18:25:22 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:22 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:22 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:22 user nova-compute[72418]: DEBUG nova.compute.manager [req-c826f28f-9ff4-40b0-ad54-ca764ad584e9 req-83fcc8e0-cb44-405a-a7a7-5af8e5ce214c service nova] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Received event network-changed-c634ea3f-4db3-4c0f-ac00-42c822c095ab {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:25:22 user nova-compute[72418]: DEBUG nova.compute.manager [req-c826f28f-9ff4-40b0-ad54-ca764ad584e9 req-83fcc8e0-cb44-405a-a7a7-5af8e5ce214c service nova] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Refreshing instance network info cache due to event network-changed-c634ea3f-4db3-4c0f-ac00-42c822c095ab. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:25:22 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-c826f28f-9ff4-40b0-ad54-ca764ad584e9 req-83fcc8e0-cb44-405a-a7a7-5af8e5ce214c service nova] Acquiring lock "refresh_cache-28dad451-f27e-4c62-8353-e3b89e0196cd" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:25:22 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-c826f28f-9ff4-40b0-ad54-ca764ad584e9 req-83fcc8e0-cb44-405a-a7a7-5af8e5ce214c service nova] Acquired lock "refresh_cache-28dad451-f27e-4c62-8353-e3b89e0196cd" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:25:22 user nova-compute[72418]: DEBUG nova.network.neutron [req-c826f28f-9ff4-40b0-ad54-ca764ad584e9 req-83fcc8e0-cb44-405a-a7a7-5af8e5ce214c service nova] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Refreshing network info cache for port c634ea3f-4db3-4c0f-ac00-42c822c095ab {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:25:22 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:22 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605522.8551328, bd87d56d-3aa5-43cf-ac55-fb3c41e092b1 => Resumed> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:25:22 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] VM Resumed (Lifecycle Event)
Aug 09 18:25:22 user nova-compute[72418]: DEBUG nova.compute.manager [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Instance event wait completed in 0 seconds for  {{(pid=72418) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 18:25:22 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Guest created on hypervisor {{(pid=72418) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 18:25:22 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Instance spawned successfully.
Aug 09 18:25:22 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 18:25:22 user nova-compute[72418]: DEBUG nova.compute.manager [req-05b01955-cc87-4669-a0a8-a064826dc7d9 req-dcc7a000-5f2c-4b26-905f-eceb79c97ef2 service nova] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Received event network-vif-plugged-616dd3b1-68e6-47e9-b7ff-a4b63c3e702f {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:25:22 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-05b01955-cc87-4669-a0a8-a064826dc7d9 req-dcc7a000-5f2c-4b26-905f-eceb79c97ef2 service nova] Acquiring lock "bd87d56d-3aa5-43cf-ac55-fb3c41e092b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:22 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-05b01955-cc87-4669-a0a8-a064826dc7d9 req-dcc7a000-5f2c-4b26-905f-eceb79c97ef2 service nova] Lock "bd87d56d-3aa5-43cf-ac55-fb3c41e092b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:22 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-05b01955-cc87-4669-a0a8-a064826dc7d9 req-dcc7a000-5f2c-4b26-905f-eceb79c97ef2 service nova] Lock "bd87d56d-3aa5-43cf-ac55-fb3c41e092b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:22 user nova-compute[72418]: DEBUG nova.compute.manager [req-05b01955-cc87-4669-a0a8-a064826dc7d9 req-dcc7a000-5f2c-4b26-905f-eceb79c97ef2 service nova] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] No waiting events found dispatching network-vif-plugged-616dd3b1-68e6-47e9-b7ff-a4b63c3e702f {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:25:22 user nova-compute[72418]: WARNING nova.compute.manager [req-05b01955-cc87-4669-a0a8-a064826dc7d9 req-dcc7a000-5f2c-4b26-905f-eceb79c97ef2 service nova] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Received unexpected event network-vif-plugged-616dd3b1-68e6-47e9-b7ff-a4b63c3e702f for instance with vm_state building and task_state spawning.
Aug 09 18:25:22 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:25:22 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:25:22 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Found default for hw_cdrom_bus of ide {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:25:22 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Found default for hw_disk_bus of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:25:22 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Found default for hw_input_bus of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:25:22 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Found default for hw_pointer_model of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:25:22 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Found default for hw_video_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:25:22 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Found default for hw_vif_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:25:22 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:25:22 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605522.864066, bd87d56d-3aa5-43cf-ac55-fb3c41e092b1 => Started> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:25:22 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] VM Started (Lifecycle Event)
Aug 09 18:25:22 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:25:22 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:25:23 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:25:23 user nova-compute[72418]: INFO nova.compute.manager [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Took 6.06 seconds to spawn the instance on the hypervisor.
Aug 09 18:25:23 user nova-compute[72418]: DEBUG nova.compute.manager [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:25:23 user nova-compute[72418]: DEBUG nova.network.neutron [req-c826f28f-9ff4-40b0-ad54-ca764ad584e9 req-83fcc8e0-cb44-405a-a7a7-5af8e5ce214c service nova] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Updated VIF entry in instance network info cache for port c634ea3f-4db3-4c0f-ac00-42c822c095ab. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:25:23 user nova-compute[72418]: DEBUG nova.network.neutron [req-c826f28f-9ff4-40b0-ad54-ca764ad584e9 req-83fcc8e0-cb44-405a-a7a7-5af8e5ce214c service nova] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Updating instance_info_cache with network_info: [{"id": "c634ea3f-4db3-4c0f-ac00-42c822c095ab", "address": "fa:16:3e:27:2e:34", "network": {"id": "cdf92d6c-8d60-4947-b73b-38686728c14e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2096407534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9c2418c1ed345928b81431d728f2650", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc634ea3f-4d", "ovs_interfaceid": "c634ea3f-4db3-4c0f-ac00-42c822c095ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:25:23 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-c826f28f-9ff4-40b0-ad54-ca764ad584e9 req-83fcc8e0-cb44-405a-a7a7-5af8e5ce214c service nova] Releasing lock "refresh_cache-28dad451-f27e-4c62-8353-e3b89e0196cd" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:25:23 user nova-compute[72418]: INFO nova.compute.manager [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Took 7.45 seconds to build instance.
Aug 09 18:25:23 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-78bc6989-9958-428a-94bb-d2f6cffdb0c4 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Lock "bd87d56d-3aa5-43cf-ac55-fb3c41e092b1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.600s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:23 user nova-compute[72418]: DEBUG nova.network.neutron [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Successfully updated port: 301d9f8c-022d-4c02-90dd-374ead3daa23 {{(pid=72418) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 18:25:23 user nova-compute[72418]: DEBUG nova.compute.manager [req-cb8fb60d-0612-4b0e-a191-23346c9269f4 req-0d40f7f8-1b5b-436b-b34f-a88aff7821c9 service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Received event network-changed-301d9f8c-022d-4c02-90dd-374ead3daa23 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:25:23 user nova-compute[72418]: DEBUG nova.compute.manager [req-cb8fb60d-0612-4b0e-a191-23346c9269f4 req-0d40f7f8-1b5b-436b-b34f-a88aff7821c9 service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Refreshing instance network info cache due to event network-changed-301d9f8c-022d-4c02-90dd-374ead3daa23. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:25:23 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-cb8fb60d-0612-4b0e-a191-23346c9269f4 req-0d40f7f8-1b5b-436b-b34f-a88aff7821c9 service nova] Acquiring lock "refresh_cache-e07beace-59d8-4c02-844b-1db1a6e81198" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:25:23 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-cb8fb60d-0612-4b0e-a191-23346c9269f4 req-0d40f7f8-1b5b-436b-b34f-a88aff7821c9 service nova] Acquired lock "refresh_cache-e07beace-59d8-4c02-844b-1db1a6e81198" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:25:23 user nova-compute[72418]: DEBUG nova.network.neutron [req-cb8fb60d-0612-4b0e-a191-23346c9269f4 req-0d40f7f8-1b5b-436b-b34f-a88aff7821c9 service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Refreshing network info cache for port 301d9f8c-022d-4c02-90dd-374ead3daa23 {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:25:23 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Acquiring lock "refresh_cache-e07beace-59d8-4c02-844b-1db1a6e81198" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:25:23 user nova-compute[72418]: DEBUG nova.network.neutron [req-cb8fb60d-0612-4b0e-a191-23346c9269f4 req-0d40f7f8-1b5b-436b-b34f-a88aff7821c9 service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Instance cache missing network info. {{(pid=72418) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 18:25:23 user nova-compute[72418]: DEBUG nova.network.neutron [req-cb8fb60d-0612-4b0e-a191-23346c9269f4 req-0d40f7f8-1b5b-436b-b34f-a88aff7821c9 service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:25:23 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-cb8fb60d-0612-4b0e-a191-23346c9269f4 req-0d40f7f8-1b5b-436b-b34f-a88aff7821c9 service nova] Releasing lock "refresh_cache-e07beace-59d8-4c02-844b-1db1a6e81198" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:25:23 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Acquired lock "refresh_cache-e07beace-59d8-4c02-844b-1db1a6e81198" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:25:23 user nova-compute[72418]: DEBUG nova.network.neutron [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:25:23 user nova-compute[72418]: DEBUG nova.network.neutron [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Instance cache missing network info. {{(pid=72418) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 18:25:23 user nova-compute[72418]: DEBUG nova.network.neutron [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Updating instance_info_cache with network_info: [{"id": "301d9f8c-022d-4c02-90dd-374ead3daa23", "address": "fa:16:3e:a6:38:d9", "network": {"id": "7621f03d-76ac-49da-89a8-0753bb11e329", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596253708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5242fb37f9664dbf9a8b50449f8dd129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap301d9f8c-02", "ovs_interfaceid": "301d9f8c-022d-4c02-90dd-374ead3daa23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:25:23 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Releasing lock "refresh_cache-e07beace-59d8-4c02-844b-1db1a6e81198" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:25:23 user nova-compute[72418]: DEBUG nova.compute.manager [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Instance network_info: |[{"id": "301d9f8c-022d-4c02-90dd-374ead3daa23", "address": "fa:16:3e:a6:38:d9", "network": {"id": "7621f03d-76ac-49da-89a8-0753bb11e329", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596253708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5242fb37f9664dbf9a8b50449f8dd129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap301d9f8c-02", "ovs_interfaceid": "301d9f8c-022d-4c02-90dd-374ead3daa23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 18:25:23 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Start _get_guest_xml network_info=[{"id": "301d9f8c-022d-4c02-90dd-374ead3daa23", "address": "fa:16:3e:a6:38:d9", "network": {"id": "7621f03d-76ac-49da-89a8-0753bb11e329", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596253708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5242fb37f9664dbf9a8b50449f8dd129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap301d9f8c-02", "ovs_interfaceid": "301d9f8c-022d-4c02-90dd-374ead3daa23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 18:25:23 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:25:23 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:25:23 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 18:25:23 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] CPU controller missing on host. {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 18:25:24 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 18:25:24 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] CPU controller found on host. {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 18:25:24 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72418) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 18:25:24 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T18:17:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 18:25:24 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Flavor limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 18:25:24 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Image limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 18:25:24 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Flavor pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 18:25:24 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Image pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 18:25:24 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 18:25:24 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 18:25:24 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 18:25:24 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Got 1 possible topologies {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 18:25:24 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 18:25:24 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 18:25:24 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:25:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-115156542',display_name='tempest-AttachVolumeTestJSON-server-115156542',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-115156542',id=16,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKIZ6czeitZd68FtX30D3PEurZKgjyFnUFrxFwHkysLhaffrzQKQu80qXZZAnkUayD+bRR0naGJJ9tbYqVXNcVqacPFRuWh7mU4dCbsXBHxDBemAgqD4XDp+3Jf6xUihXw==',key_name='tempest-keypair-957533556',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5242fb37f9664dbf9a8b50449f8dd129',ramdisk_id='',reservation_id='r-8u61z3zg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1480837700',owner_user_name='tempest-AttachVolumeTestJSON-1480837700-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:25:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='236307357ebf43bc8150f86f832260ba',uuid=e07beace-59d8-4c02-844b-1db1a6e81198,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "301d9f8c-022d-4c02-90dd-374ead3daa23", "address": "fa:16:3e:a6:38:d9", "network": {"id": "7621f03d-76ac-49da-89a8-0753bb11e329", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596253708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5242fb37f9664dbf9a8b50449f8dd129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap301d9f8c-02", "ovs_interfaceid": "301d9f8c-022d-4c02-90dd-374ead3daa23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:25:24 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Converting VIF {"id": "301d9f8c-022d-4c02-90dd-374ead3daa23", "address": "fa:16:3e:a6:38:d9", "network": {"id": "7621f03d-76ac-49da-89a8-0753bb11e329", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596253708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5242fb37f9664dbf9a8b50449f8dd129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap301d9f8c-02", "ovs_interfaceid": "301d9f8c-022d-4c02-90dd-374ead3daa23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:25:24 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:38:d9,bridge_name='br-int',has_traffic_filtering=True,id=301d9f8c-022d-4c02-90dd-374ead3daa23,network=Network(7621f03d-76ac-49da-89a8-0753bb11e329),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap301d9f8c-02') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:25:24 user nova-compute[72418]: DEBUG nova.objects.instance [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lazy-loading 'pci_devices' on Instance uuid e07beace-59d8-4c02-844b-1db1a6e81198 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:25:24 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] End _get_guest_xml xml=<domain type="kvm">
Aug 09 18:25:24 user nova-compute[72418]:   <uuid>e07beace-59d8-4c02-844b-1db1a6e81198</uuid>
Aug 09 18:25:24 user nova-compute[72418]:   <name>instance-00000010</name>
Aug 09 18:25:24 user nova-compute[72418]:   <memory>524288</memory>
Aug 09 18:25:24 user nova-compute[72418]:   <vcpu>1</vcpu>
Aug 09 18:25:24 user nova-compute[72418]:   <metadata>
Aug 09 18:25:24 user nova-compute[72418]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:25:24 user nova-compute[72418]:       <nova:package version="0.0.0"/>
Aug 09 18:25:24 user nova-compute[72418]:       <nova:name>tempest-AttachVolumeTestJSON-server-115156542</nova:name>
Aug 09 18:25:24 user nova-compute[72418]:       <nova:creationTime>2023-08-09 18:25:23</nova:creationTime>
Aug 09 18:25:24 user nova-compute[72418]:       <nova:flavor name="m1.tiny">
Aug 09 18:25:24 user nova-compute[72418]:         <nova:memory>512</nova:memory>
Aug 09 18:25:24 user nova-compute[72418]:         <nova:disk>1</nova:disk>
Aug 09 18:25:24 user nova-compute[72418]:         <nova:swap>0</nova:swap>
Aug 09 18:25:24 user nova-compute[72418]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:25:24 user nova-compute[72418]:         <nova:vcpus>1</nova:vcpus>
Aug 09 18:25:24 user nova-compute[72418]:       </nova:flavor>
Aug 09 18:25:24 user nova-compute[72418]:       <nova:owner>
Aug 09 18:25:24 user nova-compute[72418]:         <nova:user uuid="236307357ebf43bc8150f86f832260ba">tempest-AttachVolumeTestJSON-1480837700-project-member</nova:user>
Aug 09 18:25:24 user nova-compute[72418]:         <nova:project uuid="5242fb37f9664dbf9a8b50449f8dd129">tempest-AttachVolumeTestJSON-1480837700</nova:project>
Aug 09 18:25:24 user nova-compute[72418]:       </nova:owner>
Aug 09 18:25:24 user nova-compute[72418]:       <nova:root type="image" uuid="8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e"/>
Aug 09 18:25:24 user nova-compute[72418]:       <nova:ports>
Aug 09 18:25:24 user nova-compute[72418]:         <nova:port uuid="301d9f8c-022d-4c02-90dd-374ead3daa23">
Aug 09 18:25:24 user nova-compute[72418]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 09 18:25:24 user nova-compute[72418]:         </nova:port>
Aug 09 18:25:24 user nova-compute[72418]:       </nova:ports>
Aug 09 18:25:24 user nova-compute[72418]:     </nova:instance>
Aug 09 18:25:24 user nova-compute[72418]:   </metadata>
Aug 09 18:25:24 user nova-compute[72418]:   <sysinfo type="smbios">
Aug 09 18:25:24 user nova-compute[72418]:     <system>
Aug 09 18:25:24 user nova-compute[72418]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 18:25:24 user nova-compute[72418]:       <entry name="product">OpenStack Nova</entry>
Aug 09 18:25:24 user nova-compute[72418]:       <entry name="version">0.0.0</entry>
Aug 09 18:25:24 user nova-compute[72418]:       <entry name="serial">e07beace-59d8-4c02-844b-1db1a6e81198</entry>
Aug 09 18:25:24 user nova-compute[72418]:       <entry name="uuid">e07beace-59d8-4c02-844b-1db1a6e81198</entry>
Aug 09 18:25:24 user nova-compute[72418]:       <entry name="family">Virtual Machine</entry>
Aug 09 18:25:24 user nova-compute[72418]:     </system>
Aug 09 18:25:24 user nova-compute[72418]:   </sysinfo>
Aug 09 18:25:24 user nova-compute[72418]:   <os>
Aug 09 18:25:24 user nova-compute[72418]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 18:25:24 user nova-compute[72418]:     <boot dev="hd"/>
Aug 09 18:25:24 user nova-compute[72418]:     <smbios mode="sysinfo"/>
Aug 09 18:25:24 user nova-compute[72418]:   </os>
Aug 09 18:25:24 user nova-compute[72418]:   <features>
Aug 09 18:25:24 user nova-compute[72418]:     <acpi/>
Aug 09 18:25:24 user nova-compute[72418]:     <apic/>
Aug 09 18:25:24 user nova-compute[72418]:     <vmcoreinfo/>
Aug 09 18:25:24 user nova-compute[72418]:   </features>
Aug 09 18:25:24 user nova-compute[72418]:   <clock offset="utc">
Aug 09 18:25:24 user nova-compute[72418]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 18:25:24 user nova-compute[72418]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 18:25:24 user nova-compute[72418]:     <timer name="hpet" present="no"/>
Aug 09 18:25:24 user nova-compute[72418]:   </clock>
Aug 09 18:25:24 user nova-compute[72418]:   <cpu mode="custom" match="exact">
Aug 09 18:25:24 user nova-compute[72418]:     <model>Nehalem</model>
Aug 09 18:25:24 user nova-compute[72418]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 18:25:24 user nova-compute[72418]:   </cpu>
Aug 09 18:25:24 user nova-compute[72418]:   <devices>
Aug 09 18:25:24 user nova-compute[72418]:     <disk type="file" device="disk">
Aug 09 18:25:24 user nova-compute[72418]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 18:25:24 user nova-compute[72418]:       <source file="/opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk"/>
Aug 09 18:25:24 user nova-compute[72418]:       <target dev="vda" bus="virtio"/>
Aug 09 18:25:24 user nova-compute[72418]:     </disk>
Aug 09 18:25:24 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:25:24 user nova-compute[72418]:       <mac address="fa:16:3e:a6:38:d9"/>
Aug 09 18:25:24 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:25:24 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:25:24 user nova-compute[72418]:       <target dev="tap301d9f8c-02"/>
Aug 09 18:25:24 user nova-compute[72418]:     </interface>
Aug 09 18:25:24 user nova-compute[72418]:     <serial type="pty">
Aug 09 18:25:24 user nova-compute[72418]:       <log file="/opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/console.log" append="off"/>
Aug 09 18:25:24 user nova-compute[72418]:     </serial>
Aug 09 18:25:24 user nova-compute[72418]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 18:25:24 user nova-compute[72418]:     <video>
Aug 09 18:25:24 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:25:24 user nova-compute[72418]:     </video>
Aug 09 18:25:24 user nova-compute[72418]:     <rng model="virtio">
Aug 09 18:25:24 user nova-compute[72418]:       <backend model="random">/dev/urandom</backend>
Aug 09 18:25:24 user nova-compute[72418]:     </rng>
Aug 09 18:25:24 user nova-compute[72418]:     <controller type="usb" index="0" model="none"/>
Aug 09 18:25:24 user nova-compute[72418]:     <memballoon model="virtio">
Aug 09 18:25:24 user nova-compute[72418]:       <stats period="10"/>
Aug 09 18:25:24 user nova-compute[72418]:     </memballoon>
Aug 09 18:25:24 user nova-compute[72418]:   </devices>
Aug 09 18:25:24 user nova-compute[72418]: </domain>
Aug 09 18:25:24 user nova-compute[72418]:  {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 18:25:24 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:25:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-115156542',display_name='tempest-AttachVolumeTestJSON-server-115156542',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-115156542',id=16,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKIZ6czeitZd68FtX30D3PEurZKgjyFnUFrxFwHkysLhaffrzQKQu80qXZZAnkUayD+bRR0naGJJ9tbYqVXNcVqacPFRuWh7mU4dCbsXBHxDBemAgqD4XDp+3Jf6xUihXw==',key_name='tempest-keypair-957533556',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5242fb37f9664dbf9a8b50449f8dd129',ramdisk_id='',reservation_id='r-8u61z3zg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1480837700',owner_user_name='tempest-AttachVolumeTestJSON-1480837700-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:25:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='236307357ebf43bc8150f86f832260ba',uuid=e07beace-59d8-4c02-844b-1db1a6e81198,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "301d9f8c-022d-4c02-90dd-374ead3daa23", "address": "fa:16:3e:a6:38:d9", "network": {"id": "7621f03d-76ac-49da-89a8-0753bb11e329", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596253708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5242fb37f9664dbf9a8b50449f8dd129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap301d9f8c-02", "ovs_interfaceid": "301d9f8c-022d-4c02-90dd-374ead3daa23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:25:24 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Converting VIF {"id": "301d9f8c-022d-4c02-90dd-374ead3daa23", "address": "fa:16:3e:a6:38:d9", "network": {"id": "7621f03d-76ac-49da-89a8-0753bb11e329", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596253708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5242fb37f9664dbf9a8b50449f8dd129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap301d9f8c-02", "ovs_interfaceid": "301d9f8c-022d-4c02-90dd-374ead3daa23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:25:24 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:38:d9,bridge_name='br-int',has_traffic_filtering=True,id=301d9f8c-022d-4c02-90dd-374ead3daa23,network=Network(7621f03d-76ac-49da-89a8-0753bb11e329),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap301d9f8c-02') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:25:24 user nova-compute[72418]: DEBUG os_vif [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:38:d9,bridge_name='br-int',has_traffic_filtering=True,id=301d9f8c-022d-4c02-90dd-374ead3daa23,network=Network(7621f03d-76ac-49da-89a8-0753bb11e329),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap301d9f8c-02') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:25:24 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:24 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:25:24 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:25:24 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:24 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap301d9f8c-02, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:25:24 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap301d9f8c-02, col_values=(('external_ids', {'iface-id': '301d9f8c-022d-4c02-90dd-374ead3daa23', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:38:d9', 'vm-uuid': 'e07beace-59d8-4c02-844b-1db1a6e81198'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:25:24 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:24 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:25:24 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:24 user nova-compute[72418]: INFO os_vif [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:38:d9,bridge_name='br-int',has_traffic_filtering=True,id=301d9f8c-022d-4c02-90dd-374ead3daa23,network=Network(7621f03d-76ac-49da-89a8-0753bb11e329),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap301d9f8c-02')
Aug 09 18:25:24 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:25:24 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] No VIF found with MAC fa:16:3e:a6:38:d9, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:25:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:25 user nova-compute[72418]: DEBUG nova.compute.manager [req-348d5782-0db2-4467-a848-fbdd031a6da1 req-30bf8fba-12d8-4241-916a-3303f6827383 service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Received event network-vif-plugged-301d9f8c-022d-4c02-90dd-374ead3daa23 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:25:25 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-348d5782-0db2-4467-a848-fbdd031a6da1 req-30bf8fba-12d8-4241-916a-3303f6827383 service nova] Acquiring lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:25 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-348d5782-0db2-4467-a848-fbdd031a6da1 req-30bf8fba-12d8-4241-916a-3303f6827383 service nova] Lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:25 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-348d5782-0db2-4467-a848-fbdd031a6da1 req-30bf8fba-12d8-4241-916a-3303f6827383 service nova] Lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:25 user nova-compute[72418]: DEBUG nova.compute.manager [req-348d5782-0db2-4467-a848-fbdd031a6da1 req-30bf8fba-12d8-4241-916a-3303f6827383 service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] No waiting events found dispatching network-vif-plugged-301d9f8c-022d-4c02-90dd-374ead3daa23 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:25:25 user nova-compute[72418]: WARNING nova.compute.manager [req-348d5782-0db2-4467-a848-fbdd031a6da1 req-30bf8fba-12d8-4241-916a-3303f6827383 service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Received unexpected event network-vif-plugged-301d9f8c-022d-4c02-90dd-374ead3daa23 for instance with vm_state building and task_state spawning.
Aug 09 18:25:26 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:26 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:26 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:26 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-709dfd51-b88c-4c85-8b82-20dec8a02449 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Acquiring lock "28dad451-f27e-4c62-8353-e3b89e0196cd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:26 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-709dfd51-b88c-4c85-8b82-20dec8a02449 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Lock "28dad451-f27e-4c62-8353-e3b89e0196cd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:26 user nova-compute[72418]: DEBUG nova.objects.instance [None req-709dfd51-b88c-4c85-8b82-20dec8a02449 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Lazy-loading 'flavor' on Instance uuid 28dad451-f27e-4c62-8353-e3b89e0196cd {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:25:26 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-709dfd51-b88c-4c85-8b82-20dec8a02449 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Lock "28dad451-f27e-4c62-8353-e3b89e0196cd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:26 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-709dfd51-b88c-4c85-8b82-20dec8a02449 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Acquiring lock "28dad451-f27e-4c62-8353-e3b89e0196cd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:26 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-709dfd51-b88c-4c85-8b82-20dec8a02449 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Lock "28dad451-f27e-4c62-8353-e3b89e0196cd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:26 user nova-compute[72418]: INFO nova.compute.manager [None req-709dfd51-b88c-4c85-8b82-20dec8a02449 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Attaching volume 04c7b0a6-0982-4234-abb6-4aa0314e242a to /dev/vdb
Aug 09 18:25:26 user nova-compute[72418]: DEBUG os_brick.utils [None req-709dfd51-b88c-4c85-8b82-20dec8a02449 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:25:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:26 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1cdde36-797d-465c-a977-7cbca5af7835]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ad56b243ad71\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:26 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[32bbc4ae-d9c0-41a2-bf71-d9c018d2fd90]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:26 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e547b3-bf5e-43a5-8569-9cbbc277863b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:26 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[05bbaf3e-5d6f-4e0e-bdf4-d047c116192a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-709dfd51-b88c-4c85-8b82-20dec8a02449 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Running cmd (subprocess): nvme version {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-709dfd51-b88c-4c85-8b82-20dec8a02449 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] 'nvme version' failed. Not Retrying. {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:25:26 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.nvmeof [None req-709dfd51-b88c-4c85-8b82-20dec8a02449 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] nvme not present on system {{(pid=72418) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 18:25:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:25:26 user nova-compute[72418]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 18:25:26 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94e9687-617a-43be-9505-0a6ee203f6ae]: (4, '') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:26 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-709dfd51-b88c-4c85-8b82-20dec8a02449 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72418) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 18:25:26 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-709dfd51-b88c-4c85-8b82-20dec8a02449 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 18:25:26 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-709dfd51-b88c-4c85-8b82-20dec8a02449 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] LIGHTOS: no hostnqn found. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 18:25:26 user nova-compute[72418]: DEBUG os_brick.utils [None req-709dfd51-b88c-4c85-8b82-20dec8a02449 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ad56b243ad71', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:25:26 user nova-compute[72418]: DEBUG nova.virt.block_device [None req-709dfd51-b88c-4c85-8b82-20dec8a02449 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Updating existing volume attachment record: d5967d73-c515-4534-a53f-3aa6d5f05906 {{(pid=72418) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 18:25:27 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:27 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605527.7317696, e07beace-59d8-4c02-844b-1db1a6e81198 => Resumed> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:25:27 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] VM Resumed (Lifecycle Event)
Aug 09 18:25:27 user nova-compute[72418]: DEBUG nova.compute.manager [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Instance event wait completed in 0 seconds for  {{(pid=72418) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 18:25:27 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Guest created on hypervisor {{(pid=72418) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 18:25:27 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Instance spawned successfully.
Aug 09 18:25:27 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 18:25:27 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:25:27 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:25:27 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Found default for hw_cdrom_bus of ide {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:25:27 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Found default for hw_disk_bus of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:25:27 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Found default for hw_input_bus of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:25:27 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Found default for hw_pointer_model of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:25:27 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Found default for hw_video_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:25:27 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Found default for hw_vif_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:25:27 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:25:27 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605527.7333314, e07beace-59d8-4c02-844b-1db1a6e81198 => Started> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:25:27 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] VM Started (Lifecycle Event)
Aug 09 18:25:27 user nova-compute[72418]: DEBUG nova.compute.manager [req-b5b2e2cc-caea-43b8-a4dd-7f320ca0ad94 req-d815f55c-aaa9-4644-bce1-d51e066e15e9 service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Received event network-vif-plugged-301d9f8c-022d-4c02-90dd-374ead3daa23 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:25:27 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-b5b2e2cc-caea-43b8-a4dd-7f320ca0ad94 req-d815f55c-aaa9-4644-bce1-d51e066e15e9 service nova] Acquiring lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:27 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-b5b2e2cc-caea-43b8-a4dd-7f320ca0ad94 req-d815f55c-aaa9-4644-bce1-d51e066e15e9 service nova] Lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:27 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-b5b2e2cc-caea-43b8-a4dd-7f320ca0ad94 req-d815f55c-aaa9-4644-bce1-d51e066e15e9 service nova] Lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:27 user nova-compute[72418]: DEBUG nova.compute.manager [req-b5b2e2cc-caea-43b8-a4dd-7f320ca0ad94 req-d815f55c-aaa9-4644-bce1-d51e066e15e9 service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] No waiting events found dispatching network-vif-plugged-301d9f8c-022d-4c02-90dd-374ead3daa23 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:25:27 user nova-compute[72418]: WARNING nova.compute.manager [req-b5b2e2cc-caea-43b8-a4dd-7f320ca0ad94 req-d815f55c-aaa9-4644-bce1-d51e066e15e9 service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Received unexpected event network-vif-plugged-301d9f8c-022d-4c02-90dd-374ead3daa23 for instance with vm_state building and task_state spawning.
Aug 09 18:25:27 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:25:27 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:25:27 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:25:27 user nova-compute[72418]: INFO nova.compute.manager [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Took 6.48 seconds to spawn the instance on the hypervisor.
Aug 09 18:25:27 user nova-compute[72418]: DEBUG nova.compute.manager [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:25:27 user nova-compute[72418]: INFO nova.compute.manager [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Took 7.40 seconds to build instance.
Aug 09 18:25:27 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-1e14a435-f6d1-49fa-b229-2592428d402a tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "e07beace-59d8-4c02-844b-1db1a6e81198" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.509s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:29 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:32 user nova-compute[72418]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691605517.1580482, 6084e681-01c4-4a6c-beb3-dcda4a990a51 => Stopped> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:25:32 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] VM Stopped (Lifecycle Event)
Aug 09 18:25:32 user nova-compute[72418]: DEBUG nova.compute.manager [None req-f7216d96-ca75-477a-a82c-ff22fd873fa2 None None] [instance: 6084e681-01c4-4a6c-beb3-dcda4a990a51] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:25:32 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:34 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:35 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-709dfd51-b88c-4c85-8b82-20dec8a02449 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Calling os-brick to attach iSCSI Volume {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 18:25:35 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-709dfd51-b88c-4c85-8b82-20dec8a02449 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:04c7b0a6-0982-4234-abb6-4aa0314e242a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CNXzDSGa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:25:35 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-709dfd51-b88c-4c85-8b82-20dec8a02449 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:25:35 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-709dfd51-b88c-4c85-8b82-20dec8a02449 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:25:35 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-709dfd51-b88c-4c85-8b82-20dec8a02449 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:25:35 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-709dfd51-b88c-4c85-8b82-20dec8a02449 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:25:35 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-709dfd51-b88c-4c85-8b82-20dec8a02449 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04c7b0a6-0982-4234-abb6-4aa0314e242a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:25:35 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-709dfd51-b88c-4c85-8b82-20dec8a02449 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04c7b0a6-0982-4234-abb6-4aa0314e242a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:25:35 user nova-compute[72418]: INFO os_brick.initiator.connectors.iscsi [None req-709dfd51-b88c-4c85-8b82-20dec8a02449 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 18:25:35 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04c7b0a6-0982-4234-abb6-4aa0314e242a -p 172.16.0.220:3260 {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:35 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04c7b0a6-0982-4234-abb6-4aa0314e242a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:35 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f04e5b2-60b0-4bb3-a9e7-c469bd8f1e54]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:35 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-709dfd51-b88c-4c85-8b82-20dec8a02449 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 18:25:35 user nova-compute[72418]:  {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:25:35 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04c7b0a6-0982-4234-abb6-4aa0314e242a -p 172.16.0.220:3260 --interface default --op new {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:35 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04c7b0a6-0982-4234-abb6-4aa0314e242a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:35 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[86dc03db-c241-4f75-84d6-f1bc3d68e482]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04c7b0a6-0982-4234-abb6-4aa0314e242a] added\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:35 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-709dfd51-b88c-4c85-8b82-20dec8a02449 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04c7b0a6-0982-4234-abb6-4aa0314e242a] added
Aug 09 18:25:35 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:25:35 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04c7b0a6-0982-4234-abb6-4aa0314e242a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:35 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04c7b0a6-0982-4234-abb6-4aa0314e242a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:35 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fd4218-999a-4cd1-8c64-6b4d1c50018e]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:35 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-709dfd51-b88c-4c85-8b82-20dec8a02449 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:25:35 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04c7b0a6-0982-4234-abb6-4aa0314e242a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:35 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04c7b0a6-0982-4234-abb6-4aa0314e242a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:35 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[939b495e-a23a-4595-bf5d-0f84dfa4f8fe]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:35 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-709dfd51-b88c-4c85-8b82-20dec8a02449 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:25:35 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04c7b0a6-0982-4234-abb6-4aa0314e242a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CNXzDSGa {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:35 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04c7b0a6-0982-4234-abb6-4aa0314e242a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CNXzDSGa" returned: 0 in 0.023s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:35 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e04e48f-e098-4af3-9d4c-168fcfeff026]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:35 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-709dfd51-b88c-4c85-8b82-20dec8a02449 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CNXzDSGa'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:25:35 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04c7b0a6-0982-4234-abb6-4aa0314e242a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:35 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04c7b0a6-0982-4234-abb6-4aa0314e242a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:35 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72beb17-97c8-402f-914a-c21b95a6ca56]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:35 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-709dfd51-b88c-4c85-8b82-20dec8a02449 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:25:35 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:35 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:35 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed5be0e-5144-4b19-acc4-bcdd1d15a484]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:35 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-709dfd51-b88c-4c85-8b82-20dec8a02449 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:25:35 user nova-compute[72418]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:25:35 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:25:35 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-709dfd51-b88c-4c85-8b82-20dec8a02449 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:25:35 user nova-compute[72418]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:25:35 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:25:35 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04c7b0a6-0982-4234-abb6-4aa0314e242a -p 172.16.0.220:3260 --login {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:35 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04c7b0a6-0982-4234-abb6-4aa0314e242a -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:35 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b837bd-eff4-4e77-b46f-f6e04fd38995]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:04c7b0a6-0982-4234-abb6-4aa0314e242a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:04c7b0a6-0982-4234-abb6-4aa0314e242a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:35 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-709dfd51-b88c-4c85-8b82-20dec8a02449 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:04c7b0a6-0982-4234-abb6-4aa0314e242a, portal: 172.16.0.220,3260]
Aug 09 18:25:35 user nova-compute[72418]: Login to [iface: default, target: iqn.2010-10.org.openstack:04c7b0a6-0982-4234-abb6-4aa0314e242a, portal: 172.16.0.220,3260] successful.
Aug 09 18:25:35 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:25:35 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04c7b0a6-0982-4234-abb6-4aa0314e242a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:35 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04c7b0a6-0982-4234-abb6-4aa0314e242a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:35 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ada0ea-ac93-4774-955d-36d7c22afb58]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:35 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-709dfd51-b88c-4c85-8b82-20dec8a02449 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:25:35 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:35 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:35 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[b553812a-18df-4731-8c90-a1417f4b6689]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04c7b0a6-0982-4234-abb6-4aa0314e242a (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:35 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-709dfd51-b88c-4c85-8b82-20dec8a02449 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:25:35 user nova-compute[72418]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:25:35 user nova-compute[72418]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04c7b0a6-0982-4234-abb6-4aa0314e242a (non-flash)
Aug 09 18:25:35 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:25:35 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-709dfd51-b88c-4c85-8b82-20dec8a02449 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:25:35 user nova-compute[72418]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:25:35 user nova-compute[72418]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04c7b0a6-0982-4234-abb6-4aa0314e242a (non-flash)
Aug 09 18:25:35 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:25:35 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-709dfd51-b88c-4c85-8b82-20dec8a02449 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04c7b0a6-0982-4234-abb6-4aa0314e242a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:25:35 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-709dfd51-b88c-4c85-8b82-20dec8a02449 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Connected to 172.16.0.220:3260 {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 18:25:35 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-709dfd51-b88c-4c85-8b82-20dec8a02449 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=72418) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 18:25:35 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-709dfd51-b88c-4c85-8b82-20dec8a02449 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72418) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 18:25:35 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:35 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:35 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd0b32a-ac95-4262-b6c2-54a69112dfff]: (4, ('- - 0', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:35 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-709dfd51-b88c-4c85-8b82-20dec8a02449 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72418) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 18:25:35 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-709dfd51-b88c-4c85-8b82-20dec8a02449 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CNXzDSGa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 18:25:36 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-8340dea4-4b95-4aa3-b23a-1d1b171a9aa4 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Acquiring lock "aab087ae-c46e-46c8-baa0-d754dc29947f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:36 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-8340dea4-4b95-4aa3-b23a-1d1b171a9aa4 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Lock "aab087ae-c46e-46c8-baa0-d754dc29947f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:36 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-8340dea4-4b95-4aa3-b23a-1d1b171a9aa4 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Acquiring lock "aab087ae-c46e-46c8-baa0-d754dc29947f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:36 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-8340dea4-4b95-4aa3-b23a-1d1b171a9aa4 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Lock "aab087ae-c46e-46c8-baa0-d754dc29947f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:36 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-8340dea4-4b95-4aa3-b23a-1d1b171a9aa4 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Lock "aab087ae-c46e-46c8-baa0-d754dc29947f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:36 user nova-compute[72418]: INFO nova.compute.manager [None req-8340dea4-4b95-4aa3-b23a-1d1b171a9aa4 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Terminating instance
Aug 09 18:25:36 user nova-compute[72418]: DEBUG nova.compute.manager [None req-8340dea4-4b95-4aa3-b23a-1d1b171a9aa4 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Start destroying the instance on the hypervisor. {{(pid=72418) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 18:25:36 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:36 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:36 user nova-compute[72418]: DEBUG nova.compute.manager [req-1320a85a-ef5c-4b5b-9eab-7de17fc70dd4 req-def4367e-65d6-4de8-9216-a9deded82b92 service nova] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Received event network-vif-unplugged-0eba7184-d598-4e94-aefc-d1f1cbf63046 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:25:36 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-1320a85a-ef5c-4b5b-9eab-7de17fc70dd4 req-def4367e-65d6-4de8-9216-a9deded82b92 service nova] Acquiring lock "aab087ae-c46e-46c8-baa0-d754dc29947f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:36 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-1320a85a-ef5c-4b5b-9eab-7de17fc70dd4 req-def4367e-65d6-4de8-9216-a9deded82b92 service nova] Lock "aab087ae-c46e-46c8-baa0-d754dc29947f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:36 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-1320a85a-ef5c-4b5b-9eab-7de17fc70dd4 req-def4367e-65d6-4de8-9216-a9deded82b92 service nova] Lock "aab087ae-c46e-46c8-baa0-d754dc29947f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:36 user nova-compute[72418]: DEBUG nova.compute.manager [req-1320a85a-ef5c-4b5b-9eab-7de17fc70dd4 req-def4367e-65d6-4de8-9216-a9deded82b92 service nova] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] No waiting events found dispatching network-vif-unplugged-0eba7184-d598-4e94-aefc-d1f1cbf63046 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:25:36 user nova-compute[72418]: DEBUG nova.compute.manager [req-1320a85a-ef5c-4b5b-9eab-7de17fc70dd4 req-def4367e-65d6-4de8-9216-a9deded82b92 service nova] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Received event network-vif-unplugged-0eba7184-d598-4e94-aefc-d1f1cbf63046 for instance with task_state deleting. {{(pid=72418) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 18:25:36 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:36 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:36 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Instance destroyed successfully.
Aug 09 18:25:36 user nova-compute[72418]: DEBUG nova.objects.instance [None req-8340dea4-4b95-4aa3-b23a-1d1b171a9aa4 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Lazy-loading 'resources' on Instance uuid aab087ae-c46e-46c8-baa0-d754dc29947f {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:25:36 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-8340dea4-4b95-4aa3-b23a-1d1b171a9aa4 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:23:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1573430224',display_name='tempest-ServersNegativeTestJSON-server-1573430224',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1573430224',id=12,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:23:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60e3274c2e3447fcad6d1f16765f4afd',ramdisk_id='',reservation_id='r-4islqo30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1802403477',owner_user_name='tempest-ServersNegativeTestJSON-1802403477-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:23:56Z,user_data=None,user_id='6e1439f58ac640f481a59944ee145f97',uuid=aab087ae-c46e-46c8-baa0-d754dc29947f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0eba7184-d598-4e94-aefc-d1f1cbf63046", "address": "fa:16:3e:71:1c:06", "network": {"id": "d72da164-7e30-4eeb-8c28-765454c2b24f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1301909372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e3274c2e3447fcad6d1f16765f4afd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eba7184-d5", "ovs_interfaceid": "0eba7184-d598-4e94-aefc-d1f1cbf63046", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 18:25:36 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-8340dea4-4b95-4aa3-b23a-1d1b171a9aa4 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Converting VIF {"id": "0eba7184-d598-4e94-aefc-d1f1cbf63046", "address": "fa:16:3e:71:1c:06", "network": {"id": "d72da164-7e30-4eeb-8c28-765454c2b24f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1301909372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e3274c2e3447fcad6d1f16765f4afd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eba7184-d5", "ovs_interfaceid": "0eba7184-d598-4e94-aefc-d1f1cbf63046", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:25:36 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-8340dea4-4b95-4aa3-b23a-1d1b171a9aa4 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:1c:06,bridge_name='br-int',has_traffic_filtering=True,id=0eba7184-d598-4e94-aefc-d1f1cbf63046,network=Network(d72da164-7e30-4eeb-8c28-765454c2b24f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0eba7184-d5') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:25:36 user nova-compute[72418]: DEBUG os_vif [None req-8340dea4-4b95-4aa3-b23a-1d1b171a9aa4 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:1c:06,bridge_name='br-int',has_traffic_filtering=True,id=0eba7184-d598-4e94-aefc-d1f1cbf63046,network=Network(d72da164-7e30-4eeb-8c28-765454c2b24f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0eba7184-d5') {{(pid=72418) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 18:25:36 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:36 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0eba7184-d5, bridge=br-int, if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:25:36 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:36 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:25:36 user nova-compute[72418]: INFO os_vif [None req-8340dea4-4b95-4aa3-b23a-1d1b171a9aa4 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:1c:06,bridge_name='br-int',has_traffic_filtering=True,id=0eba7184-d598-4e94-aefc-d1f1cbf63046,network=Network(d72da164-7e30-4eeb-8c28-765454c2b24f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0eba7184-d5')
Aug 09 18:25:36 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-8340dea4-4b95-4aa3-b23a-1d1b171a9aa4 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Deleting instance files /opt/stack/data/nova/instances/aab087ae-c46e-46c8-baa0-d754dc29947f_del
Aug 09 18:25:36 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-8340dea4-4b95-4aa3-b23a-1d1b171a9aa4 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Deletion of /opt/stack/data/nova/instances/aab087ae-c46e-46c8-baa0-d754dc29947f_del complete
Aug 09 18:25:36 user nova-compute[72418]: INFO nova.compute.manager [None req-8340dea4-4b95-4aa3-b23a-1d1b171a9aa4 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Took 0.70 seconds to destroy the instance on the hypervisor.
Aug 09 18:25:36 user nova-compute[72418]: DEBUG oslo.service.loopingcall [None req-8340dea4-4b95-4aa3-b23a-1d1b171a9aa4 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72418) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 18:25:36 user nova-compute[72418]: DEBUG nova.compute.manager [-] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Deallocating network for instance {{(pid=72418) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 18:25:36 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] deallocate_for_instance() {{(pid=72418) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 18:25:36 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-709dfd51-b88c-4c85-8b82-20dec8a02449 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:25:36 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-709dfd51-b88c-4c85-8b82-20dec8a02449 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23337386532663364', 'path': '/dev/sdc'} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:25:36 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-709dfd51-b88c-4c85-8b82-20dec8a02449 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337386532663364', 'path': '/dev/sdc'} {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 18:25:36 user nova-compute[72418]: DEBUG nova.objects.instance [None req-709dfd51-b88c-4c85-8b82-20dec8a02449 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Lazy-loading 'flavor' on Instance uuid 28dad451-f27e-4c62-8353-e3b89e0196cd {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:25:36 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-709dfd51-b88c-4c85-8b82-20dec8a02449 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 18:25:36 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:25:36 user nova-compute[72418]:   <source dev="/dev/sdc"/>
Aug 09 18:25:36 user nova-compute[72418]:   <target dev="vdb" bus="virtio"/>
Aug 09 18:25:36 user nova-compute[72418]:   <serial>04c7b0a6-0982-4234-abb6-4aa0314e242a</serial>
Aug 09 18:25:36 user nova-compute[72418]: </disk>
Aug 09 18:25:36 user nova-compute[72418]:  {{(pid=72418) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 18:25:37 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:25:37 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Took 0.51 seconds to deallocate network for instance.
Aug 09 18:25:37 user nova-compute[72418]: DEBUG nova.compute.manager [req-eb85d9c5-2308-4a68-b166-c25835f32bc0 req-9f58354c-7ddc-4a91-8e0b-befcef8ac9bc service nova] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Received event network-vif-deleted-0eba7184-d598-4e94-aefc-d1f1cbf63046 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:25:37 user nova-compute[72418]: INFO nova.compute.manager [req-eb85d9c5-2308-4a68-b166-c25835f32bc0 req-9f58354c-7ddc-4a91-8e0b-befcef8ac9bc service nova] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Neutron deleted interface 0eba7184-d598-4e94-aefc-d1f1cbf63046; detaching it from the instance and deleting it from the info cache
Aug 09 18:25:37 user nova-compute[72418]: DEBUG nova.network.neutron [req-eb85d9c5-2308-4a68-b166-c25835f32bc0 req-9f58354c-7ddc-4a91-8e0b-befcef8ac9bc service nova] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:25:37 user nova-compute[72418]: DEBUG nova.compute.manager [req-eb85d9c5-2308-4a68-b166-c25835f32bc0 req-9f58354c-7ddc-4a91-8e0b-befcef8ac9bc service nova] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Detach interface failed, port_id=0eba7184-d598-4e94-aefc-d1f1cbf63046, reason: Instance aab087ae-c46e-46c8-baa0-d754dc29947f could not be found. {{(pid=72418) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 18:25:37 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-709dfd51-b88c-4c85-8b82-20dec8a02449 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:25:37 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-709dfd51-b88c-4c85-8b82-20dec8a02449 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:25:37 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-709dfd51-b88c-4c85-8b82-20dec8a02449 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] No VIF found with MAC fa:16:3e:27:2e:34, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:25:37 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-8340dea4-4b95-4aa3-b23a-1d1b171a9aa4 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:37 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-8340dea4-4b95-4aa3-b23a-1d1b171a9aa4 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:37 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-709dfd51-b88c-4c85-8b82-20dec8a02449 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Lock "28dad451-f27e-4c62-8353-e3b89e0196cd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.726s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:37 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:37 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-8340dea4-4b95-4aa3-b23a-1d1b171a9aa4 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:25:37 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-8340dea4-4b95-4aa3-b23a-1d1b171a9aa4 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:25:37 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-8340dea4-4b95-4aa3-b23a-1d1b171a9aa4 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.388s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:37 user nova-compute[72418]: INFO nova.scheduler.client.report [None req-8340dea4-4b95-4aa3-b23a-1d1b171a9aa4 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Deleted allocations for instance aab087ae-c46e-46c8-baa0-d754dc29947f
Aug 09 18:25:37 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-8340dea4-4b95-4aa3-b23a-1d1b171a9aa4 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Lock "aab087ae-c46e-46c8-baa0-d754dc29947f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.781s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:38 user nova-compute[72418]: DEBUG nova.compute.manager [req-4ebf068b-051f-4338-abf1-b1c94ba6b63c req-9d804549-8ccf-4c22-ac32-3f509be6638a service nova] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Received event network-vif-plugged-0eba7184-d598-4e94-aefc-d1f1cbf63046 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:25:38 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-4ebf068b-051f-4338-abf1-b1c94ba6b63c req-9d804549-8ccf-4c22-ac32-3f509be6638a service nova] Acquiring lock "aab087ae-c46e-46c8-baa0-d754dc29947f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:38 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-4ebf068b-051f-4338-abf1-b1c94ba6b63c req-9d804549-8ccf-4c22-ac32-3f509be6638a service nova] Lock "aab087ae-c46e-46c8-baa0-d754dc29947f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:38 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-4ebf068b-051f-4338-abf1-b1c94ba6b63c req-9d804549-8ccf-4c22-ac32-3f509be6638a service nova] Lock "aab087ae-c46e-46c8-baa0-d754dc29947f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:38 user nova-compute[72418]: DEBUG nova.compute.manager [req-4ebf068b-051f-4338-abf1-b1c94ba6b63c req-9d804549-8ccf-4c22-ac32-3f509be6638a service nova] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] No waiting events found dispatching network-vif-plugged-0eba7184-d598-4e94-aefc-d1f1cbf63046 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:25:38 user nova-compute[72418]: WARNING nova.compute.manager [req-4ebf068b-051f-4338-abf1-b1c94ba6b63c req-9d804549-8ccf-4c22-ac32-3f509be6638a service nova] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Received unexpected event network-vif-plugged-0eba7184-d598-4e94-aefc-d1f1cbf63046 for instance with vm_state deleted and task_state None.
Aug 09 18:25:40 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-26e78fec-3294-4b46-b671-fe8839963f9b tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Acquiring lock "28dad451-f27e-4c62-8353-e3b89e0196cd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:40 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-26e78fec-3294-4b46-b671-fe8839963f9b tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Lock "28dad451-f27e-4c62-8353-e3b89e0196cd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:40 user nova-compute[72418]: INFO nova.compute.manager [None req-26e78fec-3294-4b46-b671-fe8839963f9b tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Detaching volume 04c7b0a6-0982-4234-abb6-4aa0314e242a
Aug 09 18:25:40 user nova-compute[72418]: INFO nova.virt.block_device [None req-26e78fec-3294-4b46-b671-fe8839963f9b tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Attempting to driver detach volume 04c7b0a6-0982-4234-abb6-4aa0314e242a from mountpoint /dev/vdb
Aug 09 18:25:40 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-26e78fec-3294-4b46-b671-fe8839963f9b tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Attempting to detach device vdb from instance 28dad451-f27e-4c62-8353-e3b89e0196cd from the persistent domain config. {{(pid=72418) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 18:25:40 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-26e78fec-3294-4b46-b671-fe8839963f9b tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 18:25:40 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:25:40 user nova-compute[72418]:   <source dev="/dev/sdc"/>
Aug 09 18:25:40 user nova-compute[72418]:   <target dev="vdb" bus="virtio"/>
Aug 09 18:25:40 user nova-compute[72418]:   <serial>04c7b0a6-0982-4234-abb6-4aa0314e242a</serial>
Aug 09 18:25:40 user nova-compute[72418]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 18:25:40 user nova-compute[72418]: </disk>
Aug 09 18:25:40 user nova-compute[72418]:  {{(pid=72418) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 18:25:40 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-26e78fec-3294-4b46-b671-fe8839963f9b tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Successfully detached device vdb from instance 28dad451-f27e-4c62-8353-e3b89e0196cd from the persistent domain config.
Aug 09 18:25:40 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-26e78fec-3294-4b46-b671-fe8839963f9b tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 28dad451-f27e-4c62-8353-e3b89e0196cd from the live domain config. {{(pid=72418) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 18:25:40 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-26e78fec-3294-4b46-b671-fe8839963f9b tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 18:25:40 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:25:40 user nova-compute[72418]:   <source dev="/dev/sdc"/>
Aug 09 18:25:40 user nova-compute[72418]:   <target dev="vdb" bus="virtio"/>
Aug 09 18:25:40 user nova-compute[72418]:   <serial>04c7b0a6-0982-4234-abb6-4aa0314e242a</serial>
Aug 09 18:25:40 user nova-compute[72418]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 18:25:40 user nova-compute[72418]: </disk>
Aug 09 18:25:40 user nova-compute[72418]:  {{(pid=72418) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 18:25:40 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Received event <DeviceRemovedEvent: 1691605540.836057, 28dad451-f27e-4c62-8353-e3b89e0196cd => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72418) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 18:25:40 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-26e78fec-3294-4b46-b671-fe8839963f9b tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 28dad451-f27e-4c62-8353-e3b89e0196cd {{(pid=72418) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 18:25:40 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-26e78fec-3294-4b46-b671-fe8839963f9b tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Successfully detached device vdb from instance 28dad451-f27e-4c62-8353-e3b89e0196cd from the live domain config.
Aug 09 18:25:40 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26e78fec-3294-4b46-b671-fe8839963f9b tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] calling os-brick to detach iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 18:25:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e78fec-3294-4b46-b671-fe8839963f9b tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, {'target_iqns': ['iqn.2010-10.org.openstack:04c7b0a6-0982-4234-abb6-4aa0314e242a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CNXzDSGa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:25:40 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-26e78fec-3294-4b46-b671-fe8839963f9b tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:25:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-26e78fec-3294-4b46-b671-fe8839963f9b tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:25:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-26e78fec-3294-4b46-b671-fe8839963f9b tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:25:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e78fec-3294-4b46-b671-fe8839963f9b tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04c7b0a6-0982-4234-abb6-4aa0314e242a', 0)] {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 18:25:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:40 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f332804-76da-4374-8402-ff5f6c62ab35]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04c7b0a6-0982-4234-abb6-4aa0314e242a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.066s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:40 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a197588-1e47-47b1-81da-380bffdfca1b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04c7b0a6-0982-4234-abb6-4aa0314e242a (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e78fec-3294-4b46-b671-fe8839963f9b tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:25:40 user nova-compute[72418]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:25:40 user nova-compute[72418]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04c7b0a6-0982-4234-abb6-4aa0314e242a (non-flash)
Aug 09 18:25:40 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:25:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e78fec-3294-4b46-b671-fe8839963f9b tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:25:40 user nova-compute[72418]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:25:40 user nova-compute[72418]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04c7b0a6-0982-4234-abb6-4aa0314e242a (non-flash)
Aug 09 18:25:40 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:25:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e78fec-3294-4b46-b671-fe8839963f9b tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f42f83b96c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04c7b0a6-0982-4234-abb6-4aa0314e242a'): ({'sdc'}, set())}) {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 18:25:40 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-26e78fec-3294-4b46-b671-fe8839963f9b tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Removing single pathed devices sdc {{(pid=72418) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 18:25:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:40 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f3e22a-441d-47a6-b1ca-5ddd10e0c52d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:41 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ebf066-ec20-4711-a6a1-c60b019075a1]: (4, ('ok\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:41 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-26e78fec-3294-4b46-b671-fe8839963f9b tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Flushing IO for device /dev/sdc {{(pid=72418) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 18:25:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:41 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a8ca35-a52a-4b1f-8783-b6790f06b49b]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:41 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-26e78fec-3294-4b46-b671-fe8839963f9b tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72418) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 18:25:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:41 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d09706-08e1-43db-8ec2-be1b34a43283]: (4, ('1', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:41 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-26e78fec-3294-4b46-b671-fe8839963f9b tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 18:25:41 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-26e78fec-3294-4b46-b671-fe8839963f9b tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] SCSI volumes sdc have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 18:25:41 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e78fec-3294-4b46-b671-fe8839963f9b tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04c7b0a6-0982-4234-abb6-4aa0314e242a')] {{(pid=72418) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 18:25:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04c7b0a6-0982-4234-abb6-4aa0314e242a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04c7b0a6-0982-4234-abb6-4aa0314e242a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:41 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c74a6b3-55b4-4200-8836-7576f9c14609]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:41 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e78fec-3294-4b46-b671-fe8839963f9b tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:25:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04c7b0a6-0982-4234-abb6-4aa0314e242a -p 172.16.0.220:3260 --logout {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04c7b0a6-0982-4234-abb6-4aa0314e242a -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:41 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6dc224-3b1d-4498-a446-9db27b7e3e10]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:04c7b0a6-0982-4234-abb6-4aa0314e242a, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:04c7b0a6-0982-4234-abb6-4aa0314e242a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:41 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e78fec-3294-4b46-b671-fe8839963f9b tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:04c7b0a6-0982-4234-abb6-4aa0314e242a, portal: 172.16.0.220,3260]
Aug 09 18:25:41 user nova-compute[72418]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:04c7b0a6-0982-4234-abb6-4aa0314e242a, portal: 172.16.0.220,3260] successful.
Aug 09 18:25:41 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:25:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04c7b0a6-0982-4234-abb6-4aa0314e242a -p 172.16.0.220:3260 --op delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04c7b0a6-0982-4234-abb6-4aa0314e242a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:41 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb98973-c78f-40f5-a3da-bdd11a553d35]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:25:41 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e78fec-3294-4b46-b671-fe8839963f9b tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:25:41 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-26e78fec-3294-4b46-b671-fe8839963f9b tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:25:41 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e78fec-3294-4b46-b671-fe8839963f9b tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] <== disconnect_volume: return (351ms) None {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:25:41 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26e78fec-3294-4b46-b671-fe8839963f9b tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Disconnected iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 18:25:41 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:42 user nova-compute[72418]: DEBUG nova.objects.instance [None req-26e78fec-3294-4b46-b671-fe8839963f9b tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Lazy-loading 'flavor' on Instance uuid 28dad451-f27e-4c62-8353-e3b89e0196cd {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:25:42 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-26e78fec-3294-4b46-b671-fe8839963f9b tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Lock "28dad451-f27e-4c62-8353-e3b89e0196cd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.007s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:42 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:43 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:25:43 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:25:46 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:46 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:25:46 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:25:47 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:47 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:25:48 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:25:48 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:25:49 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:25:49 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72418) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 18:25:49 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:25:49 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:49 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:49 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:49 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Auditing locally available compute resources for user (node: user) {{(pid=72418) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 18:25:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/479ea4c3-ad7f-4da0-a901-defe46d96065/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/479ea4c3-ad7f-4da0-a901-defe46d96065/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/479ea4c3-ad7f-4da0-a901-defe46d96065/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/479ea4c3-ad7f-4da0-a901-defe46d96065/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28dad451-f27e-4c62-8353-e3b89e0196cd/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28dad451-f27e-4c62-8353-e3b89e0196cd/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28dad451-f27e-4c62-8353-e3b89e0196cd/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28dad451-f27e-4c62-8353-e3b89e0196cd/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6927390-e0f7-43cf-8a83-d3c004865129/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6927390-e0f7-43cf-8a83-d3c004865129/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6927390-e0f7-43cf-8a83-d3c004865129/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6927390-e0f7-43cf-8a83-d3c004865129/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dabfdb24-fc0b-4a00-a229-1ece48e27d18/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dabfdb24-fc0b-4a00-a229-1ece48e27d18/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dabfdb24-fc0b-4a00-a229-1ece48e27d18/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dabfdb24-fc0b-4a00-a229-1ece48e27d18/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:51 user nova-compute[72418]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691605536.7033443, aab087ae-c46e-46c8-baa0-d754dc29947f => Stopped> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:25:51 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] VM Stopped (Lifecycle Event)
Aug 09 18:25:51 user nova-compute[72418]: DEBUG nova.compute.manager [None req-2e2112a7-f778-4ded-bec7-6549e1d5eaa7 None None] [instance: aab087ae-c46e-46c8-baa0-d754dc29947f] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:25:51 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:52 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd87d56d-3aa5-43cf-ac55-fb3c41e092b1/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd87d56d-3aa5-43cf-ac55-fb3c41e092b1/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd87d56d-3aa5-43cf-ac55-fb3c41e092b1/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd87d56d-3aa5-43cf-ac55-fb3c41e092b1/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:53 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:25:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:25:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:25:53 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:25:53 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:25:53 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:25:53 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Hypervisor/Node resource view: name=user free_ram=7049MB free_disk=25.75393295288086GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72418) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 18:25:53 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:53 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:54 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 6af7918a-ce90-45ab-93d8-684e1489e891 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:25:54 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 8fe41968-a219-4a5a-afdb-32eb2082bb40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:25:54 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 01c46b33-6788-44a5-a43c-88ee4acc4d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:25:54 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 479ea4c3-ad7f-4da0-a901-defe46d96065 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:25:54 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:25:54 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance dabfdb24-fc0b-4a00-a229-1ece48e27d18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:25:54 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance d9d5d476-484e-49a3-a665-5a2069ea606e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:25:54 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 28dad451-f27e-4c62-8353-e3b89e0196cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:25:54 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance b6927390-e0f7-43cf-8a83-d3c004865129 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:25:54 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance e019064c-955e-4f80-9b00-6b32b3835d58 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:25:54 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance bd87d56d-3aa5-43cf-ac55-fb3c41e092b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:25:54 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance e07beace-59d8-4c02-844b-1db1a6e81198 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:25:54 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 18:25:54 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 18:25:54 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:25:54 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:25:54 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Compute_service record updated for user:user {{(pid=72418) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 18:25:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.515s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:56 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:25:56 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Starting heal instance info cache {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 18:25:56 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "refresh_cache-479ea4c3-ad7f-4da0-a901-defe46d96065" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:25:56 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquired lock "refresh_cache-479ea4c3-ad7f-4da0-a901-defe46d96065" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:25:56 user nova-compute[72418]: DEBUG nova.network.neutron [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Forcefully refreshing network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 18:25:56 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:57 user nova-compute[72418]: DEBUG nova.network.neutron [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Updating instance_info_cache with network_info: [{"id": "1ebdd43e-c423-4e1c-9e50-1419f2857ae4", "address": "fa:16:3e:3b:33:c3", "network": {"id": "d72da164-7e30-4eeb-8c28-765454c2b24f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1301909372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e3274c2e3447fcad6d1f16765f4afd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ebdd43e-c4", "ovs_interfaceid": "1ebdd43e-c423-4e1c-9e50-1419f2857ae4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:25:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Releasing lock "refresh_cache-479ea4c3-ad7f-4da0-a901-defe46d96065" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:25:57 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Updated the network info_cache for instance {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 18:25:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-6b035742-20d4-4807-8c10-aff691273ceb tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Acquiring lock "dabfdb24-fc0b-4a00-a229-1ece48e27d18" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-6b035742-20d4-4807-8c10-aff691273ceb tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Lock "dabfdb24-fc0b-4a00-a229-1ece48e27d18" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-6b035742-20d4-4807-8c10-aff691273ceb tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Acquiring lock "dabfdb24-fc0b-4a00-a229-1ece48e27d18-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-6b035742-20d4-4807-8c10-aff691273ceb tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Lock "dabfdb24-fc0b-4a00-a229-1ece48e27d18-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-6b035742-20d4-4807-8c10-aff691273ceb tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Lock "dabfdb24-fc0b-4a00-a229-1ece48e27d18-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:57 user nova-compute[72418]: INFO nova.compute.manager [None req-6b035742-20d4-4807-8c10-aff691273ceb tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Terminating instance
Aug 09 18:25:57 user nova-compute[72418]: DEBUG nova.compute.manager [None req-6b035742-20d4-4807-8c10-aff691273ceb tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Start destroying the instance on the hypervisor. {{(pid=72418) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 18:25:57 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:57 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:57 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:57 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:57 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:57 user nova-compute[72418]: DEBUG nova.compute.manager [req-52d3d08d-cad5-49c9-bcbc-55771f9a6415 req-5a11407f-4a5d-4502-8c77-73febc516290 service nova] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Received event network-vif-unplugged-e53ca69c-b53f-4f5f-b8fa-f8a66b4177f5 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:25:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-52d3d08d-cad5-49c9-bcbc-55771f9a6415 req-5a11407f-4a5d-4502-8c77-73febc516290 service nova] Acquiring lock "dabfdb24-fc0b-4a00-a229-1ece48e27d18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-52d3d08d-cad5-49c9-bcbc-55771f9a6415 req-5a11407f-4a5d-4502-8c77-73febc516290 service nova] Lock "dabfdb24-fc0b-4a00-a229-1ece48e27d18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-52d3d08d-cad5-49c9-bcbc-55771f9a6415 req-5a11407f-4a5d-4502-8c77-73febc516290 service nova] Lock "dabfdb24-fc0b-4a00-a229-1ece48e27d18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:57 user nova-compute[72418]: DEBUG nova.compute.manager [req-52d3d08d-cad5-49c9-bcbc-55771f9a6415 req-5a11407f-4a5d-4502-8c77-73febc516290 service nova] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] No waiting events found dispatching network-vif-unplugged-e53ca69c-b53f-4f5f-b8fa-f8a66b4177f5 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:25:57 user nova-compute[72418]: DEBUG nova.compute.manager [req-52d3d08d-cad5-49c9-bcbc-55771f9a6415 req-5a11407f-4a5d-4502-8c77-73febc516290 service nova] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Received event network-vif-unplugged-e53ca69c-b53f-4f5f-b8fa-f8a66b4177f5 for instance with task_state deleting. {{(pid=72418) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 18:25:57 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:58 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Instance destroyed successfully.
Aug 09 18:25:58 user nova-compute[72418]: DEBUG nova.objects.instance [None req-6b035742-20d4-4807-8c10-aff691273ceb tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Lazy-loading 'resources' on Instance uuid dabfdb24-fc0b-4a00-a229-1ece48e27d18 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:25:58 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-6b035742-20d4-4807-8c10-aff691273ceb tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:22:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2118574215',display_name='tempest-TestVolumeSwap-server-2118574215',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2118574215',id=8,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLhr+BmnLQHSSQhY45cpG3EfUYHhI72ddTB+tZqOGD2dBAalfMaaqnCsFe9sV2x8zXBcbLyTVXvjiVIxS/1zOeEtcjduDmbV9Ca2A10KVsXv/iO6d8E0Cx+qF2x7xsc0fA==',key_name='tempest-keypair-18310665',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:22:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cee457e31034445e82a46b87d54ef5f4',ramdisk_id='',reservation_id='r-wqaxbpm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-880389199',owner_user_name='tempest-TestVolumeSwap-880389199-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:22:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2dcffc3323db447c9625f74e82179502',uuid=dabfdb24-fc0b-4a00-a229-1ece48e27d18,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e53ca69c-b53f-4f5f-b8fa-f8a66b4177f5", "address": "fa:16:3e:9a:12:a5", "network": {"id": "6dd2923f-ee1a-4058-abfb-b1fb2b0c8325", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1188534456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cee457e31034445e82a46b87d54ef5f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape53ca69c-b5", "ovs_interfaceid": "e53ca69c-b53f-4f5f-b8fa-f8a66b4177f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 18:25:58 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-6b035742-20d4-4807-8c10-aff691273ceb tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Converting VIF {"id": "e53ca69c-b53f-4f5f-b8fa-f8a66b4177f5", "address": "fa:16:3e:9a:12:a5", "network": {"id": "6dd2923f-ee1a-4058-abfb-b1fb2b0c8325", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1188534456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cee457e31034445e82a46b87d54ef5f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape53ca69c-b5", "ovs_interfaceid": "e53ca69c-b53f-4f5f-b8fa-f8a66b4177f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:25:58 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-6b035742-20d4-4807-8c10-aff691273ceb tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:12:a5,bridge_name='br-int',has_traffic_filtering=True,id=e53ca69c-b53f-4f5f-b8fa-f8a66b4177f5,network=Network(6dd2923f-ee1a-4058-abfb-b1fb2b0c8325),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape53ca69c-b5') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:25:58 user nova-compute[72418]: DEBUG os_vif [None req-6b035742-20d4-4807-8c10-aff691273ceb tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:12:a5,bridge_name='br-int',has_traffic_filtering=True,id=e53ca69c-b53f-4f5f-b8fa-f8a66b4177f5,network=Network(6dd2923f-ee1a-4058-abfb-b1fb2b0c8325),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape53ca69c-b5') {{(pid=72418) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 18:25:58 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:58 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape53ca69c-b5, bridge=br-int, if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:25:58 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:25:58 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:25:58 user nova-compute[72418]: INFO os_vif [None req-6b035742-20d4-4807-8c10-aff691273ceb tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:12:a5,bridge_name='br-int',has_traffic_filtering=True,id=e53ca69c-b53f-4f5f-b8fa-f8a66b4177f5,network=Network(6dd2923f-ee1a-4058-abfb-b1fb2b0c8325),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape53ca69c-b5')
Aug 09 18:25:58 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-6b035742-20d4-4807-8c10-aff691273ceb tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Deleting instance files /opt/stack/data/nova/instances/dabfdb24-fc0b-4a00-a229-1ece48e27d18_del
Aug 09 18:25:58 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-6b035742-20d4-4807-8c10-aff691273ceb tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Deletion of /opt/stack/data/nova/instances/dabfdb24-fc0b-4a00-a229-1ece48e27d18_del complete
Aug 09 18:25:58 user nova-compute[72418]: INFO nova.compute.manager [None req-6b035742-20d4-4807-8c10-aff691273ceb tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 09 18:25:58 user nova-compute[72418]: DEBUG oslo.service.loopingcall [None req-6b035742-20d4-4807-8c10-aff691273ceb tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72418) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 18:25:58 user nova-compute[72418]: DEBUG nova.compute.manager [-] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Deallocating network for instance {{(pid=72418) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 18:25:58 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] deallocate_for_instance() {{(pid=72418) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 18:25:59 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:25:59 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Took 0.85 seconds to deallocate network for instance.
Aug 09 18:25:59 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-6b035742-20d4-4807-8c10-aff691273ceb tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:59 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-6b035742-20d4-4807-8c10-aff691273ceb tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:59 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-6b035742-20d4-4807-8c10-aff691273ceb tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:25:59 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-6b035742-20d4-4807-8c10-aff691273ceb tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:25:59 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-6b035742-20d4-4807-8c10-aff691273ceb tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.358s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:59 user nova-compute[72418]: INFO nova.scheduler.client.report [None req-6b035742-20d4-4807-8c10-aff691273ceb tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Deleted allocations for instance dabfdb24-fc0b-4a00-a229-1ece48e27d18
Aug 09 18:25:59 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-6b035742-20d4-4807-8c10-aff691273ceb tempest-TestVolumeSwap-880389199 tempest-TestVolumeSwap-880389199-project-member] Lock "dabfdb24-fc0b-4a00-a229-1ece48e27d18" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.239s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:59 user nova-compute[72418]: DEBUG nova.compute.manager [req-b4797446-d8ce-4aa6-b260-aee0d3c21905 req-d3e07795-ae42-43b2-a13e-7c2a604cfe3f service nova] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Received event network-vif-plugged-e53ca69c-b53f-4f5f-b8fa-f8a66b4177f5 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:25:59 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-b4797446-d8ce-4aa6-b260-aee0d3c21905 req-d3e07795-ae42-43b2-a13e-7c2a604cfe3f service nova] Acquiring lock "dabfdb24-fc0b-4a00-a229-1ece48e27d18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:25:59 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-b4797446-d8ce-4aa6-b260-aee0d3c21905 req-d3e07795-ae42-43b2-a13e-7c2a604cfe3f service nova] Lock "dabfdb24-fc0b-4a00-a229-1ece48e27d18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:25:59 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-b4797446-d8ce-4aa6-b260-aee0d3c21905 req-d3e07795-ae42-43b2-a13e-7c2a604cfe3f service nova] Lock "dabfdb24-fc0b-4a00-a229-1ece48e27d18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:25:59 user nova-compute[72418]: DEBUG nova.compute.manager [req-b4797446-d8ce-4aa6-b260-aee0d3c21905 req-d3e07795-ae42-43b2-a13e-7c2a604cfe3f service nova] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] No waiting events found dispatching network-vif-plugged-e53ca69c-b53f-4f5f-b8fa-f8a66b4177f5 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:25:59 user nova-compute[72418]: WARNING nova.compute.manager [req-b4797446-d8ce-4aa6-b260-aee0d3c21905 req-d3e07795-ae42-43b2-a13e-7c2a604cfe3f service nova] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Received unexpected event network-vif-plugged-e53ca69c-b53f-4f5f-b8fa-f8a66b4177f5 for instance with vm_state deleted and task_state None.
Aug 09 18:25:59 user nova-compute[72418]: DEBUG nova.compute.manager [req-b4797446-d8ce-4aa6-b260-aee0d3c21905 req-d3e07795-ae42-43b2-a13e-7c2a604cfe3f service nova] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Received event network-vif-deleted-e53ca69c-b53f-4f5f-b8fa-f8a66b4177f5 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:26:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:08 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:10 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-bda81cf0-c3ad-4242-be99-46d6832df5f1 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Acquiring lock "b6927390-e0f7-43cf-8a83-d3c004865129" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:26:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-bda81cf0-c3ad-4242-be99-46d6832df5f1 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Lock "b6927390-e0f7-43cf-8a83-d3c004865129" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:26:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-bda81cf0-c3ad-4242-be99-46d6832df5f1 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Acquiring lock "b6927390-e0f7-43cf-8a83-d3c004865129-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:26:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-bda81cf0-c3ad-4242-be99-46d6832df5f1 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Lock "b6927390-e0f7-43cf-8a83-d3c004865129-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:26:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-bda81cf0-c3ad-4242-be99-46d6832df5f1 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Lock "b6927390-e0f7-43cf-8a83-d3c004865129-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:26:12 user nova-compute[72418]: INFO nova.compute.manager [None req-bda81cf0-c3ad-4242-be99-46d6832df5f1 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Terminating instance
Aug 09 18:26:12 user nova-compute[72418]: DEBUG nova.compute.manager [None req-bda81cf0-c3ad-4242-be99-46d6832df5f1 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Start destroying the instance on the hypervisor. {{(pid=72418) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 18:26:12 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:12 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:12 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:13 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:13 user nova-compute[72418]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691605558.0535102, dabfdb24-fc0b-4a00-a229-1ece48e27d18 => Stopped> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:26:13 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] VM Stopped (Lifecycle Event)
Aug 09 18:26:13 user nova-compute[72418]: DEBUG nova.compute.manager [None req-dcb9a250-9b35-4fb2-add0-aa8eecf347c9 None None] [instance: dabfdb24-fc0b-4a00-a229-1ece48e27d18] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:26:13 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:13 user nova-compute[72418]: DEBUG nova.compute.manager [req-767cbd00-622f-4c0c-81d5-d135b94e9703 req-26f34eb8-52ef-4906-bfd4-31e913293335 service nova] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Received event network-vif-unplugged-50b32717-31fd-42cc-9a2c-34a0b08faff1 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:26:13 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-767cbd00-622f-4c0c-81d5-d135b94e9703 req-26f34eb8-52ef-4906-bfd4-31e913293335 service nova] Acquiring lock "b6927390-e0f7-43cf-8a83-d3c004865129-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:26:13 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-767cbd00-622f-4c0c-81d5-d135b94e9703 req-26f34eb8-52ef-4906-bfd4-31e913293335 service nova] Lock "b6927390-e0f7-43cf-8a83-d3c004865129-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:26:13 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-767cbd00-622f-4c0c-81d5-d135b94e9703 req-26f34eb8-52ef-4906-bfd4-31e913293335 service nova] Lock "b6927390-e0f7-43cf-8a83-d3c004865129-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:26:13 user nova-compute[72418]: DEBUG nova.compute.manager [req-767cbd00-622f-4c0c-81d5-d135b94e9703 req-26f34eb8-52ef-4906-bfd4-31e913293335 service nova] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] No waiting events found dispatching network-vif-unplugged-50b32717-31fd-42cc-9a2c-34a0b08faff1 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:26:13 user nova-compute[72418]: DEBUG nova.compute.manager [req-767cbd00-622f-4c0c-81d5-d135b94e9703 req-26f34eb8-52ef-4906-bfd4-31e913293335 service nova] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Received event network-vif-unplugged-50b32717-31fd-42cc-9a2c-34a0b08faff1 for instance with task_state deleting. {{(pid=72418) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 18:26:13 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Instance destroyed successfully.
Aug 09 18:26:13 user nova-compute[72418]: DEBUG nova.objects.instance [None req-bda81cf0-c3ad-4242-be99-46d6832df5f1 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Lazy-loading 'resources' on Instance uuid b6927390-e0f7-43cf-8a83-d3c004865129 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:26:13 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-bda81cf0-c3ad-4242-be99-46d6832df5f1 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:24:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-330004694',display_name='tempest-VolumesActionsTest-instance-330004694',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-330004694',id=13,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:24:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af7a7d69112347edb919fb26f98e55e3',ramdisk_id='',reservation_id='r-o27rlw1t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1905077092',owner_user_name='tempest-VolumesActionsTest-1905077092-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:24:29Z,user_data=None,user_id='cb031f5ca0bc4b7dbb600ee287a26e6f',uuid=b6927390-e0f7-43cf-8a83-d3c004865129,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50b32717-31fd-42cc-9a2c-34a0b08faff1", "address": "fa:16:3e:81:2b:fc", "network": {"id": "c14fe632-b9ef-4551-8767-8bd9520ab900", "bridge": "br-int", "label": "tempest-VolumesActionsTest-889666224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7a7d69112347edb919fb26f98e55e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50b32717-31", "ovs_interfaceid": "50b32717-31fd-42cc-9a2c-34a0b08faff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 18:26:13 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-bda81cf0-c3ad-4242-be99-46d6832df5f1 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Converting VIF {"id": "50b32717-31fd-42cc-9a2c-34a0b08faff1", "address": "fa:16:3e:81:2b:fc", "network": {"id": "c14fe632-b9ef-4551-8767-8bd9520ab900", "bridge": "br-int", "label": "tempest-VolumesActionsTest-889666224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7a7d69112347edb919fb26f98e55e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50b32717-31", "ovs_interfaceid": "50b32717-31fd-42cc-9a2c-34a0b08faff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:26:13 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-bda81cf0-c3ad-4242-be99-46d6832df5f1 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:2b:fc,bridge_name='br-int',has_traffic_filtering=True,id=50b32717-31fd-42cc-9a2c-34a0b08faff1,network=Network(c14fe632-b9ef-4551-8767-8bd9520ab900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50b32717-31') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:26:13 user nova-compute[72418]: DEBUG os_vif [None req-bda81cf0-c3ad-4242-be99-46d6832df5f1 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:2b:fc,bridge_name='br-int',has_traffic_filtering=True,id=50b32717-31fd-42cc-9a2c-34a0b08faff1,network=Network(c14fe632-b9ef-4551-8767-8bd9520ab900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50b32717-31') {{(pid=72418) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 18:26:13 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:13 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap50b32717-31, bridge=br-int, if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:26:13 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:13 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:26:13 user nova-compute[72418]: INFO os_vif [None req-bda81cf0-c3ad-4242-be99-46d6832df5f1 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:2b:fc,bridge_name='br-int',has_traffic_filtering=True,id=50b32717-31fd-42cc-9a2c-34a0b08faff1,network=Network(c14fe632-b9ef-4551-8767-8bd9520ab900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50b32717-31')
Aug 09 18:26:13 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-bda81cf0-c3ad-4242-be99-46d6832df5f1 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Deleting instance files /opt/stack/data/nova/instances/b6927390-e0f7-43cf-8a83-d3c004865129_del
Aug 09 18:26:13 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-bda81cf0-c3ad-4242-be99-46d6832df5f1 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Deletion of /opt/stack/data/nova/instances/b6927390-e0f7-43cf-8a83-d3c004865129_del complete
Aug 09 18:26:13 user nova-compute[72418]: INFO nova.compute.manager [None req-bda81cf0-c3ad-4242-be99-46d6832df5f1 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Took 0.68 seconds to destroy the instance on the hypervisor.
Aug 09 18:26:13 user nova-compute[72418]: DEBUG oslo.service.loopingcall [None req-bda81cf0-c3ad-4242-be99-46d6832df5f1 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72418) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 18:26:13 user nova-compute[72418]: DEBUG nova.compute.manager [-] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Deallocating network for instance {{(pid=72418) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 18:26:13 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] deallocate_for_instance() {{(pid=72418) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 18:26:14 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:26:14 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Took 0.56 seconds to deallocate network for instance.
Aug 09 18:26:14 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-bda81cf0-c3ad-4242-be99-46d6832df5f1 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:26:14 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-bda81cf0-c3ad-4242-be99-46d6832df5f1 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:26:14 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:14 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-bda81cf0-c3ad-4242-be99-46d6832df5f1 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:26:14 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-bda81cf0-c3ad-4242-be99-46d6832df5f1 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:26:14 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-bda81cf0-c3ad-4242-be99-46d6832df5f1 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.402s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:26:14 user nova-compute[72418]: INFO nova.scheduler.client.report [None req-bda81cf0-c3ad-4242-be99-46d6832df5f1 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Deleted allocations for instance b6927390-e0f7-43cf-8a83-d3c004865129
Aug 09 18:26:14 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-bda81cf0-c3ad-4242-be99-46d6832df5f1 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Lock "b6927390-e0f7-43cf-8a83-d3c004865129" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.860s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:26:14 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:15 user nova-compute[72418]: DEBUG nova.compute.manager [req-343b075b-245b-4bd9-85d8-a7e883b29701 req-e69fccb1-121c-47a0-805d-aa5eba418f9d service nova] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Received event network-vif-plugged-50b32717-31fd-42cc-9a2c-34a0b08faff1 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:26:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-343b075b-245b-4bd9-85d8-a7e883b29701 req-e69fccb1-121c-47a0-805d-aa5eba418f9d service nova] Acquiring lock "b6927390-e0f7-43cf-8a83-d3c004865129-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:26:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-343b075b-245b-4bd9-85d8-a7e883b29701 req-e69fccb1-121c-47a0-805d-aa5eba418f9d service nova] Lock "b6927390-e0f7-43cf-8a83-d3c004865129-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:26:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-343b075b-245b-4bd9-85d8-a7e883b29701 req-e69fccb1-121c-47a0-805d-aa5eba418f9d service nova] Lock "b6927390-e0f7-43cf-8a83-d3c004865129-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:26:15 user nova-compute[72418]: DEBUG nova.compute.manager [req-343b075b-245b-4bd9-85d8-a7e883b29701 req-e69fccb1-121c-47a0-805d-aa5eba418f9d service nova] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] No waiting events found dispatching network-vif-plugged-50b32717-31fd-42cc-9a2c-34a0b08faff1 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:26:15 user nova-compute[72418]: WARNING nova.compute.manager [req-343b075b-245b-4bd9-85d8-a7e883b29701 req-e69fccb1-121c-47a0-805d-aa5eba418f9d service nova] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Received unexpected event network-vif-plugged-50b32717-31fd-42cc-9a2c-34a0b08faff1 for instance with vm_state deleted and task_state None.
Aug 09 18:26:15 user nova-compute[72418]: DEBUG nova.compute.manager [req-343b075b-245b-4bd9-85d8-a7e883b29701 req-e69fccb1-121c-47a0-805d-aa5eba418f9d service nova] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Received event network-vif-deleted-50b32717-31fd-42cc-9a2c-34a0b08faff1 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:26:18 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:18 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:20 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:22 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:23 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:23 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:24 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-b87699c9-77a2-4ff8-9963-bac3864512b0 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Acquiring lock "d9d5d476-484e-49a3-a665-5a2069ea606e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:26:24 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-b87699c9-77a2-4ff8-9963-bac3864512b0 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Lock "d9d5d476-484e-49a3-a665-5a2069ea606e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:26:24 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-b87699c9-77a2-4ff8-9963-bac3864512b0 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Acquiring lock "d9d5d476-484e-49a3-a665-5a2069ea606e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:26:24 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-b87699c9-77a2-4ff8-9963-bac3864512b0 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Lock "d9d5d476-484e-49a3-a665-5a2069ea606e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:26:24 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-b87699c9-77a2-4ff8-9963-bac3864512b0 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Lock "d9d5d476-484e-49a3-a665-5a2069ea606e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:26:24 user nova-compute[72418]: INFO nova.compute.manager [None req-b87699c9-77a2-4ff8-9963-bac3864512b0 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Terminating instance
Aug 09 18:26:24 user nova-compute[72418]: DEBUG nova.compute.manager [None req-b87699c9-77a2-4ff8-9963-bac3864512b0 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Start destroying the instance on the hypervisor. {{(pid=72418) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 18:26:24 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:24 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:24 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:24 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:24 user nova-compute[72418]: DEBUG nova.compute.manager [req-92777d3a-d97a-4b62-8ed0-57f90c74e6e0 req-0b1a5e15-44a2-4306-b966-7d7eabf67799 service nova] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Received event network-vif-unplugged-2472f1be-ea8f-46b6-a4f3-481f517c7edd {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:26:24 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-92777d3a-d97a-4b62-8ed0-57f90c74e6e0 req-0b1a5e15-44a2-4306-b966-7d7eabf67799 service nova] Acquiring lock "d9d5d476-484e-49a3-a665-5a2069ea606e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:26:24 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-92777d3a-d97a-4b62-8ed0-57f90c74e6e0 req-0b1a5e15-44a2-4306-b966-7d7eabf67799 service nova] Lock "d9d5d476-484e-49a3-a665-5a2069ea606e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:26:24 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-92777d3a-d97a-4b62-8ed0-57f90c74e6e0 req-0b1a5e15-44a2-4306-b966-7d7eabf67799 service nova] Lock "d9d5d476-484e-49a3-a665-5a2069ea606e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:26:24 user nova-compute[72418]: DEBUG nova.compute.manager [req-92777d3a-d97a-4b62-8ed0-57f90c74e6e0 req-0b1a5e15-44a2-4306-b966-7d7eabf67799 service nova] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] No waiting events found dispatching network-vif-unplugged-2472f1be-ea8f-46b6-a4f3-481f517c7edd {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:26:24 user nova-compute[72418]: DEBUG nova.compute.manager [req-92777d3a-d97a-4b62-8ed0-57f90c74e6e0 req-0b1a5e15-44a2-4306-b966-7d7eabf67799 service nova] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Received event network-vif-unplugged-2472f1be-ea8f-46b6-a4f3-481f517c7edd for instance with task_state deleting. {{(pid=72418) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 18:26:24 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Instance destroyed successfully.
Aug 09 18:26:24 user nova-compute[72418]: DEBUG nova.objects.instance [None req-b87699c9-77a2-4ff8-9963-bac3864512b0 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Lazy-loading 'resources' on Instance uuid d9d5d476-484e-49a3-a665-5a2069ea606e {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-b87699c9-77a2-4ff8-9963-bac3864512b0 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T18:22:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1508281415',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-575459132',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTlpxVeNhPxeJuW8zTxzwBKwT/CA/qFwbFSyGFFQ5WBC/z6rTuUG5Drvoef5DHSqpEg+qFNytmw3WteLGcKSZH4mMFqTcywv5Hy3vANpNfa+6Xl/MY5tiOWNwwb6BRwFw==',key_name='tempest-keypair-546529688',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:25:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='64ada6c609434916beb7b6a1d117a993',ramdisk_id='',reservation_id='r-fnsl4oak',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1647763299',owner_user_name='tempest-ServerActionsV293TestJSON-1647763299-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:25:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3a35ad1146840949d0f1cc4780efa2b',uuid=d9d5d476-484e-49a3-a665-5a2069ea606e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2472f1be-ea8f-46b6-a4f3-481f517c7edd", "address": "fa:16:3e:86:93:dc", "network": {"id": "eddf3956-c192-42b3-b928-5e9cf4f07f5f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1344000484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64ada6c609434916beb7b6a1d117a993", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2472f1be-ea", "ovs_interfaceid": "2472f1be-ea8f-46b6-a4f3-481f517c7edd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-b87699c9-77a2-4ff8-9963-bac3864512b0 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Converting VIF {"id": "2472f1be-ea8f-46b6-a4f3-481f517c7edd", "address": "fa:16:3e:86:93:dc", "network": {"id": "eddf3956-c192-42b3-b928-5e9cf4f07f5f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1344000484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64ada6c609434916beb7b6a1d117a993", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2472f1be-ea", "ovs_interfaceid": "2472f1be-ea8f-46b6-a4f3-481f517c7edd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-b87699c9-77a2-4ff8-9963-bac3864512b0 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:93:dc,bridge_name='br-int',has_traffic_filtering=True,id=2472f1be-ea8f-46b6-a4f3-481f517c7edd,network=Network(eddf3956-c192-42b3-b928-5e9cf4f07f5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2472f1be-ea') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG os_vif [None req-b87699c9-77a2-4ff8-9963-bac3864512b0 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:93:dc,bridge_name='br-int',has_traffic_filtering=True,id=2472f1be-ea8f-46b6-a4f3-481f517c7edd,network=Network(eddf3956-c192-42b3-b928-5e9cf4f07f5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2472f1be-ea') {{(pid=72418) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2472f1be-ea, bridge=br-int, if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:25 user nova-compute[72418]: INFO os_vif [None req-b87699c9-77a2-4ff8-9963-bac3864512b0 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:93:dc,bridge_name='br-int',has_traffic_filtering=True,id=2472f1be-ea8f-46b6-a4f3-481f517c7edd,network=Network(eddf3956-c192-42b3-b928-5e9cf4f07f5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2472f1be-ea')
Aug 09 18:26:25 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b87699c9-77a2-4ff8-9963-bac3864512b0 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] calling os-brick to detach iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b87699c9-77a2-4ff8-9963-bac3864512b0 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, {'target_iqns': ['iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TUdEGbkO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:26:25 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-b87699c9-77a2-4ff8-9963-bac3864512b0 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:26:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-b87699c9-77a2-4ff8-9963-bac3864512b0 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-b87699c9-77a2-4ff8-9963-bac3864512b0 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b87699c9-77a2-4ff8-9963-bac3864512b0 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424', 0)] {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[24938d10-4263-4640-88ad-c69fca11f135]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1e6181-88e6-4bb7-9216-8d45dca53a24]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b87699c9-77a2-4ff8-9963-bac3864512b0 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:26:25 user nova-compute[72418]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:26:25 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b87699c9-77a2-4ff8-9963-bac3864512b0 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 (non-flash)
Aug 09 18:26:25 user nova-compute[72418]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:26:25 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b87699c9-77a2-4ff8-9963-bac3864512b0 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f42f84220e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424'): ({'sdg'}, set())}) {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-b87699c9-77a2-4ff8-9963-bac3864512b0 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Removing single pathed devices sdg {{(pid=72418) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.034s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f53095-5e2b-4307-a5c3-14286492c1af]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.024s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[1557d305-70d3-4948-be2f-f9e097856ae8]: (4, ('ok\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-b87699c9-77a2-4ff8-9963-bac3864512b0 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Flushing IO for device /dev/sdg {{(pid=72418) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[92fa4842-297d-42ef-9913-71d58e5177a4]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-b87699c9-77a2-4ff8-9963-bac3864512b0 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72418) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.041s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c179ea98-efa4-4f10-9ec8-8bc97c566c28]: (4, ('1', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-b87699c9-77a2-4ff8-9963-bac3864512b0 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-b87699c9-77a2-4ff8-9963-bac3864512b0 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] SCSI volumes sdg have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_685254e0', '/dev/disk/by-id/scsi-1SCST_BIO685254e0-d8d84c0c0d8711bb', '/dev/disk/by-id/scsi-26438643834633063') {{(pid=83046) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec72cc3-e410-4b51-9fcc-1b5cf6429df5]: (4, None) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b87699c9-77a2-4ff8-9963-bac3864512b0 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424')] {{(pid=72418) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c1b609-6643-4780-96d8-b6b5d7dc2a39]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b87699c9-77a2-4ff8-9963-bac3864512b0 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 -p 172.16.0.220:3260 --logout {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25d0c52-4dd3-4b8d-be25-4685d9d38950]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b87699c9-77a2-4ff8-9963-bac3864512b0 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424, portal: 172.16.0.220,3260]
Aug 09 18:26:25 user nova-compute[72418]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424, portal: 172.16.0.220,3260] successful.
Aug 09 18:26:25 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 -p 172.16.0.220:3260 --op delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63025fe7-5619-4f33-85cb-044aca432424 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[001f505e-fad7-4eac-93fe-fa0185496b1f]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b87699c9-77a2-4ff8-9963-bac3864512b0 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-b87699c9-77a2-4ff8-9963-bac3864512b0 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-b87699c9-77a2-4ff8-9963-bac3864512b0 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] <== disconnect_volume: return (345ms) None {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b87699c9-77a2-4ff8-9963-bac3864512b0 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Disconnected iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 18:26:25 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-b87699c9-77a2-4ff8-9963-bac3864512b0 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Deleting instance files /opt/stack/data/nova/instances/d9d5d476-484e-49a3-a665-5a2069ea606e_del
Aug 09 18:26:25 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-b87699c9-77a2-4ff8-9963-bac3864512b0 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Deletion of /opt/stack/data/nova/instances/d9d5d476-484e-49a3-a665-5a2069ea606e_del complete
Aug 09 18:26:25 user nova-compute[72418]: INFO nova.compute.manager [None req-b87699c9-77a2-4ff8-9963-bac3864512b0 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Took 1.26 seconds to destroy the instance on the hypervisor.
Aug 09 18:26:25 user nova-compute[72418]: DEBUG oslo.service.loopingcall [None req-b87699c9-77a2-4ff8-9963-bac3864512b0 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72418) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG nova.compute.manager [-] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Deallocating network for instance {{(pid=72418) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] deallocate_for_instance() {{(pid=72418) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 18:26:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:26 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:26:26 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Took 0.96 seconds to deallocate network for instance.
Aug 09 18:26:26 user nova-compute[72418]: DEBUG nova.compute.manager [req-928423d9-0555-40bf-a8bc-fe5cc1f73ac2 req-0a9fa7b1-3986-42e1-8f6b-70345115fae9 service nova] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Received event network-vif-deleted-2472f1be-ea8f-46b6-a4f3-481f517c7edd {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:26:26 user nova-compute[72418]: DEBUG nova.compute.manager [req-7728d813-aaa7-49b0-a576-ee67d729760c req-8bbbf98e-863c-4099-9423-be7b304e99e8 service nova] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Received event network-vif-plugged-2472f1be-ea8f-46b6-a4f3-481f517c7edd {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:26:26 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-7728d813-aaa7-49b0-a576-ee67d729760c req-8bbbf98e-863c-4099-9423-be7b304e99e8 service nova] Acquiring lock "d9d5d476-484e-49a3-a665-5a2069ea606e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:26:26 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-7728d813-aaa7-49b0-a576-ee67d729760c req-8bbbf98e-863c-4099-9423-be7b304e99e8 service nova] Lock "d9d5d476-484e-49a3-a665-5a2069ea606e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:26:26 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-7728d813-aaa7-49b0-a576-ee67d729760c req-8bbbf98e-863c-4099-9423-be7b304e99e8 service nova] Lock "d9d5d476-484e-49a3-a665-5a2069ea606e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:26:26 user nova-compute[72418]: DEBUG nova.compute.manager [req-7728d813-aaa7-49b0-a576-ee67d729760c req-8bbbf98e-863c-4099-9423-be7b304e99e8 service nova] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] No waiting events found dispatching network-vif-plugged-2472f1be-ea8f-46b6-a4f3-481f517c7edd {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:26:26 user nova-compute[72418]: WARNING nova.compute.manager [req-7728d813-aaa7-49b0-a576-ee67d729760c req-8bbbf98e-863c-4099-9423-be7b304e99e8 service nova] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Received unexpected event network-vif-plugged-2472f1be-ea8f-46b6-a4f3-481f517c7edd for instance with vm_state active and task_state deleting.
Aug 09 18:26:27 user nova-compute[72418]: INFO nova.compute.manager [None req-b87699c9-77a2-4ff8-9963-bac3864512b0 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Took 0.80 seconds to detach 1 volumes for instance.
Aug 09 18:26:27 user nova-compute[72418]: DEBUG nova.compute.manager [None req-b87699c9-77a2-4ff8-9963-bac3864512b0 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Deleting volume: 63025fe7-5619-4f33-85cb-044aca432424 {{(pid=72418) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 09 18:26:27 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-b87699c9-77a2-4ff8-9963-bac3864512b0 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:26:27 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-b87699c9-77a2-4ff8-9963-bac3864512b0 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:26:27 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:27 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-b87699c9-77a2-4ff8-9963-bac3864512b0 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:26:27 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-b87699c9-77a2-4ff8-9963-bac3864512b0 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:26:27 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-b87699c9-77a2-4ff8-9963-bac3864512b0 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.344s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:26:27 user nova-compute[72418]: INFO nova.scheduler.client.report [None req-b87699c9-77a2-4ff8-9963-bac3864512b0 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Deleted allocations for instance d9d5d476-484e-49a3-a665-5a2069ea606e
Aug 09 18:26:27 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-b87699c9-77a2-4ff8-9963-bac3864512b0 tempest-ServerActionsV293TestJSON-1647763299 tempest-ServerActionsV293TestJSON-1647763299-project-member] Lock "d9d5d476-484e-49a3-a665-5a2069ea606e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.664s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:26:28 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:28 user nova-compute[72418]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691605573.3995938, b6927390-e0f7-43cf-8a83-d3c004865129 => Stopped> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:26:28 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] VM Stopped (Lifecycle Event)
Aug 09 18:26:28 user nova-compute[72418]: DEBUG nova.compute.manager [None req-daee5815-7c97-413e-adde-9571a122581f None None] [instance: b6927390-e0f7-43cf-8a83-d3c004865129] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:26:28 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:30 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:31 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:32 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Acquiring lock "c46f2599-93f8-412e-9918-7ace8a9f19dd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:26:32 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "c46f2599-93f8-412e-9918-7ace8a9f19dd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:26:32 user nova-compute[72418]: DEBUG nova.compute.manager [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Starting instance... {{(pid=72418) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 18:26:32 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:26:32 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:26:32 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72418) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 18:26:32 user nova-compute[72418]: INFO nova.compute.claims [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Claim successful on node user
Aug 09 18:26:32 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:32 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:26:32 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:26:32 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.479s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:26:32 user nova-compute[72418]: DEBUG nova.compute.manager [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Start building networks asynchronously for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 18:26:32 user nova-compute[72418]: DEBUG nova.compute.manager [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Allocating IP information in the background. {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 18:26:32 user nova-compute[72418]: DEBUG nova.network.neutron [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] allocate_for_instance() {{(pid=72418) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 18:26:32 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 18:26:32 user nova-compute[72418]: DEBUG nova.compute.manager [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Start building block device mappings for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 18:26:33 user nova-compute[72418]: DEBUG nova.policy [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'edc9ed6980274b978caf0666a9b31379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b6e36a5b61456092ce7de9212c3c82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72418) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 18:26:33 user nova-compute[72418]: DEBUG nova.compute.manager [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Start spawning the instance on the hypervisor. {{(pid=72418) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 18:26:33 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Creating instance directory {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 18:26:33 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Creating image(s)
Aug 09 18:26:33 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Acquiring lock "/opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:26:33 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "/opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:26:33 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "/opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:26:33 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:33 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.148s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:33 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Acquiring lock "458773cfa7230b717e41c60277832e9f83806d71" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:26:33 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:26:33 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:33 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.143s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:33 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk 1073741824 {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:33 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk 1073741824" returned: 0 in 0.059s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:33 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.209s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:26:33 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:33 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.147s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:33 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk. size=1073741824 {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 18:26:33 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:33 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:33 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Cannot resize image /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk to a smaller size. {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 18:26:33 user nova-compute[72418]: DEBUG nova.objects.instance [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lazy-loading 'migration_context' on Instance uuid c46f2599-93f8-412e-9918-7ace8a9f19dd {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:26:33 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Created local disks {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 18:26:33 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Ensure instance console log exists: /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/console.log {{(pid=72418) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 18:26:33 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:26:33 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:26:33 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:26:33 user nova-compute[72418]: DEBUG nova.network.neutron [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Successfully created port: 6c9676d3-6e5d-4a95-a24f-0df4a15e993d {{(pid=72418) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 18:26:35 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:35 user nova-compute[72418]: DEBUG nova.network.neutron [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Successfully updated port: 6c9676d3-6e5d-4a95-a24f-0df4a15e993d {{(pid=72418) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 18:26:35 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Acquiring lock "refresh_cache-c46f2599-93f8-412e-9918-7ace8a9f19dd" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:26:35 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Acquired lock "refresh_cache-c46f2599-93f8-412e-9918-7ace8a9f19dd" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:26:35 user nova-compute[72418]: DEBUG nova.network.neutron [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:26:35 user nova-compute[72418]: DEBUG nova.compute.manager [req-c4009030-fef8-4396-9d79-bd92c9764404 req-e171ca88-ffcc-4f5e-b0b5-644835d5d12f service nova] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Received event network-changed-6c9676d3-6e5d-4a95-a24f-0df4a15e993d {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:26:35 user nova-compute[72418]: DEBUG nova.compute.manager [req-c4009030-fef8-4396-9d79-bd92c9764404 req-e171ca88-ffcc-4f5e-b0b5-644835d5d12f service nova] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Refreshing instance network info cache due to event network-changed-6c9676d3-6e5d-4a95-a24f-0df4a15e993d. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:26:35 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-c4009030-fef8-4396-9d79-bd92c9764404 req-e171ca88-ffcc-4f5e-b0b5-644835d5d12f service nova] Acquiring lock "refresh_cache-c46f2599-93f8-412e-9918-7ace8a9f19dd" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:26:35 user nova-compute[72418]: DEBUG nova.network.neutron [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Instance cache missing network info. {{(pid=72418) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 18:26:35 user nova-compute[72418]: DEBUG nova.network.neutron [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Updating instance_info_cache with network_info: [{"id": "6c9676d3-6e5d-4a95-a24f-0df4a15e993d", "address": "fa:16:3e:80:17:d9", "network": {"id": "bd36ef30-e57d-473f-97bc-c51b5db08aa7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-425133239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78b6e36a5b61456092ce7de9212c3c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9676d3-6e", "ovs_interfaceid": "6c9676d3-6e5d-4a95-a24f-0df4a15e993d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:26:35 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Releasing lock "refresh_cache-c46f2599-93f8-412e-9918-7ace8a9f19dd" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:26:35 user nova-compute[72418]: DEBUG nova.compute.manager [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Instance network_info: |[{"id": "6c9676d3-6e5d-4a95-a24f-0df4a15e993d", "address": "fa:16:3e:80:17:d9", "network": {"id": "bd36ef30-e57d-473f-97bc-c51b5db08aa7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-425133239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78b6e36a5b61456092ce7de9212c3c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9676d3-6e", "ovs_interfaceid": "6c9676d3-6e5d-4a95-a24f-0df4a15e993d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 18:26:35 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-c4009030-fef8-4396-9d79-bd92c9764404 req-e171ca88-ffcc-4f5e-b0b5-644835d5d12f service nova] Acquired lock "refresh_cache-c46f2599-93f8-412e-9918-7ace8a9f19dd" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:26:35 user nova-compute[72418]: DEBUG nova.network.neutron [req-c4009030-fef8-4396-9d79-bd92c9764404 req-e171ca88-ffcc-4f5e-b0b5-644835d5d12f service nova] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Refreshing network info cache for port 6c9676d3-6e5d-4a95-a24f-0df4a15e993d {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:26:35 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Start _get_guest_xml network_info=[{"id": "6c9676d3-6e5d-4a95-a24f-0df4a15e993d", "address": "fa:16:3e:80:17:d9", "network": {"id": "bd36ef30-e57d-473f-97bc-c51b5db08aa7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-425133239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78b6e36a5b61456092ce7de9212c3c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9676d3-6e", "ovs_interfaceid": "6c9676d3-6e5d-4a95-a24f-0df4a15e993d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 18:26:35 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:26:35 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:26:35 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 18:26:35 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] CPU controller missing on host. {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 18:26:35 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 18:26:35 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] CPU controller found on host. {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 18:26:35 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72418) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 18:26:35 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T18:17:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 18:26:35 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Flavor limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 18:26:35 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Image limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 18:26:35 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Flavor pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 18:26:35 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Image pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 18:26:35 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 18:26:35 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 18:26:35 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 18:26:35 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Got 1 possible topologies {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 18:26:35 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 18:26:35 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 18:26:35 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:26:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1080698985',display_name='tempest-ServerActionsTestOtherA-server-1080698985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1080698985',id=17,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZ8H8MvJhas/vPLXexc9KvUsV16Uhsl6uYTaDGrZC9aE3rBb3x7zoV+NqPR5zKzOIkCqtgn8ZVvU3tdtAtEAYrB/yDbEIXvY0hEVuVM8ww17BzMc60Vtn0IN61LmfWZ8Q==',key_name='tempest-keypair-882054128',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='78b6e36a5b61456092ce7de9212c3c82',ramdisk_id='',reservation_id='r-g13uz4wm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1039384122',owner_user_name='tempest-ServerActionsTestOtherA-1039384122-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:26:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='edc9ed6980274b978caf0666a9b31379',uuid=c46f2599-93f8-412e-9918-7ace8a9f19dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c9676d3-6e5d-4a95-a24f-0df4a15e993d", "address": "fa:16:3e:80:17:d9", "network": {"id": "bd36ef30-e57d-473f-97bc-c51b5db08aa7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-425133239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78b6e36a5b61456092ce7de9212c3c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9676d3-6e", "ovs_interfaceid": "6c9676d3-6e5d-4a95-a24f-0df4a15e993d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:26:35 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Converting VIF {"id": "6c9676d3-6e5d-4a95-a24f-0df4a15e993d", "address": "fa:16:3e:80:17:d9", "network": {"id": "bd36ef30-e57d-473f-97bc-c51b5db08aa7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-425133239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78b6e36a5b61456092ce7de9212c3c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9676d3-6e", "ovs_interfaceid": "6c9676d3-6e5d-4a95-a24f-0df4a15e993d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:26:35 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:17:d9,bridge_name='br-int',has_traffic_filtering=True,id=6c9676d3-6e5d-4a95-a24f-0df4a15e993d,network=Network(bd36ef30-e57d-473f-97bc-c51b5db08aa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9676d3-6e') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:26:35 user nova-compute[72418]: DEBUG nova.objects.instance [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lazy-loading 'pci_devices' on Instance uuid c46f2599-93f8-412e-9918-7ace8a9f19dd {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:26:35 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] End _get_guest_xml xml=<domain type="kvm">
Aug 09 18:26:35 user nova-compute[72418]:   <uuid>c46f2599-93f8-412e-9918-7ace8a9f19dd</uuid>
Aug 09 18:26:35 user nova-compute[72418]:   <name>instance-00000011</name>
Aug 09 18:26:35 user nova-compute[72418]:   <memory>524288</memory>
Aug 09 18:26:35 user nova-compute[72418]:   <vcpu>1</vcpu>
Aug 09 18:26:35 user nova-compute[72418]:   <metadata>
Aug 09 18:26:35 user nova-compute[72418]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:26:35 user nova-compute[72418]:       <nova:package version="0.0.0"/>
Aug 09 18:26:35 user nova-compute[72418]:       <nova:name>tempest-ServerActionsTestOtherA-server-1080698985</nova:name>
Aug 09 18:26:35 user nova-compute[72418]:       <nova:creationTime>2023-08-09 18:26:35</nova:creationTime>
Aug 09 18:26:35 user nova-compute[72418]:       <nova:flavor name="m1.tiny">
Aug 09 18:26:35 user nova-compute[72418]:         <nova:memory>512</nova:memory>
Aug 09 18:26:35 user nova-compute[72418]:         <nova:disk>1</nova:disk>
Aug 09 18:26:35 user nova-compute[72418]:         <nova:swap>0</nova:swap>
Aug 09 18:26:35 user nova-compute[72418]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:26:35 user nova-compute[72418]:         <nova:vcpus>1</nova:vcpus>
Aug 09 18:26:35 user nova-compute[72418]:       </nova:flavor>
Aug 09 18:26:35 user nova-compute[72418]:       <nova:owner>
Aug 09 18:26:35 user nova-compute[72418]:         <nova:user uuid="edc9ed6980274b978caf0666a9b31379">tempest-ServerActionsTestOtherA-1039384122-project-member</nova:user>
Aug 09 18:26:35 user nova-compute[72418]:         <nova:project uuid="78b6e36a5b61456092ce7de9212c3c82">tempest-ServerActionsTestOtherA-1039384122</nova:project>
Aug 09 18:26:35 user nova-compute[72418]:       </nova:owner>
Aug 09 18:26:35 user nova-compute[72418]:       <nova:root type="image" uuid="8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e"/>
Aug 09 18:26:35 user nova-compute[72418]:       <nova:ports>
Aug 09 18:26:35 user nova-compute[72418]:         <nova:port uuid="6c9676d3-6e5d-4a95-a24f-0df4a15e993d">
Aug 09 18:26:35 user nova-compute[72418]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 09 18:26:35 user nova-compute[72418]:         </nova:port>
Aug 09 18:26:35 user nova-compute[72418]:       </nova:ports>
Aug 09 18:26:35 user nova-compute[72418]:     </nova:instance>
Aug 09 18:26:35 user nova-compute[72418]:   </metadata>
Aug 09 18:26:35 user nova-compute[72418]:   <sysinfo type="smbios">
Aug 09 18:26:35 user nova-compute[72418]:     <system>
Aug 09 18:26:35 user nova-compute[72418]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 18:26:35 user nova-compute[72418]:       <entry name="product">OpenStack Nova</entry>
Aug 09 18:26:35 user nova-compute[72418]:       <entry name="version">0.0.0</entry>
Aug 09 18:26:35 user nova-compute[72418]:       <entry name="serial">c46f2599-93f8-412e-9918-7ace8a9f19dd</entry>
Aug 09 18:26:35 user nova-compute[72418]:       <entry name="uuid">c46f2599-93f8-412e-9918-7ace8a9f19dd</entry>
Aug 09 18:26:35 user nova-compute[72418]:       <entry name="family">Virtual Machine</entry>
Aug 09 18:26:35 user nova-compute[72418]:     </system>
Aug 09 18:26:35 user nova-compute[72418]:   </sysinfo>
Aug 09 18:26:35 user nova-compute[72418]:   <os>
Aug 09 18:26:35 user nova-compute[72418]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 18:26:35 user nova-compute[72418]:     <boot dev="hd"/>
Aug 09 18:26:35 user nova-compute[72418]:     <smbios mode="sysinfo"/>
Aug 09 18:26:35 user nova-compute[72418]:   </os>
Aug 09 18:26:35 user nova-compute[72418]:   <features>
Aug 09 18:26:35 user nova-compute[72418]:     <acpi/>
Aug 09 18:26:35 user nova-compute[72418]:     <apic/>
Aug 09 18:26:35 user nova-compute[72418]:     <vmcoreinfo/>
Aug 09 18:26:35 user nova-compute[72418]:   </features>
Aug 09 18:26:35 user nova-compute[72418]:   <clock offset="utc">
Aug 09 18:26:35 user nova-compute[72418]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 18:26:35 user nova-compute[72418]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 18:26:35 user nova-compute[72418]:     <timer name="hpet" present="no"/>
Aug 09 18:26:35 user nova-compute[72418]:   </clock>
Aug 09 18:26:35 user nova-compute[72418]:   <cpu mode="custom" match="exact">
Aug 09 18:26:35 user nova-compute[72418]:     <model>Nehalem</model>
Aug 09 18:26:35 user nova-compute[72418]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 18:26:35 user nova-compute[72418]:   </cpu>
Aug 09 18:26:35 user nova-compute[72418]:   <devices>
Aug 09 18:26:35 user nova-compute[72418]:     <disk type="file" device="disk">
Aug 09 18:26:35 user nova-compute[72418]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 18:26:35 user nova-compute[72418]:       <source file="/opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk"/>
Aug 09 18:26:35 user nova-compute[72418]:       <target dev="vda" bus="virtio"/>
Aug 09 18:26:35 user nova-compute[72418]:     </disk>
Aug 09 18:26:35 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:26:35 user nova-compute[72418]:       <mac address="fa:16:3e:80:17:d9"/>
Aug 09 18:26:35 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:26:35 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:26:35 user nova-compute[72418]:       <target dev="tap6c9676d3-6e"/>
Aug 09 18:26:35 user nova-compute[72418]:     </interface>
Aug 09 18:26:35 user nova-compute[72418]:     <serial type="pty">
Aug 09 18:26:35 user nova-compute[72418]:       <log file="/opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/console.log" append="off"/>
Aug 09 18:26:35 user nova-compute[72418]:     </serial>
Aug 09 18:26:35 user nova-compute[72418]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 18:26:35 user nova-compute[72418]:     <video>
Aug 09 18:26:35 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:26:35 user nova-compute[72418]:     </video>
Aug 09 18:26:35 user nova-compute[72418]:     <rng model="virtio">
Aug 09 18:26:35 user nova-compute[72418]:       <backend model="random">/dev/urandom</backend>
Aug 09 18:26:35 user nova-compute[72418]:     </rng>
Aug 09 18:26:35 user nova-compute[72418]:     <controller type="usb" index="0" model="none"/>
Aug 09 18:26:35 user nova-compute[72418]:     <memballoon model="virtio">
Aug 09 18:26:35 user nova-compute[72418]:       <stats period="10"/>
Aug 09 18:26:35 user nova-compute[72418]:     </memballoon>
Aug 09 18:26:35 user nova-compute[72418]:   </devices>
Aug 09 18:26:35 user nova-compute[72418]: </domain>
Aug 09 18:26:35 user nova-compute[72418]:  {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 18:26:35 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:26:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1080698985',display_name='tempest-ServerActionsTestOtherA-server-1080698985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1080698985',id=17,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZ8H8MvJhas/vPLXexc9KvUsV16Uhsl6uYTaDGrZC9aE3rBb3x7zoV+NqPR5zKzOIkCqtgn8ZVvU3tdtAtEAYrB/yDbEIXvY0hEVuVM8ww17BzMc60Vtn0IN61LmfWZ8Q==',key_name='tempest-keypair-882054128',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='78b6e36a5b61456092ce7de9212c3c82',ramdisk_id='',reservation_id='r-g13uz4wm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1039384122',owner_user_name='tempest-ServerActionsTestOtherA-1039384122-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:26:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='edc9ed6980274b978caf0666a9b31379',uuid=c46f2599-93f8-412e-9918-7ace8a9f19dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c9676d3-6e5d-4a95-a24f-0df4a15e993d", "address": "fa:16:3e:80:17:d9", "network": {"id": "bd36ef30-e57d-473f-97bc-c51b5db08aa7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-425133239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78b6e36a5b61456092ce7de9212c3c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9676d3-6e", "ovs_interfaceid": "6c9676d3-6e5d-4a95-a24f-0df4a15e993d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:26:35 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Converting VIF {"id": "6c9676d3-6e5d-4a95-a24f-0df4a15e993d", "address": "fa:16:3e:80:17:d9", "network": {"id": "bd36ef30-e57d-473f-97bc-c51b5db08aa7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-425133239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78b6e36a5b61456092ce7de9212c3c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9676d3-6e", "ovs_interfaceid": "6c9676d3-6e5d-4a95-a24f-0df4a15e993d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:26:35 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:17:d9,bridge_name='br-int',has_traffic_filtering=True,id=6c9676d3-6e5d-4a95-a24f-0df4a15e993d,network=Network(bd36ef30-e57d-473f-97bc-c51b5db08aa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9676d3-6e') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:26:35 user nova-compute[72418]: DEBUG os_vif [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:17:d9,bridge_name='br-int',has_traffic_filtering=True,id=6c9676d3-6e5d-4a95-a24f-0df4a15e993d,network=Network(bd36ef30-e57d-473f-97bc-c51b5db08aa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9676d3-6e') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:26:35 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:35 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:26:35 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:26:35 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:35 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6c9676d3-6e, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:26:35 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6c9676d3-6e, col_values=(('external_ids', {'iface-id': '6c9676d3-6e5d-4a95-a24f-0df4a15e993d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:17:d9', 'vm-uuid': 'c46f2599-93f8-412e-9918-7ace8a9f19dd'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:26:35 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:35 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:26:35 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:35 user nova-compute[72418]: INFO os_vif [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:17:d9,bridge_name='br-int',has_traffic_filtering=True,id=6c9676d3-6e5d-4a95-a24f-0df4a15e993d,network=Network(bd36ef30-e57d-473f-97bc-c51b5db08aa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9676d3-6e')
Aug 09 18:26:35 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:26:35 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] No VIF found with MAC fa:16:3e:80:17:d9, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:26:35 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-2bacd487-1fb6-41ad-a31f-345af6cb9eea tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Acquiring lock "28dad451-f27e-4c62-8353-e3b89e0196cd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:26:35 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-2bacd487-1fb6-41ad-a31f-345af6cb9eea tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Lock "28dad451-f27e-4c62-8353-e3b89e0196cd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:26:35 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-2bacd487-1fb6-41ad-a31f-345af6cb9eea tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Acquiring lock "28dad451-f27e-4c62-8353-e3b89e0196cd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:26:35 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-2bacd487-1fb6-41ad-a31f-345af6cb9eea tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Lock "28dad451-f27e-4c62-8353-e3b89e0196cd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:26:35 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-2bacd487-1fb6-41ad-a31f-345af6cb9eea tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Lock "28dad451-f27e-4c62-8353-e3b89e0196cd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:26:35 user nova-compute[72418]: INFO nova.compute.manager [None req-2bacd487-1fb6-41ad-a31f-345af6cb9eea tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Terminating instance
Aug 09 18:26:35 user nova-compute[72418]: DEBUG nova.compute.manager [None req-2bacd487-1fb6-41ad-a31f-345af6cb9eea tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Start destroying the instance on the hypervisor. {{(pid=72418) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 18:26:35 user nova-compute[72418]: DEBUG nova.network.neutron [req-c4009030-fef8-4396-9d79-bd92c9764404 req-e171ca88-ffcc-4f5e-b0b5-644835d5d12f service nova] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Updated VIF entry in instance network info cache for port 6c9676d3-6e5d-4a95-a24f-0df4a15e993d. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:26:35 user nova-compute[72418]: DEBUG nova.network.neutron [req-c4009030-fef8-4396-9d79-bd92c9764404 req-e171ca88-ffcc-4f5e-b0b5-644835d5d12f service nova] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Updating instance_info_cache with network_info: [{"id": "6c9676d3-6e5d-4a95-a24f-0df4a15e993d", "address": "fa:16:3e:80:17:d9", "network": {"id": "bd36ef30-e57d-473f-97bc-c51b5db08aa7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-425133239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78b6e36a5b61456092ce7de9212c3c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9676d3-6e", "ovs_interfaceid": "6c9676d3-6e5d-4a95-a24f-0df4a15e993d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:26:35 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-c4009030-fef8-4396-9d79-bd92c9764404 req-e171ca88-ffcc-4f5e-b0b5-644835d5d12f service nova] Releasing lock "refresh_cache-c46f2599-93f8-412e-9918-7ace8a9f19dd" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:26:36 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:36 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:36 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:36 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:36 user nova-compute[72418]: DEBUG nova.compute.manager [req-98085ec1-c4a2-420d-909b-c971e8fb6d64 req-7e8858c9-6de7-43d8-a7f2-c7b57f9ece7d service nova] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Received event network-vif-unplugged-c634ea3f-4db3-4c0f-ac00-42c822c095ab {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:26:36 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-98085ec1-c4a2-420d-909b-c971e8fb6d64 req-7e8858c9-6de7-43d8-a7f2-c7b57f9ece7d service nova] Acquiring lock "28dad451-f27e-4c62-8353-e3b89e0196cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:26:36 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-98085ec1-c4a2-420d-909b-c971e8fb6d64 req-7e8858c9-6de7-43d8-a7f2-c7b57f9ece7d service nova] Lock "28dad451-f27e-4c62-8353-e3b89e0196cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:26:36 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-98085ec1-c4a2-420d-909b-c971e8fb6d64 req-7e8858c9-6de7-43d8-a7f2-c7b57f9ece7d service nova] Lock "28dad451-f27e-4c62-8353-e3b89e0196cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:26:36 user nova-compute[72418]: DEBUG nova.compute.manager [req-98085ec1-c4a2-420d-909b-c971e8fb6d64 req-7e8858c9-6de7-43d8-a7f2-c7b57f9ece7d service nova] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] No waiting events found dispatching network-vif-unplugged-c634ea3f-4db3-4c0f-ac00-42c822c095ab {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:26:36 user nova-compute[72418]: DEBUG nova.compute.manager [req-98085ec1-c4a2-420d-909b-c971e8fb6d64 req-7e8858c9-6de7-43d8-a7f2-c7b57f9ece7d service nova] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Received event network-vif-unplugged-c634ea3f-4db3-4c0f-ac00-42c822c095ab for instance with task_state deleting. {{(pid=72418) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 18:26:36 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:36 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:37 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Instance destroyed successfully.
Aug 09 18:26:37 user nova-compute[72418]: DEBUG nova.objects.instance [None req-2bacd487-1fb6-41ad-a31f-345af6cb9eea tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Lazy-loading 'resources' on Instance uuid 28dad451-f27e-4c62-8353-e3b89e0196cd {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:26:37 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-2bacd487-1fb6-41ad-a31f-345af6cb9eea tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:23:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-639325370',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-639325370',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-6393253',id=11,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIoqToZAlYsdBm6NV31jJe8Jx6210KEYutt67Hi68ZFARzjHLDzp/rIi9kVGURo9o44L634qGu1D9iYiMX9U5sCzvsIwQpAbB5vFMWm55ks2DotDjDyEDYhSlt3A/LGN1w==',key_name='tempest-keypair-1921005649',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:23:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9c2418c1ed345928b81431d728f2650',ramdisk_id='',reservation_id='r-j0iqfk4p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2001119544',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:23:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa49b18d00ad41c6a2c7d2a9e91b1206',uuid=28dad451-f27e-4c62-8353-e3b89e0196cd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c634ea3f-4db3-4c0f-ac00-42c822c095ab", "address": "fa:16:3e:27:2e:34", "network": {"id": "cdf92d6c-8d60-4947-b73b-38686728c14e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2096407534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9c2418c1ed345928b81431d728f2650", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc634ea3f-4d", "ovs_interfaceid": "c634ea3f-4db3-4c0f-ac00-42c822c095ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 18:26:37 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-2bacd487-1fb6-41ad-a31f-345af6cb9eea tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Converting VIF {"id": "c634ea3f-4db3-4c0f-ac00-42c822c095ab", "address": "fa:16:3e:27:2e:34", "network": {"id": "cdf92d6c-8d60-4947-b73b-38686728c14e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2096407534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9c2418c1ed345928b81431d728f2650", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc634ea3f-4d", "ovs_interfaceid": "c634ea3f-4db3-4c0f-ac00-42c822c095ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:26:37 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-2bacd487-1fb6-41ad-a31f-345af6cb9eea tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:2e:34,bridge_name='br-int',has_traffic_filtering=True,id=c634ea3f-4db3-4c0f-ac00-42c822c095ab,network=Network(cdf92d6c-8d60-4947-b73b-38686728c14e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc634ea3f-4d') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:26:37 user nova-compute[72418]: DEBUG os_vif [None req-2bacd487-1fb6-41ad-a31f-345af6cb9eea tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:2e:34,bridge_name='br-int',has_traffic_filtering=True,id=c634ea3f-4db3-4c0f-ac00-42c822c095ab,network=Network(cdf92d6c-8d60-4947-b73b-38686728c14e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc634ea3f-4d') {{(pid=72418) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 18:26:37 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:37 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc634ea3f-4d, bridge=br-int, if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:26:37 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:37 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:26:37 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:37 user nova-compute[72418]: INFO os_vif [None req-2bacd487-1fb6-41ad-a31f-345af6cb9eea tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:2e:34,bridge_name='br-int',has_traffic_filtering=True,id=c634ea3f-4db3-4c0f-ac00-42c822c095ab,network=Network(cdf92d6c-8d60-4947-b73b-38686728c14e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc634ea3f-4d')
Aug 09 18:26:37 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-2bacd487-1fb6-41ad-a31f-345af6cb9eea tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Deleting instance files /opt/stack/data/nova/instances/28dad451-f27e-4c62-8353-e3b89e0196cd_del
Aug 09 18:26:37 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-2bacd487-1fb6-41ad-a31f-345af6cb9eea tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Deletion of /opt/stack/data/nova/instances/28dad451-f27e-4c62-8353-e3b89e0196cd_del complete
Aug 09 18:26:37 user nova-compute[72418]: INFO nova.compute.manager [None req-2bacd487-1fb6-41ad-a31f-345af6cb9eea tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Took 1.23 seconds to destroy the instance on the hypervisor.
Aug 09 18:26:37 user nova-compute[72418]: DEBUG oslo.service.loopingcall [None req-2bacd487-1fb6-41ad-a31f-345af6cb9eea tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72418) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 18:26:37 user nova-compute[72418]: DEBUG nova.compute.manager [-] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Deallocating network for instance {{(pid=72418) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 18:26:37 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] deallocate_for_instance() {{(pid=72418) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 18:26:37 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:37 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:37 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:37 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:38 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:26:38 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Took 1.07 seconds to deallocate network for instance.
Aug 09 18:26:38 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:38 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:38 user nova-compute[72418]: DEBUG nova.compute.manager [req-c4f99540-f867-43f8-a72f-de01915c0b7e req-ca7bf218-2a82-4c9e-9f8d-c37bcda99578 service nova] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Received event network-vif-deleted-c634ea3f-4db3-4c0f-ac00-42c822c095ab {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:26:38 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:38 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-2bacd487-1fb6-41ad-a31f-345af6cb9eea tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:26:38 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-2bacd487-1fb6-41ad-a31f-345af6cb9eea tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:26:38 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Acquiring lock "8abe9dfb-2bc7-41f3-adba-7ba00f3af83c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:26:38 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Lock "8abe9dfb-2bc7-41f3-adba-7ba00f3af83c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:26:38 user nova-compute[72418]: DEBUG nova.compute.manager [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Starting instance... {{(pid=72418) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 18:26:38 user nova-compute[72418]: DEBUG nova.compute.manager [req-1f0d57c4-9ab3-44fa-a33c-bb8fe2bc847e req-f30a55ce-3bd2-4475-8268-ed9e4bc81948 service nova] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Received event network-vif-plugged-c634ea3f-4db3-4c0f-ac00-42c822c095ab {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:26:38 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-1f0d57c4-9ab3-44fa-a33c-bb8fe2bc847e req-f30a55ce-3bd2-4475-8268-ed9e4bc81948 service nova] Acquiring lock "28dad451-f27e-4c62-8353-e3b89e0196cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:26:38 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-1f0d57c4-9ab3-44fa-a33c-bb8fe2bc847e req-f30a55ce-3bd2-4475-8268-ed9e4bc81948 service nova] Lock "28dad451-f27e-4c62-8353-e3b89e0196cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:26:38 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-1f0d57c4-9ab3-44fa-a33c-bb8fe2bc847e req-f30a55ce-3bd2-4475-8268-ed9e4bc81948 service nova] Lock "28dad451-f27e-4c62-8353-e3b89e0196cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:26:38 user nova-compute[72418]: DEBUG nova.compute.manager [req-1f0d57c4-9ab3-44fa-a33c-bb8fe2bc847e req-f30a55ce-3bd2-4475-8268-ed9e4bc81948 service nova] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] No waiting events found dispatching network-vif-plugged-c634ea3f-4db3-4c0f-ac00-42c822c095ab {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:26:38 user nova-compute[72418]: WARNING nova.compute.manager [req-1f0d57c4-9ab3-44fa-a33c-bb8fe2bc847e req-f30a55ce-3bd2-4475-8268-ed9e4bc81948 service nova] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Received unexpected event network-vif-plugged-c634ea3f-4db3-4c0f-ac00-42c822c095ab for instance with vm_state deleted and task_state None.
Aug 09 18:26:38 user nova-compute[72418]: DEBUG nova.compute.manager [req-1f0d57c4-9ab3-44fa-a33c-bb8fe2bc847e req-f30a55ce-3bd2-4475-8268-ed9e4bc81948 service nova] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Received event network-vif-plugged-6c9676d3-6e5d-4a95-a24f-0df4a15e993d {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:26:38 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-1f0d57c4-9ab3-44fa-a33c-bb8fe2bc847e req-f30a55ce-3bd2-4475-8268-ed9e4bc81948 service nova] Acquiring lock "c46f2599-93f8-412e-9918-7ace8a9f19dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:26:38 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-1f0d57c4-9ab3-44fa-a33c-bb8fe2bc847e req-f30a55ce-3bd2-4475-8268-ed9e4bc81948 service nova] Lock "c46f2599-93f8-412e-9918-7ace8a9f19dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:26:38 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-1f0d57c4-9ab3-44fa-a33c-bb8fe2bc847e req-f30a55ce-3bd2-4475-8268-ed9e4bc81948 service nova] Lock "c46f2599-93f8-412e-9918-7ace8a9f19dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:26:38 user nova-compute[72418]: DEBUG nova.compute.manager [req-1f0d57c4-9ab3-44fa-a33c-bb8fe2bc847e req-f30a55ce-3bd2-4475-8268-ed9e4bc81948 service nova] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] No waiting events found dispatching network-vif-plugged-6c9676d3-6e5d-4a95-a24f-0df4a15e993d {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:26:38 user nova-compute[72418]: WARNING nova.compute.manager [req-1f0d57c4-9ab3-44fa-a33c-bb8fe2bc847e req-f30a55ce-3bd2-4475-8268-ed9e4bc81948 service nova] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Received unexpected event network-vif-plugged-6c9676d3-6e5d-4a95-a24f-0df4a15e993d for instance with vm_state building and task_state spawning.
Aug 09 18:26:38 user nova-compute[72418]: DEBUG nova.compute.manager [req-1f0d57c4-9ab3-44fa-a33c-bb8fe2bc847e req-f30a55ce-3bd2-4475-8268-ed9e4bc81948 service nova] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Received event network-vif-plugged-6c9676d3-6e5d-4a95-a24f-0df4a15e993d {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:26:38 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-1f0d57c4-9ab3-44fa-a33c-bb8fe2bc847e req-f30a55ce-3bd2-4475-8268-ed9e4bc81948 service nova] Acquiring lock "c46f2599-93f8-412e-9918-7ace8a9f19dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:26:38 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-1f0d57c4-9ab3-44fa-a33c-bb8fe2bc847e req-f30a55ce-3bd2-4475-8268-ed9e4bc81948 service nova] Lock "c46f2599-93f8-412e-9918-7ace8a9f19dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:26:38 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-1f0d57c4-9ab3-44fa-a33c-bb8fe2bc847e req-f30a55ce-3bd2-4475-8268-ed9e4bc81948 service nova] Lock "c46f2599-93f8-412e-9918-7ace8a9f19dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:26:38 user nova-compute[72418]: DEBUG nova.compute.manager [req-1f0d57c4-9ab3-44fa-a33c-bb8fe2bc847e req-f30a55ce-3bd2-4475-8268-ed9e4bc81948 service nova] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] No waiting events found dispatching network-vif-plugged-6c9676d3-6e5d-4a95-a24f-0df4a15e993d {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:26:38 user nova-compute[72418]: WARNING nova.compute.manager [req-1f0d57c4-9ab3-44fa-a33c-bb8fe2bc847e req-f30a55ce-3bd2-4475-8268-ed9e4bc81948 service nova] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Received unexpected event network-vif-plugged-6c9676d3-6e5d-4a95-a24f-0df4a15e993d for instance with vm_state building and task_state spawning.
Aug 09 18:26:38 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:26:38 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-2bacd487-1fb6-41ad-a31f-345af6cb9eea tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:26:38 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-2bacd487-1fb6-41ad-a31f-345af6cb9eea tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:26:38 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-2bacd487-1fb6-41ad-a31f-345af6cb9eea tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.362s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:26:38 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.184s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:26:38 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72418) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 18:26:38 user nova-compute[72418]: INFO nova.compute.claims [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Claim successful on node user
Aug 09 18:26:38 user nova-compute[72418]: INFO nova.scheduler.client.report [None req-2bacd487-1fb6-41ad-a31f-345af6cb9eea tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Deleted allocations for instance 28dad451-f27e-4c62-8353-e3b89e0196cd
Aug 09 18:26:38 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-2bacd487-1fb6-41ad-a31f-345af6cb9eea tempest-TestServerVolumeAttachScenarioOldVersion-2001119544 tempest-TestServerVolumeAttachScenarioOldVersion-2001119544-project-member] Lock "28dad451-f27e-4c62-8353-e3b89e0196cd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.904s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:26:39 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:26:39 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:26:39 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.440s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:26:39 user nova-compute[72418]: DEBUG nova.compute.manager [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Start building networks asynchronously for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 18:26:39 user nova-compute[72418]: DEBUG nova.compute.manager [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Allocating IP information in the background. {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 18:26:39 user nova-compute[72418]: DEBUG nova.network.neutron [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] allocate_for_instance() {{(pid=72418) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 18:26:39 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 09 18:26:39 user nova-compute[72418]: DEBUG nova.compute.manager [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Start building block device mappings for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 18:26:39 user nova-compute[72418]: DEBUG nova.policy [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '43008ce004de4019b0e7ea8a9fef7701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '154f8492962c4c69876520aaa2b2e8aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72418) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 18:26:39 user nova-compute[72418]: DEBUG nova.compute.manager [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Start spawning the instance on the hypervisor. {{(pid=72418) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 18:26:39 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Creating instance directory {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 18:26:39 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Creating image(s)
Aug 09 18:26:39 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Acquiring lock "/opt/stack/data/nova/instances/8abe9dfb-2bc7-41f3-adba-7ba00f3af83c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:26:39 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Lock "/opt/stack/data/nova/instances/8abe9dfb-2bc7-41f3-adba-7ba00f3af83c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:26:39 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Lock "/opt/stack/data/nova/instances/8abe9dfb-2bc7-41f3-adba-7ba00f3af83c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:26:39 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Acquiring lock "72917c8912a8c37418f54ea946db0d481275f72a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:26:39 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Lock "72917c8912a8c37418f54ea946db0d481275f72a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:26:39 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72917c8912a8c37418f54ea946db0d481275f72a.part --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:39 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605599.7454922, c46f2599-93f8-412e-9918-7ace8a9f19dd => Resumed> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:26:39 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] VM Resumed (Lifecycle Event)
Aug 09 18:26:39 user nova-compute[72418]: DEBUG nova.compute.manager [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Instance event wait completed in 0 seconds for  {{(pid=72418) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 18:26:39 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Guest created on hypervisor {{(pid=72418) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 18:26:39 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Instance spawned successfully.
Aug 09 18:26:39 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 18:26:39 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:26:39 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:26:39 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Found default for hw_cdrom_bus of ide {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:26:39 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Found default for hw_disk_bus of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:26:39 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Found default for hw_input_bus of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:26:39 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Found default for hw_pointer_model of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:26:39 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Found default for hw_video_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:26:39 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Found default for hw_vif_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:26:39 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:26:39 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605599.7455966, c46f2599-93f8-412e-9918-7ace8a9f19dd => Started> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:26:39 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] VM Started (Lifecycle Event)
Aug 09 18:26:39 user nova-compute[72418]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691605584.9790406, d9d5d476-484e-49a3-a665-5a2069ea606e => Stopped> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:26:39 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] VM Stopped (Lifecycle Event)
Aug 09 18:26:39 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72917c8912a8c37418f54ea946db0d481275f72a.part --force-share --output=json" returned: 0 in 0.145s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:40 user nova-compute[72418]: DEBUG nova.virt.images [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] 2dd3b5c7-4579-4bd7-b6f0-3425a2d3fa88 was qcow2, converting to raw {{(pid=72418) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 18:26:40 user nova-compute[72418]: DEBUG nova.privsep.utils [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72418) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 18:26:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/72917c8912a8c37418f54ea946db0d481275f72a.part /opt/stack/data/nova/instances/_base/72917c8912a8c37418f54ea946db0d481275f72a.converted {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:40 user nova-compute[72418]: DEBUG nova.compute.manager [None req-cdbc57b0-0254-400a-bc09-c0ebc0ef4e94 None None] [instance: d9d5d476-484e-49a3-a665-5a2069ea606e] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:26:40 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:26:40 user nova-compute[72418]: INFO nova.compute.manager [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Took 6.94 seconds to spawn the instance on the hypervisor.
Aug 09 18:26:40 user nova-compute[72418]: DEBUG nova.compute.manager [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:26:40 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:26:40 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:26:40 user nova-compute[72418]: INFO nova.compute.manager [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Took 7.91 seconds to build instance.
Aug 09 18:26:40 user nova-compute[72418]: DEBUG nova.network.neutron [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Successfully created port: 927916e6-8d94-4529-bb6f-0be5a98cafac {{(pid=72418) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 18:26:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/72917c8912a8c37418f54ea946db0d481275f72a.part /opt/stack/data/nova/instances/_base/72917c8912a8c37418f54ea946db0d481275f72a.converted" returned: 0 in 0.269s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72917c8912a8c37418f54ea946db0d481275f72a.converted --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:40 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-34716dfb-4072-4221-b0ea-122ec8ebd469 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "c46f2599-93f8-412e-9918-7ace8a9f19dd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.112s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:26:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72917c8912a8c37418f54ea946db0d481275f72a.converted --force-share --output=json" returned: 0 in 0.169s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:40 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Lock "72917c8912a8c37418f54ea946db0d481275f72a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.091s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:26:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72917c8912a8c37418f54ea946db0d481275f72a --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:40 user nova-compute[72418]: INFO nova.compute.manager [None req-4cef4370-2828-43dc-8ddf-b75ab9208a18 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Rescuing
Aug 09 18:26:40 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-4cef4370-2828-43dc-8ddf-b75ab9208a18 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Acquiring lock "refresh_cache-6af7918a-ce90-45ab-93d8-684e1489e891" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:26:40 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-4cef4370-2828-43dc-8ddf-b75ab9208a18 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Acquired lock "refresh_cache-6af7918a-ce90-45ab-93d8-684e1489e891" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:26:40 user nova-compute[72418]: DEBUG nova.network.neutron [None req-4cef4370-2828-43dc-8ddf-b75ab9208a18 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:26:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72917c8912a8c37418f54ea946db0d481275f72a --force-share --output=json" returned: 0 in 0.161s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:40 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Acquiring lock "72917c8912a8c37418f54ea946db0d481275f72a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:26:40 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Lock "72917c8912a8c37418f54ea946db0d481275f72a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:26:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72917c8912a8c37418f54ea946db0d481275f72a --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72917c8912a8c37418f54ea946db0d481275f72a --force-share --output=json" returned: 0 in 0.137s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72917c8912a8c37418f54ea946db0d481275f72a,backing_fmt=raw /opt/stack/data/nova/instances/8abe9dfb-2bc7-41f3-adba-7ba00f3af83c/disk 1073741824 {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72917c8912a8c37418f54ea946db0d481275f72a,backing_fmt=raw /opt/stack/data/nova/instances/8abe9dfb-2bc7-41f3-adba-7ba00f3af83c/disk 1073741824" returned: 0 in 0.063s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:40 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Lock "72917c8912a8c37418f54ea946db0d481275f72a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.207s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:26:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72917c8912a8c37418f54ea946db0d481275f72a --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72917c8912a8c37418f54ea946db0d481275f72a --force-share --output=json" returned: 0 in 0.167s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:41 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8abe9dfb-2bc7-41f3-adba-7ba00f3af83c/disk. size=1073741824 {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 18:26:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8abe9dfb-2bc7-41f3-adba-7ba00f3af83c/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8abe9dfb-2bc7-41f3-adba-7ba00f3af83c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:41 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Cannot resize image /opt/stack/data/nova/instances/8abe9dfb-2bc7-41f3-adba-7ba00f3af83c/disk to a smaller size. {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 18:26:41 user nova-compute[72418]: DEBUG nova.objects.instance [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Lazy-loading 'migration_context' on Instance uuid 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:26:41 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Created local disks {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 18:26:41 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Ensure instance console log exists: /opt/stack/data/nova/instances/8abe9dfb-2bc7-41f3-adba-7ba00f3af83c/console.log {{(pid=72418) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 18:26:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:26:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:26:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:26:41 user nova-compute[72418]: DEBUG nova.network.neutron [None req-4cef4370-2828-43dc-8ddf-b75ab9208a18 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Updating instance_info_cache with network_info: [{"id": "2b44ecc4-13c5-43ba-8425-5f42d86bc716", "address": "fa:16:3e:8d:41:82", "network": {"id": "15a49d9b-3c0d-449b-9473-29f219960e2c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c68622cd79472ba6ad14a6876aeaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b44ecc4-13", "ovs_interfaceid": "2b44ecc4-13c5-43ba-8425-5f42d86bc716", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:26:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-4cef4370-2828-43dc-8ddf-b75ab9208a18 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Releasing lock "refresh_cache-6af7918a-ce90-45ab-93d8-684e1489e891" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:26:41 user nova-compute[72418]: DEBUG nova.network.neutron [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Successfully updated port: 927916e6-8d94-4529-bb6f-0be5a98cafac {{(pid=72418) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 18:26:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Acquiring lock "refresh_cache-8abe9dfb-2bc7-41f3-adba-7ba00f3af83c" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:26:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Acquired lock "refresh_cache-8abe9dfb-2bc7-41f3-adba-7ba00f3af83c" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:26:41 user nova-compute[72418]: DEBUG nova.network.neutron [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:26:41 user nova-compute[72418]: DEBUG nova.compute.manager [req-d4417b2c-9dc1-4ab0-bd3e-fcfb7c0bbc58 req-49e84b8d-8401-421b-b358-140c34d1cbb9 service nova] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Received event network-changed-927916e6-8d94-4529-bb6f-0be5a98cafac {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:26:41 user nova-compute[72418]: DEBUG nova.compute.manager [req-d4417b2c-9dc1-4ab0-bd3e-fcfb7c0bbc58 req-49e84b8d-8401-421b-b358-140c34d1cbb9 service nova] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Refreshing instance network info cache due to event network-changed-927916e6-8d94-4529-bb6f-0be5a98cafac. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:26:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-d4417b2c-9dc1-4ab0-bd3e-fcfb7c0bbc58 req-49e84b8d-8401-421b-b358-140c34d1cbb9 service nova] Acquiring lock "refresh_cache-8abe9dfb-2bc7-41f3-adba-7ba00f3af83c" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:26:41 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:41 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:41 user nova-compute[72418]: DEBUG nova.network.neutron [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Instance cache missing network info. {{(pid=72418) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 18:26:41 user nova-compute[72418]: DEBUG nova.compute.manager [req-a81c71f9-9398-4cc0-8012-c2ee4c51ce62 req-991fa9eb-f4ea-4299-ae35-82a71ddc5c97 service nova] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Received event network-vif-unplugged-2b44ecc4-13c5-43ba-8425-5f42d86bc716 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:26:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a81c71f9-9398-4cc0-8012-c2ee4c51ce62 req-991fa9eb-f4ea-4299-ae35-82a71ddc5c97 service nova] Acquiring lock "6af7918a-ce90-45ab-93d8-684e1489e891-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:26:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a81c71f9-9398-4cc0-8012-c2ee4c51ce62 req-991fa9eb-f4ea-4299-ae35-82a71ddc5c97 service nova] Lock "6af7918a-ce90-45ab-93d8-684e1489e891-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:26:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a81c71f9-9398-4cc0-8012-c2ee4c51ce62 req-991fa9eb-f4ea-4299-ae35-82a71ddc5c97 service nova] Lock "6af7918a-ce90-45ab-93d8-684e1489e891-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:26:41 user nova-compute[72418]: DEBUG nova.compute.manager [req-a81c71f9-9398-4cc0-8012-c2ee4c51ce62 req-991fa9eb-f4ea-4299-ae35-82a71ddc5c97 service nova] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] No waiting events found dispatching network-vif-unplugged-2b44ecc4-13c5-43ba-8425-5f42d86bc716 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:26:41 user nova-compute[72418]: WARNING nova.compute.manager [req-a81c71f9-9398-4cc0-8012-c2ee4c51ce62 req-991fa9eb-f4ea-4299-ae35-82a71ddc5c97 service nova] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Received unexpected event network-vif-unplugged-2b44ecc4-13c5-43ba-8425-5f42d86bc716 for instance with vm_state active and task_state rescuing.
Aug 09 18:26:41 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:41 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:41 user nova-compute[72418]: DEBUG nova.network.neutron [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Updating instance_info_cache with network_info: [{"id": "927916e6-8d94-4529-bb6f-0be5a98cafac", "address": "fa:16:3e:a9:b9:b3", "network": {"id": "58f83624-fe55-4b3a-b3d6-a4a38df692e4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-638473817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "154f8492962c4c69876520aaa2b2e8aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap927916e6-8d", "ovs_interfaceid": "927916e6-8d94-4529-bb6f-0be5a98cafac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:26:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Releasing lock "refresh_cache-8abe9dfb-2bc7-41f3-adba-7ba00f3af83c" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:26:41 user nova-compute[72418]: DEBUG nova.compute.manager [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Instance network_info: |[{"id": "927916e6-8d94-4529-bb6f-0be5a98cafac", "address": "fa:16:3e:a9:b9:b3", "network": {"id": "58f83624-fe55-4b3a-b3d6-a4a38df692e4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-638473817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "154f8492962c4c69876520aaa2b2e8aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap927916e6-8d", "ovs_interfaceid": "927916e6-8d94-4529-bb6f-0be5a98cafac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 18:26:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-d4417b2c-9dc1-4ab0-bd3e-fcfb7c0bbc58 req-49e84b8d-8401-421b-b358-140c34d1cbb9 service nova] Acquired lock "refresh_cache-8abe9dfb-2bc7-41f3-adba-7ba00f3af83c" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:26:41 user nova-compute[72418]: DEBUG nova.network.neutron [req-d4417b2c-9dc1-4ab0-bd3e-fcfb7c0bbc58 req-49e84b8d-8401-421b-b358-140c34d1cbb9 service nova] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Refreshing network info cache for port 927916e6-8d94-4529-bb6f-0be5a98cafac {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Start _get_guest_xml network_info=[{"id": "927916e6-8d94-4529-bb6f-0be5a98cafac", "address": "fa:16:3e:a9:b9:b3", "network": {"id": "58f83624-fe55-4b3a-b3d6-a4a38df692e4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-638473817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "154f8492962c4c69876520aaa2b2e8aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap927916e6-8d", "ovs_interfaceid": "927916e6-8d94-4529-bb6f-0be5a98cafac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:26:33Z,direct_url=<?>,disk_format='qcow2',id=2dd3b5c7-4579-4bd7-b6f0-3425a2d3fa88,min_disk=0,min_ram=0,name='',owner='1d70fc11765347b88c051403c373e1d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:26:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encrypted': False, 'disk_bus': 'scsi', 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/sda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '2dd3b5c7-4579-4bd7-b6f0-3425a2d3fa88'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 18:26:42 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:26:42 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] CPU controller missing on host. {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] CPU controller found on host. {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72418) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T18:17:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:26:33Z,direct_url=<?>,disk_format='qcow2',id=2dd3b5c7-4579-4bd7-b6f0-3425a2d3fa88,min_disk=0,min_ram=0,name='',owner='1d70fc11765347b88c051403c373e1d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:26:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Flavor limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Image limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Flavor pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Image pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Got 1 possible topologies {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T18:26:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-317502969',display_name='tempest-AttachSCSIVolumeTestJSON-server-317502969',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-317502969',id=18,image_ref='2dd3b5c7-4579-4bd7-b6f0-3425a2d3fa88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDvXzV9a+9+R9rG4sUxH35UR3XfOKob5UVPn7AuwH5O1QwX3a7b5J/z5l13L0879jSt64hhZV3MzsTzaUvqlZRPOHoS8MV02mA2nwvnMfpg3VrOo5xure1kCT1u/lo4pNw==',key_name='tempest-keypair-1156144079',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='154f8492962c4c69876520aaa2b2e8aa',ramdisk_id='',reservation_id='r-bf0jv510',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2dd3b5c7-4579-4bd7-b6f0-3425a2d3fa88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-633262233',owner_user_name='tempest-AttachSCSIVolumeTestJSON-633262233-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:26:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43008ce004de4019b0e7ea8a9fef7701',uuid=8abe9dfb-2bc7-41f3-adba-7ba00f3af83c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "927916e6-8d94-4529-bb6f-0be5a98cafac", "address": "fa:16:3e:a9:b9:b3", "network": {"id": "58f83624-fe55-4b3a-b3d6-a4a38df692e4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-638473817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "154f8492962c4c69876520aaa2b2e8aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap927916e6-8d", "ovs_interfaceid": "927916e6-8d94-4529-bb6f-0be5a98cafac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Converting VIF {"id": "927916e6-8d94-4529-bb6f-0be5a98cafac", "address": "fa:16:3e:a9:b9:b3", "network": {"id": "58f83624-fe55-4b3a-b3d6-a4a38df692e4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-638473817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "154f8492962c4c69876520aaa2b2e8aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap927916e6-8d", "ovs_interfaceid": "927916e6-8d94-4529-bb6f-0be5a98cafac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:b9:b3,bridge_name='br-int',has_traffic_filtering=True,id=927916e6-8d94-4529-bb6f-0be5a98cafac,network=Network(58f83624-fe55-4b3a-b3d6-a4a38df692e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap927916e6-8d') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.objects.instance [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Lazy-loading 'pci_devices' on Instance uuid 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:42 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Instance destroyed successfully.
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] End _get_guest_xml xml=<domain type="kvm">
Aug 09 18:26:42 user nova-compute[72418]:   <uuid>8abe9dfb-2bc7-41f3-adba-7ba00f3af83c</uuid>
Aug 09 18:26:42 user nova-compute[72418]:   <name>instance-00000012</name>
Aug 09 18:26:42 user nova-compute[72418]:   <memory>524288</memory>
Aug 09 18:26:42 user nova-compute[72418]:   <vcpu>1</vcpu>
Aug 09 18:26:42 user nova-compute[72418]:   <metadata>
Aug 09 18:26:42 user nova-compute[72418]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:26:42 user nova-compute[72418]:       <nova:package version="0.0.0"/>
Aug 09 18:26:42 user nova-compute[72418]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-317502969</nova:name>
Aug 09 18:26:42 user nova-compute[72418]:       <nova:creationTime>2023-08-09 18:26:42</nova:creationTime>
Aug 09 18:26:42 user nova-compute[72418]:       <nova:flavor name="m1.tiny">
Aug 09 18:26:42 user nova-compute[72418]:         <nova:memory>512</nova:memory>
Aug 09 18:26:42 user nova-compute[72418]:         <nova:disk>1</nova:disk>
Aug 09 18:26:42 user nova-compute[72418]:         <nova:swap>0</nova:swap>
Aug 09 18:26:42 user nova-compute[72418]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:26:42 user nova-compute[72418]:         <nova:vcpus>1</nova:vcpus>
Aug 09 18:26:42 user nova-compute[72418]:       </nova:flavor>
Aug 09 18:26:42 user nova-compute[72418]:       <nova:owner>
Aug 09 18:26:42 user nova-compute[72418]:         <nova:user uuid="43008ce004de4019b0e7ea8a9fef7701">tempest-AttachSCSIVolumeTestJSON-633262233-project-member</nova:user>
Aug 09 18:26:42 user nova-compute[72418]:         <nova:project uuid="154f8492962c4c69876520aaa2b2e8aa">tempest-AttachSCSIVolumeTestJSON-633262233</nova:project>
Aug 09 18:26:42 user nova-compute[72418]:       </nova:owner>
Aug 09 18:26:42 user nova-compute[72418]:       <nova:root type="image" uuid="2dd3b5c7-4579-4bd7-b6f0-3425a2d3fa88"/>
Aug 09 18:26:42 user nova-compute[72418]:       <nova:ports>
Aug 09 18:26:42 user nova-compute[72418]:         <nova:port uuid="927916e6-8d94-4529-bb6f-0be5a98cafac">
Aug 09 18:26:42 user nova-compute[72418]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 18:26:42 user nova-compute[72418]:         </nova:port>
Aug 09 18:26:42 user nova-compute[72418]:       </nova:ports>
Aug 09 18:26:42 user nova-compute[72418]:     </nova:instance>
Aug 09 18:26:42 user nova-compute[72418]:   </metadata>
Aug 09 18:26:42 user nova-compute[72418]:   <sysinfo type="smbios">
Aug 09 18:26:42 user nova-compute[72418]:     <system>
Aug 09 18:26:42 user nova-compute[72418]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 18:26:42 user nova-compute[72418]:       <entry name="product">OpenStack Nova</entry>
Aug 09 18:26:42 user nova-compute[72418]:       <entry name="version">0.0.0</entry>
Aug 09 18:26:42 user nova-compute[72418]:       <entry name="serial">8abe9dfb-2bc7-41f3-adba-7ba00f3af83c</entry>
Aug 09 18:26:42 user nova-compute[72418]:       <entry name="uuid">8abe9dfb-2bc7-41f3-adba-7ba00f3af83c</entry>
Aug 09 18:26:42 user nova-compute[72418]:       <entry name="family">Virtual Machine</entry>
Aug 09 18:26:42 user nova-compute[72418]:     </system>
Aug 09 18:26:42 user nova-compute[72418]:   </sysinfo>
Aug 09 18:26:42 user nova-compute[72418]:   <os>
Aug 09 18:26:42 user nova-compute[72418]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 18:26:42 user nova-compute[72418]:     <boot dev="hd"/>
Aug 09 18:26:42 user nova-compute[72418]:     <smbios mode="sysinfo"/>
Aug 09 18:26:42 user nova-compute[72418]:   </os>
Aug 09 18:26:42 user nova-compute[72418]:   <features>
Aug 09 18:26:42 user nova-compute[72418]:     <acpi/>
Aug 09 18:26:42 user nova-compute[72418]:     <apic/>
Aug 09 18:26:42 user nova-compute[72418]:     <vmcoreinfo/>
Aug 09 18:26:42 user nova-compute[72418]:   </features>
Aug 09 18:26:42 user nova-compute[72418]:   <clock offset="utc">
Aug 09 18:26:42 user nova-compute[72418]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 18:26:42 user nova-compute[72418]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 18:26:42 user nova-compute[72418]:     <timer name="hpet" present="no"/>
Aug 09 18:26:42 user nova-compute[72418]:   </clock>
Aug 09 18:26:42 user nova-compute[72418]:   <cpu mode="custom" match="exact">
Aug 09 18:26:42 user nova-compute[72418]:     <model>Nehalem</model>
Aug 09 18:26:42 user nova-compute[72418]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 18:26:42 user nova-compute[72418]:   </cpu>
Aug 09 18:26:42 user nova-compute[72418]:   <devices>
Aug 09 18:26:42 user nova-compute[72418]:     <disk type="file" device="disk">
Aug 09 18:26:42 user nova-compute[72418]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 18:26:42 user nova-compute[72418]:       <source file="/opt/stack/data/nova/instances/8abe9dfb-2bc7-41f3-adba-7ba00f3af83c/disk"/>
Aug 09 18:26:42 user nova-compute[72418]:       <target dev="sda" bus="scsi"/>
Aug 09 18:26:42 user nova-compute[72418]:       <address type="drive" controller="0" unit="0"/>
Aug 09 18:26:42 user nova-compute[72418]:     </disk>
Aug 09 18:26:42 user nova-compute[72418]:     <disk type="file" device="cdrom">
Aug 09 18:26:42 user nova-compute[72418]:       <driver name="qemu" type="raw" cache="none"/>
Aug 09 18:26:42 user nova-compute[72418]:       <source file="/opt/stack/data/nova/instances/8abe9dfb-2bc7-41f3-adba-7ba00f3af83c/disk.config"/>
Aug 09 18:26:42 user nova-compute[72418]:       <target dev="sdb" bus="scsi"/>
Aug 09 18:26:42 user nova-compute[72418]:       <address type="drive" controller="0" unit="1"/>
Aug 09 18:26:42 user nova-compute[72418]:     </disk>
Aug 09 18:26:42 user nova-compute[72418]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 09 18:26:42 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:26:42 user nova-compute[72418]:       <mac address="fa:16:3e:a9:b9:b3"/>
Aug 09 18:26:42 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:26:42 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:26:42 user nova-compute[72418]:       <target dev="tap927916e6-8d"/>
Aug 09 18:26:42 user nova-compute[72418]:     </interface>
Aug 09 18:26:42 user nova-compute[72418]:     <serial type="pty">
Aug 09 18:26:42 user nova-compute[72418]:       <log file="/opt/stack/data/nova/instances/8abe9dfb-2bc7-41f3-adba-7ba00f3af83c/console.log" append="off"/>
Aug 09 18:26:42 user nova-compute[72418]:     </serial>
Aug 09 18:26:42 user nova-compute[72418]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 18:26:42 user nova-compute[72418]:     <video>
Aug 09 18:26:42 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:26:42 user nova-compute[72418]:     </video>
Aug 09 18:26:42 user nova-compute[72418]:     <rng model="virtio">
Aug 09 18:26:42 user nova-compute[72418]:       <backend model="random">/dev/urandom</backend>
Aug 09 18:26:42 user nova-compute[72418]:     </rng>
Aug 09 18:26:42 user nova-compute[72418]:     <controller type="usb" index="0" model="none"/>
Aug 09 18:26:42 user nova-compute[72418]:     <memballoon model="virtio">
Aug 09 18:26:42 user nova-compute[72418]:       <stats period="10"/>
Aug 09 18:26:42 user nova-compute[72418]:     </memballoon>
Aug 09 18:26:42 user nova-compute[72418]:   </devices>
Aug 09 18:26:42 user nova-compute[72418]: </domain>
Aug 09 18:26:42 user nova-compute[72418]:  {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T18:26:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-317502969',display_name='tempest-AttachSCSIVolumeTestJSON-server-317502969',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-317502969',id=18,image_ref='2dd3b5c7-4579-4bd7-b6f0-3425a2d3fa88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDvXzV9a+9+R9rG4sUxH35UR3XfOKob5UVPn7AuwH5O1QwX3a7b5J/z5l13L0879jSt64hhZV3MzsTzaUvqlZRPOHoS8MV02mA2nwvnMfpg3VrOo5xure1kCT1u/lo4pNw==',key_name='tempest-keypair-1156144079',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='154f8492962c4c69876520aaa2b2e8aa',ramdisk_id='',reservation_id='r-bf0jv510',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2dd3b5c7-4579-4bd7-b6f0-3425a2d3fa88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-633262233',owner_user_name='tempest-AttachSCSIVolumeTestJSON-633262233-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:26:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43008ce004de4019b0e7ea8a9fef7701',uuid=8abe9dfb-2bc7-41f3-adba-7ba00f3af83c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "927916e6-8d94-4529-bb6f-0be5a98cafac", "address": "fa:16:3e:a9:b9:b3", "network": {"id": "58f83624-fe55-4b3a-b3d6-a4a38df692e4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-638473817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "154f8492962c4c69876520aaa2b2e8aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap927916e6-8d", "ovs_interfaceid": "927916e6-8d94-4529-bb6f-0be5a98cafac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Converting VIF {"id": "927916e6-8d94-4529-bb6f-0be5a98cafac", "address": "fa:16:3e:a9:b9:b3", "network": {"id": "58f83624-fe55-4b3a-b3d6-a4a38df692e4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-638473817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "154f8492962c4c69876520aaa2b2e8aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap927916e6-8d", "ovs_interfaceid": "927916e6-8d94-4529-bb6f-0be5a98cafac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:b9:b3,bridge_name='br-int',has_traffic_filtering=True,id=927916e6-8d94-4529-bb6f-0be5a98cafac,network=Network(58f83624-fe55-4b3a-b3d6-a4a38df692e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap927916e6-8d') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG os_vif [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:b9:b3,bridge_name='br-int',has_traffic_filtering=True,id=927916e6-8d94-4529-bb6f-0be5a98cafac,network=Network(58f83624-fe55-4b3a-b3d6-a4a38df692e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap927916e6-8d') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:26:42 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-4cef4370-2828-43dc-8ddf-b75ab9208a18 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Attempting rescue
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-4cef4370-2828-43dc-8ddf-b75ab9208a18 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72418) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap927916e6-8d, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap927916e6-8d, col_values=(('external_ids', {'iface-id': '927916e6-8d94-4529-bb6f-0be5a98cafac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:b9:b3', 'vm-uuid': '8abe9dfb-2bc7-41f3-adba-7ba00f3af83c'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-4cef4370-2828-43dc-8ddf-b75ab9208a18 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Instance directory exists: not creating {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 18:26:42 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-4cef4370-2828-43dc-8ddf-b75ab9208a18 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Creating image(s)
Aug 09 18:26:42 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-4cef4370-2828-43dc-8ddf-b75ab9208a18 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Acquiring lock "/opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-4cef4370-2828-43dc-8ddf-b75ab9208a18 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "/opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-4cef4370-2828-43dc-8ddf-b75ab9208a18 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "/opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.objects.instance [None req-4cef4370-2828-43dc-8ddf-b75ab9208a18 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6af7918a-ce90-45ab-93d8-684e1489e891 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:42 user nova-compute[72418]: INFO os_vif [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:b9:b3,bridge_name='br-int',has_traffic_filtering=True,id=927916e6-8d94-4529-bb6f-0be5a98cafac,network=Network(58f83624-fe55-4b3a-b3d6-a4a38df692e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap927916e6-8d')
Aug 09 18:26:42 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-4cef4370-2828-43dc-8ddf-b75ab9208a18 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Acquiring lock "458773cfa7230b717e41c60277832e9f83806d71" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-4cef4370-2828-43dc-8ddf-b75ab9208a18 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-4cef4370-2828-43dc-8ddf-b75ab9208a18 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] No BDM found with device name sda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] No VIF found with MAC fa:16:3e:a9:b9:b3, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:26:42 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Using config drive
Aug 09 18:26:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-4cef4370-2828-43dc-8ddf-b75ab9208a18 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.187s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-4cef4370-2828-43dc-8ddf-b75ab9208a18 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk.rescue {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:42 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Creating config drive at /opt/stack/data/nova/instances/8abe9dfb-2bc7-41f3-adba-7ba00f3af83c/disk.config
Aug 09 18:26:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8abe9dfb-2bc7-41f3-adba-7ba00f3af83c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpxuzgt_re {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-4cef4370-2828-43dc-8ddf-b75ab9208a18 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk.rescue" returned: 0 in 0.108s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-4cef4370-2828-43dc-8ddf-b75ab9208a18 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.300s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.objects.instance [None req-4cef4370-2828-43dc-8ddf-b75ab9208a18 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lazy-loading 'migration_context' on Instance uuid 6af7918a-ce90-45ab-93d8-684e1489e891 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8abe9dfb-2bc7-41f3-adba-7ba00f3af83c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpxuzgt_re" returned: 0 in 0.061s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-4cef4370-2828-43dc-8ddf-b75ab9208a18 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Created local disks {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-4cef4370-2828-43dc-8ddf-b75ab9208a18 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Start _get_guest_xml network_info=[{"id": "2b44ecc4-13c5-43ba-8425-5f42d86bc716", "address": "fa:16:3e:8d:41:82", "network": {"id": "15a49d9b-3c0d-449b-9473-29f219960e2c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "vif_mac": "fa:16:3e:8d:41:82"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c68622cd79472ba6ad14a6876aeaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b44ecc4-13", "ovs_interfaceid": "2b44ecc4-13c5-43ba-8425-5f42d86bc716", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.objects.instance [None req-4cef4370-2828-43dc-8ddf-b75ab9208a18 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lazy-loading 'resources' on Instance uuid 6af7918a-ce90-45ab-93d8-684e1489e891 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.objects.instance [None req-4cef4370-2828-43dc-8ddf-b75ab9208a18 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lazy-loading 'numa_topology' on Instance uuid 6af7918a-ce90-45ab-93d8-684e1489e891 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:26:42 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-4cef4370-2828-43dc-8ddf-b75ab9208a18 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:26:42 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-4cef4370-2828-43dc-8ddf-b75ab9208a18 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-4cef4370-2828-43dc-8ddf-b75ab9208a18 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-4cef4370-2828-43dc-8ddf-b75ab9208a18 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] CPU controller missing on host. {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-4cef4370-2828-43dc-8ddf-b75ab9208a18 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-4cef4370-2828-43dc-8ddf-b75ab9208a18 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] CPU controller found on host. {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-4cef4370-2828-43dc-8ddf-b75ab9208a18 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72418) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-4cef4370-2828-43dc-8ddf-b75ab9208a18 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T18:17:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-4cef4370-2828-43dc-8ddf-b75ab9208a18 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Flavor limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-4cef4370-2828-43dc-8ddf-b75ab9208a18 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Image limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-4cef4370-2828-43dc-8ddf-b75ab9208a18 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Flavor pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-4cef4370-2828-43dc-8ddf-b75ab9208a18 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Image pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-4cef4370-2828-43dc-8ddf-b75ab9208a18 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-4cef4370-2828-43dc-8ddf-b75ab9208a18 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-4cef4370-2828-43dc-8ddf-b75ab9208a18 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-4cef4370-2828-43dc-8ddf-b75ab9208a18 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Got 1 possible topologies {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-4cef4370-2828-43dc-8ddf-b75ab9208a18 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-4cef4370-2828-43dc-8ddf-b75ab9208a18 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.objects.instance [None req-4cef4370-2828-43dc-8ddf-b75ab9208a18 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6af7918a-ce90-45ab-93d8-684e1489e891 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.network.neutron [req-d4417b2c-9dc1-4ab0-bd3e-fcfb7c0bbc58 req-49e84b8d-8401-421b-b358-140c34d1cbb9 service nova] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Updated VIF entry in instance network info cache for port 927916e6-8d94-4529-bb6f-0be5a98cafac. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.network.neutron [req-d4417b2c-9dc1-4ab0-bd3e-fcfb7c0bbc58 req-49e84b8d-8401-421b-b358-140c34d1cbb9 service nova] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Updating instance_info_cache with network_info: [{"id": "927916e6-8d94-4529-bb6f-0be5a98cafac", "address": "fa:16:3e:a9:b9:b3", "network": {"id": "58f83624-fe55-4b3a-b3d6-a4a38df692e4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-638473817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "154f8492962c4c69876520aaa2b2e8aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap927916e6-8d", "ovs_interfaceid": "927916e6-8d94-4529-bb6f-0be5a98cafac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-4cef4370-2828-43dc-8ddf-b75ab9208a18 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:21:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-640969578',display_name='tempest-ServerRescueNegativeTestJSON-server-640969578',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-640969578',id=1,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:22:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5c68622cd79472ba6ad14a6876aeaea',ramdisk_id='',reservation_id='r-e2sltd8s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-326572915',owner_user_name='tempest-ServerRescueNegativeTestJSON-326572915-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:22:15Z,user_data=None,user_id='b3c4feb0a14841eeb757a79b6a05d1fa',uuid=6af7918a-ce90-45ab-93d8-684e1489e891,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b44ecc4-13c5-43ba-8425-5f42d86bc716", "address": "fa:16:3e:8d:41:82", "network": {"id": "15a49d9b-3c0d-449b-9473-29f219960e2c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "vif_mac": "fa:16:3e:8d:41:82"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c68622cd79472ba6ad14a6876aeaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b44ecc4-13", "ovs_interfaceid": "2b44ecc4-13c5-43ba-8425-5f42d86bc716", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-4cef4370-2828-43dc-8ddf-b75ab9208a18 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Converting VIF {"id": "2b44ecc4-13c5-43ba-8425-5f42d86bc716", "address": "fa:16:3e:8d:41:82", "network": {"id": "15a49d9b-3c0d-449b-9473-29f219960e2c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "vif_mac": "fa:16:3e:8d:41:82"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c68622cd79472ba6ad14a6876aeaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b44ecc4-13", "ovs_interfaceid": "2b44ecc4-13c5-43ba-8425-5f42d86bc716", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-4cef4370-2828-43dc-8ddf-b75ab9208a18 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:41:82,bridge_name='br-int',has_traffic_filtering=True,id=2b44ecc4-13c5-43ba-8425-5f42d86bc716,network=Network(15a49d9b-3c0d-449b-9473-29f219960e2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b44ecc4-13') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.objects.instance [None req-4cef4370-2828-43dc-8ddf-b75ab9208a18 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lazy-loading 'pci_devices' on Instance uuid 6af7918a-ce90-45ab-93d8-684e1489e891 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-d4417b2c-9dc1-4ab0-bd3e-fcfb7c0bbc58 req-49e84b8d-8401-421b-b358-140c34d1cbb9 service nova] Releasing lock "refresh_cache-8abe9dfb-2bc7-41f3-adba-7ba00f3af83c" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-4cef4370-2828-43dc-8ddf-b75ab9208a18 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] End _get_guest_xml xml=<domain type="kvm">
Aug 09 18:26:42 user nova-compute[72418]:   <uuid>6af7918a-ce90-45ab-93d8-684e1489e891</uuid>
Aug 09 18:26:42 user nova-compute[72418]:   <name>instance-00000001</name>
Aug 09 18:26:42 user nova-compute[72418]:   <memory>524288</memory>
Aug 09 18:26:42 user nova-compute[72418]:   <vcpu>1</vcpu>
Aug 09 18:26:42 user nova-compute[72418]:   <metadata>
Aug 09 18:26:42 user nova-compute[72418]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:26:42 user nova-compute[72418]:       <nova:package version="0.0.0"/>
Aug 09 18:26:42 user nova-compute[72418]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-640969578</nova:name>
Aug 09 18:26:42 user nova-compute[72418]:       <nova:creationTime>2023-08-09 18:26:42</nova:creationTime>
Aug 09 18:26:42 user nova-compute[72418]:       <nova:flavor name="m1.tiny">
Aug 09 18:26:42 user nova-compute[72418]:         <nova:memory>512</nova:memory>
Aug 09 18:26:42 user nova-compute[72418]:         <nova:disk>1</nova:disk>
Aug 09 18:26:42 user nova-compute[72418]:         <nova:swap>0</nova:swap>
Aug 09 18:26:42 user nova-compute[72418]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:26:42 user nova-compute[72418]:         <nova:vcpus>1</nova:vcpus>
Aug 09 18:26:42 user nova-compute[72418]:       </nova:flavor>
Aug 09 18:26:42 user nova-compute[72418]:       <nova:owner>
Aug 09 18:26:42 user nova-compute[72418]:         <nova:user uuid="b3c4feb0a14841eeb757a79b6a05d1fa">tempest-ServerRescueNegativeTestJSON-326572915-project-member</nova:user>
Aug 09 18:26:42 user nova-compute[72418]:         <nova:project uuid="b5c68622cd79472ba6ad14a6876aeaea">tempest-ServerRescueNegativeTestJSON-326572915</nova:project>
Aug 09 18:26:42 user nova-compute[72418]:       </nova:owner>
Aug 09 18:26:42 user nova-compute[72418]:       <nova:root type="image" uuid="8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e"/>
Aug 09 18:26:42 user nova-compute[72418]:       <nova:ports>
Aug 09 18:26:42 user nova-compute[72418]:         <nova:port uuid="2b44ecc4-13c5-43ba-8425-5f42d86bc716">
Aug 09 18:26:42 user nova-compute[72418]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 18:26:42 user nova-compute[72418]:         </nova:port>
Aug 09 18:26:42 user nova-compute[72418]:       </nova:ports>
Aug 09 18:26:42 user nova-compute[72418]:     </nova:instance>
Aug 09 18:26:42 user nova-compute[72418]:   </metadata>
Aug 09 18:26:42 user nova-compute[72418]:   <sysinfo type="smbios">
Aug 09 18:26:42 user nova-compute[72418]:     <system>
Aug 09 18:26:42 user nova-compute[72418]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 18:26:42 user nova-compute[72418]:       <entry name="product">OpenStack Nova</entry>
Aug 09 18:26:42 user nova-compute[72418]:       <entry name="version">0.0.0</entry>
Aug 09 18:26:42 user nova-compute[72418]:       <entry name="serial">6af7918a-ce90-45ab-93d8-684e1489e891</entry>
Aug 09 18:26:42 user nova-compute[72418]:       <entry name="uuid">6af7918a-ce90-45ab-93d8-684e1489e891</entry>
Aug 09 18:26:42 user nova-compute[72418]:       <entry name="family">Virtual Machine</entry>
Aug 09 18:26:42 user nova-compute[72418]:     </system>
Aug 09 18:26:42 user nova-compute[72418]:   </sysinfo>
Aug 09 18:26:42 user nova-compute[72418]:   <os>
Aug 09 18:26:42 user nova-compute[72418]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 18:26:42 user nova-compute[72418]:     <smbios mode="sysinfo"/>
Aug 09 18:26:42 user nova-compute[72418]:   </os>
Aug 09 18:26:42 user nova-compute[72418]:   <features>
Aug 09 18:26:42 user nova-compute[72418]:     <acpi/>
Aug 09 18:26:42 user nova-compute[72418]:     <apic/>
Aug 09 18:26:42 user nova-compute[72418]:     <vmcoreinfo/>
Aug 09 18:26:42 user nova-compute[72418]:   </features>
Aug 09 18:26:42 user nova-compute[72418]:   <clock offset="utc">
Aug 09 18:26:42 user nova-compute[72418]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 18:26:42 user nova-compute[72418]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 18:26:42 user nova-compute[72418]:     <timer name="hpet" present="no"/>
Aug 09 18:26:42 user nova-compute[72418]:   </clock>
Aug 09 18:26:42 user nova-compute[72418]:   <cpu mode="custom" match="exact">
Aug 09 18:26:42 user nova-compute[72418]:     <model>Nehalem</model>
Aug 09 18:26:42 user nova-compute[72418]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 18:26:42 user nova-compute[72418]:   </cpu>
Aug 09 18:26:42 user nova-compute[72418]:   <devices>
Aug 09 18:26:42 user nova-compute[72418]:     <disk type="file" device="disk">
Aug 09 18:26:42 user nova-compute[72418]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 18:26:42 user nova-compute[72418]:       <source file="/opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk.rescue"/>
Aug 09 18:26:42 user nova-compute[72418]:       <target dev="vda" bus="virtio"/>
Aug 09 18:26:42 user nova-compute[72418]:     </disk>
Aug 09 18:26:42 user nova-compute[72418]:     <disk type="file" device="disk">
Aug 09 18:26:42 user nova-compute[72418]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 18:26:42 user nova-compute[72418]:       <source file="/opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk"/>
Aug 09 18:26:42 user nova-compute[72418]:       <target dev="vdb" bus="virtio"/>
Aug 09 18:26:42 user nova-compute[72418]:     </disk>
Aug 09 18:26:42 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:26:42 user nova-compute[72418]:       <mac address="fa:16:3e:8d:41:82"/>
Aug 09 18:26:42 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:26:42 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:26:42 user nova-compute[72418]:       <target dev="tap2b44ecc4-13"/>
Aug 09 18:26:42 user nova-compute[72418]:     </interface>
Aug 09 18:26:42 user nova-compute[72418]:     <serial type="pty">
Aug 09 18:26:42 user nova-compute[72418]:       <log file="/opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/console.log" append="off"/>
Aug 09 18:26:42 user nova-compute[72418]:     </serial>
Aug 09 18:26:42 user nova-compute[72418]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 18:26:42 user nova-compute[72418]:     <video>
Aug 09 18:26:42 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:26:42 user nova-compute[72418]:     </video>
Aug 09 18:26:42 user nova-compute[72418]:     <rng model="virtio">
Aug 09 18:26:42 user nova-compute[72418]:       <backend model="random">/dev/urandom</backend>
Aug 09 18:26:42 user nova-compute[72418]:     </rng>
Aug 09 18:26:42 user nova-compute[72418]:     <controller type="usb" index="0" model="none"/>
Aug 09 18:26:42 user nova-compute[72418]:     <memballoon model="virtio">
Aug 09 18:26:42 user nova-compute[72418]:       <stats period="10"/>
Aug 09 18:26:42 user nova-compute[72418]:     </memballoon>
Aug 09 18:26:42 user nova-compute[72418]:   </devices>
Aug 09 18:26:42 user nova-compute[72418]: </domain>
Aug 09 18:26:42 user nova-compute[72418]:  {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 18:26:42 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Instance destroyed successfully.
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-4cef4370-2828-43dc-8ddf-b75ab9208a18 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-4cef4370-2828-43dc-8ddf-b75ab9208a18 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:26:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-4cef4370-2828-43dc-8ddf-b75ab9208a18 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] No VIF found with MAC fa:16:3e:8d:41:82, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:26:43 user nova-compute[72418]: DEBUG nova.compute.manager [req-98568d65-126e-464e-83be-df881c5f581b req-5be765f7-44cc-47f4-a085-45b5f195d26f service nova] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Received event network-vif-plugged-2b44ecc4-13c5-43ba-8425-5f42d86bc716 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:26:43 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-98568d65-126e-464e-83be-df881c5f581b req-5be765f7-44cc-47f4-a085-45b5f195d26f service nova] Acquiring lock "6af7918a-ce90-45ab-93d8-684e1489e891-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:26:43 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-98568d65-126e-464e-83be-df881c5f581b req-5be765f7-44cc-47f4-a085-45b5f195d26f service nova] Lock "6af7918a-ce90-45ab-93d8-684e1489e891-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:26:43 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-98568d65-126e-464e-83be-df881c5f581b req-5be765f7-44cc-47f4-a085-45b5f195d26f service nova] Lock "6af7918a-ce90-45ab-93d8-684e1489e891-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:26:43 user nova-compute[72418]: DEBUG nova.compute.manager [req-98568d65-126e-464e-83be-df881c5f581b req-5be765f7-44cc-47f4-a085-45b5f195d26f service nova] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] No waiting events found dispatching network-vif-plugged-2b44ecc4-13c5-43ba-8425-5f42d86bc716 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:26:43 user nova-compute[72418]: WARNING nova.compute.manager [req-98568d65-126e-464e-83be-df881c5f581b req-5be765f7-44cc-47f4-a085-45b5f195d26f service nova] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Received unexpected event network-vif-plugged-2b44ecc4-13c5-43ba-8425-5f42d86bc716 for instance with vm_state active and task_state rescuing.
Aug 09 18:26:44 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:44 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:44 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:44 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:26:45 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:45 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:45 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:45 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:45 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:45 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:45 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:45 user nova-compute[72418]: INFO nova.compute.manager [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Rescuing
Aug 09 18:26:45 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquiring lock "refresh_cache-e019064c-955e-4f80-9b00-6b32b3835d58" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:26:45 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquired lock "refresh_cache-e019064c-955e-4f80-9b00-6b32b3835d58" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:26:45 user nova-compute[72418]: DEBUG nova.network.neutron [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:26:45 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:26:45 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:46 user nova-compute[72418]: DEBUG nova.compute.manager [req-1216f445-8d26-4f15-abff-ff5135fc889c req-04a9857b-2169-4cb4-96bb-ac81f8bf0013 service nova] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Received event network-vif-plugged-927916e6-8d94-4529-bb6f-0be5a98cafac {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:26:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-1216f445-8d26-4f15-abff-ff5135fc889c req-04a9857b-2169-4cb4-96bb-ac81f8bf0013 service nova] Acquiring lock "8abe9dfb-2bc7-41f3-adba-7ba00f3af83c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:26:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-1216f445-8d26-4f15-abff-ff5135fc889c req-04a9857b-2169-4cb4-96bb-ac81f8bf0013 service nova] Lock "8abe9dfb-2bc7-41f3-adba-7ba00f3af83c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:26:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-1216f445-8d26-4f15-abff-ff5135fc889c req-04a9857b-2169-4cb4-96bb-ac81f8bf0013 service nova] Lock "8abe9dfb-2bc7-41f3-adba-7ba00f3af83c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:26:46 user nova-compute[72418]: DEBUG nova.compute.manager [req-1216f445-8d26-4f15-abff-ff5135fc889c req-04a9857b-2169-4cb4-96bb-ac81f8bf0013 service nova] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] No waiting events found dispatching network-vif-plugged-927916e6-8d94-4529-bb6f-0be5a98cafac {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:26:46 user nova-compute[72418]: WARNING nova.compute.manager [req-1216f445-8d26-4f15-abff-ff5135fc889c req-04a9857b-2169-4cb4-96bb-ac81f8bf0013 service nova] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Received unexpected event network-vif-plugged-927916e6-8d94-4529-bb6f-0be5a98cafac for instance with vm_state building and task_state spawning.
Aug 09 18:26:46 user nova-compute[72418]: DEBUG nova.compute.manager [req-1216f445-8d26-4f15-abff-ff5135fc889c req-04a9857b-2169-4cb4-96bb-ac81f8bf0013 service nova] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Received event network-vif-plugged-927916e6-8d94-4529-bb6f-0be5a98cafac {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:26:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-1216f445-8d26-4f15-abff-ff5135fc889c req-04a9857b-2169-4cb4-96bb-ac81f8bf0013 service nova] Acquiring lock "8abe9dfb-2bc7-41f3-adba-7ba00f3af83c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:26:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-1216f445-8d26-4f15-abff-ff5135fc889c req-04a9857b-2169-4cb4-96bb-ac81f8bf0013 service nova] Lock "8abe9dfb-2bc7-41f3-adba-7ba00f3af83c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:26:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-1216f445-8d26-4f15-abff-ff5135fc889c req-04a9857b-2169-4cb4-96bb-ac81f8bf0013 service nova] Lock "8abe9dfb-2bc7-41f3-adba-7ba00f3af83c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:26:46 user nova-compute[72418]: DEBUG nova.compute.manager [req-1216f445-8d26-4f15-abff-ff5135fc889c req-04a9857b-2169-4cb4-96bb-ac81f8bf0013 service nova] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] No waiting events found dispatching network-vif-plugged-927916e6-8d94-4529-bb6f-0be5a98cafac {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:26:46 user nova-compute[72418]: WARNING nova.compute.manager [req-1216f445-8d26-4f15-abff-ff5135fc889c req-04a9857b-2169-4cb4-96bb-ac81f8bf0013 service nova] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Received unexpected event network-vif-plugged-927916e6-8d94-4529-bb6f-0be5a98cafac for instance with vm_state building and task_state spawning.
Aug 09 18:26:46 user nova-compute[72418]: DEBUG nova.compute.manager [req-1216f445-8d26-4f15-abff-ff5135fc889c req-04a9857b-2169-4cb4-96bb-ac81f8bf0013 service nova] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Received event network-vif-plugged-2b44ecc4-13c5-43ba-8425-5f42d86bc716 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:26:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-1216f445-8d26-4f15-abff-ff5135fc889c req-04a9857b-2169-4cb4-96bb-ac81f8bf0013 service nova] Acquiring lock "6af7918a-ce90-45ab-93d8-684e1489e891-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:26:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-1216f445-8d26-4f15-abff-ff5135fc889c req-04a9857b-2169-4cb4-96bb-ac81f8bf0013 service nova] Lock "6af7918a-ce90-45ab-93d8-684e1489e891-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:26:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-1216f445-8d26-4f15-abff-ff5135fc889c req-04a9857b-2169-4cb4-96bb-ac81f8bf0013 service nova] Lock "6af7918a-ce90-45ab-93d8-684e1489e891-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:26:46 user nova-compute[72418]: DEBUG nova.compute.manager [req-1216f445-8d26-4f15-abff-ff5135fc889c req-04a9857b-2169-4cb4-96bb-ac81f8bf0013 service nova] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] No waiting events found dispatching network-vif-plugged-2b44ecc4-13c5-43ba-8425-5f42d86bc716 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:26:46 user nova-compute[72418]: WARNING nova.compute.manager [req-1216f445-8d26-4f15-abff-ff5135fc889c req-04a9857b-2169-4cb4-96bb-ac81f8bf0013 service nova] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Received unexpected event network-vif-plugged-2b44ecc4-13c5-43ba-8425-5f42d86bc716 for instance with vm_state active and task_state rescuing.
Aug 09 18:26:46 user nova-compute[72418]: DEBUG nova.network.neutron [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Updating instance_info_cache with network_info: [{"id": "4c6c632a-142b-4cda-92c8-77026645af09", "address": "fa:16:3e:15:18:a4", "network": {"id": "beaefb5c-f5e4-47e7-ab68-60131f532ade", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e5863cda54487682a4edcc24202c91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c6c632a-14", "ovs_interfaceid": "4c6c632a-142b-4cda-92c8-77026645af09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:26:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Releasing lock "refresh_cache-e019064c-955e-4f80-9b00-6b32b3835d58" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:26:46 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:46 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:46 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:46 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:26:46 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:47 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:47 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Instance destroyed successfully.
Aug 09 18:26:47 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Attempting a stable device rescue
Aug 09 18:26:47 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72418) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 09 18:26:47 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:47 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Instance directory exists: not creating {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 18:26:47 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Creating image(s)
Aug 09 18:26:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquiring lock "/opt/stack/data/nova/instances/e019064c-955e-4f80-9b00-6b32b3835d58/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:26:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "/opt/stack/data/nova/instances/e019064c-955e-4f80-9b00-6b32b3835d58/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:26:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "/opt/stack/data/nova/instances/e019064c-955e-4f80-9b00-6b32b3835d58/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:26:47 user nova-compute[72418]: DEBUG nova.objects.instance [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lazy-loading 'trusted_certs' on Instance uuid e019064c-955e-4f80-9b00-6b32b3835d58 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:26:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquiring lock "becf07383c7b9f08a9568843d46ac652dc01998a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:26:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "becf07383c7b9f08a9568843d46ac652dc01998a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:26:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/becf07383c7b9f08a9568843d46ac652dc01998a.part --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:48 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605607.7172272, 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c => Resumed> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:26:48 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] VM Resumed (Lifecycle Event)
Aug 09 18:26:48 user nova-compute[72418]: DEBUG nova.compute.manager [req-2833a241-620b-41d2-a00c-1852af7af283 req-861c9dc6-ecf6-4e60-a7dc-facdfaecd1b8 service nova] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Received event network-vif-plugged-2b44ecc4-13c5-43ba-8425-5f42d86bc716 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:26:48 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-2833a241-620b-41d2-a00c-1852af7af283 req-861c9dc6-ecf6-4e60-a7dc-facdfaecd1b8 service nova] Acquiring lock "6af7918a-ce90-45ab-93d8-684e1489e891-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:26:48 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-2833a241-620b-41d2-a00c-1852af7af283 req-861c9dc6-ecf6-4e60-a7dc-facdfaecd1b8 service nova] Lock "6af7918a-ce90-45ab-93d8-684e1489e891-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:26:48 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-2833a241-620b-41d2-a00c-1852af7af283 req-861c9dc6-ecf6-4e60-a7dc-facdfaecd1b8 service nova] Lock "6af7918a-ce90-45ab-93d8-684e1489e891-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:26:48 user nova-compute[72418]: DEBUG nova.compute.manager [req-2833a241-620b-41d2-a00c-1852af7af283 req-861c9dc6-ecf6-4e60-a7dc-facdfaecd1b8 service nova] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] No waiting events found dispatching network-vif-plugged-2b44ecc4-13c5-43ba-8425-5f42d86bc716 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:26:48 user nova-compute[72418]: WARNING nova.compute.manager [req-2833a241-620b-41d2-a00c-1852af7af283 req-861c9dc6-ecf6-4e60-a7dc-facdfaecd1b8 service nova] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Received unexpected event network-vif-plugged-2b44ecc4-13c5-43ba-8425-5f42d86bc716 for instance with vm_state active and task_state rescuing.
Aug 09 18:26:48 user nova-compute[72418]: DEBUG nova.compute.manager [req-2833a241-620b-41d2-a00c-1852af7af283 req-861c9dc6-ecf6-4e60-a7dc-facdfaecd1b8 service nova] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Received event network-vif-unplugged-4c6c632a-142b-4cda-92c8-77026645af09 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:26:48 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-2833a241-620b-41d2-a00c-1852af7af283 req-861c9dc6-ecf6-4e60-a7dc-facdfaecd1b8 service nova] Acquiring lock "e019064c-955e-4f80-9b00-6b32b3835d58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:26:48 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-2833a241-620b-41d2-a00c-1852af7af283 req-861c9dc6-ecf6-4e60-a7dc-facdfaecd1b8 service nova] Lock "e019064c-955e-4f80-9b00-6b32b3835d58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:26:48 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-2833a241-620b-41d2-a00c-1852af7af283 req-861c9dc6-ecf6-4e60-a7dc-facdfaecd1b8 service nova] Lock "e019064c-955e-4f80-9b00-6b32b3835d58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:26:48 user nova-compute[72418]: DEBUG nova.compute.manager [req-2833a241-620b-41d2-a00c-1852af7af283 req-861c9dc6-ecf6-4e60-a7dc-facdfaecd1b8 service nova] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] No waiting events found dispatching network-vif-unplugged-4c6c632a-142b-4cda-92c8-77026645af09 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:26:48 user nova-compute[72418]: WARNING nova.compute.manager [req-2833a241-620b-41d2-a00c-1852af7af283 req-861c9dc6-ecf6-4e60-a7dc-facdfaecd1b8 service nova] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Received unexpected event network-vif-unplugged-4c6c632a-142b-4cda-92c8-77026645af09 for instance with vm_state active and task_state rescuing.
Aug 09 18:26:48 user nova-compute[72418]: DEBUG nova.compute.manager [req-2833a241-620b-41d2-a00c-1852af7af283 req-861c9dc6-ecf6-4e60-a7dc-facdfaecd1b8 service nova] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Received event network-vif-plugged-4c6c632a-142b-4cda-92c8-77026645af09 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:26:48 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-2833a241-620b-41d2-a00c-1852af7af283 req-861c9dc6-ecf6-4e60-a7dc-facdfaecd1b8 service nova] Acquiring lock "e019064c-955e-4f80-9b00-6b32b3835d58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:26:48 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-2833a241-620b-41d2-a00c-1852af7af283 req-861c9dc6-ecf6-4e60-a7dc-facdfaecd1b8 service nova] Lock "e019064c-955e-4f80-9b00-6b32b3835d58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:26:48 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-2833a241-620b-41d2-a00c-1852af7af283 req-861c9dc6-ecf6-4e60-a7dc-facdfaecd1b8 service nova] Lock "e019064c-955e-4f80-9b00-6b32b3835d58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:26:48 user nova-compute[72418]: DEBUG nova.compute.manager [req-2833a241-620b-41d2-a00c-1852af7af283 req-861c9dc6-ecf6-4e60-a7dc-facdfaecd1b8 service nova] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] No waiting events found dispatching network-vif-plugged-4c6c632a-142b-4cda-92c8-77026645af09 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:26:48 user nova-compute[72418]: WARNING nova.compute.manager [req-2833a241-620b-41d2-a00c-1852af7af283 req-861c9dc6-ecf6-4e60-a7dc-facdfaecd1b8 service nova] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Received unexpected event network-vif-plugged-4c6c632a-142b-4cda-92c8-77026645af09 for instance with vm_state active and task_state rescuing.
Aug 09 18:26:48 user nova-compute[72418]: DEBUG nova.compute.manager [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Instance event wait completed in 0 seconds for  {{(pid=72418) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 18:26:48 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Guest created on hypervisor {{(pid=72418) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 18:26:48 user nova-compute[72418]: DEBUG nova.compute.manager [None req-4cef4370-2828-43dc-8ddf-b75ab9208a18 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:26:48 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:26:48 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Instance spawned successfully.
Aug 09 18:26:48 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 18:26:48 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:26:48 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Found default for hw_input_bus of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:26:48 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Found default for hw_pointer_model of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:26:48 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Found default for hw_video_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:26:48 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Found default for hw_vif_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:26:48 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:26:48 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605607.718185, 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c => Started> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:26:48 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] VM Started (Lifecycle Event)
Aug 09 18:26:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/becf07383c7b9f08a9568843d46ac652dc01998a.part --force-share --output=json" returned: 0 in 0.182s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:48 user nova-compute[72418]: DEBUG nova.virt.images [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] ebea4570-280b-4728-ba1d-ad5a41503b99 was qcow2, converting to raw {{(pid=72418) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 18:26:48 user nova-compute[72418]: DEBUG nova.privsep.utils [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72418) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 18:26:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/becf07383c7b9f08a9568843d46ac652dc01998a.part /opt/stack/data/nova/instances/_base/becf07383c7b9f08a9568843d46ac652dc01998a.converted {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:48 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:26:48 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:26:48 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:26:48 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:26:48 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:26:48 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:26:48 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Removed pending event for 6af7918a-ce90-45ab-93d8-684e1489e891 due to event {{(pid=72418) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 18:26:48 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605607.7835286, 6af7918a-ce90-45ab-93d8-684e1489e891 => Resumed> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:26:48 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] VM Resumed (Lifecycle Event)
Aug 09 18:26:49 user nova-compute[72418]: INFO nova.compute.manager [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Took 9.66 seconds to spawn the instance on the hypervisor.
Aug 09 18:26:49 user nova-compute[72418]: DEBUG nova.compute.manager [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:26:49 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:26:49 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:26:49 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605607.7839122, 6af7918a-ce90-45ab-93d8-684e1489e891 => Started> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:26:49 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] VM Started (Lifecycle Event)
Aug 09 18:26:49 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:26:49 user nova-compute[72418]: INFO nova.compute.manager [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Took 10.75 seconds to build instance.
Aug 09 18:26:49 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:26:49 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-03cca767-16ed-44e6-954e-1f1148441533 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Lock "8abe9dfb-2bc7-41f3-adba-7ba00f3af83c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.921s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:26:49 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/becf07383c7b9f08a9568843d46ac652dc01998a.part /opt/stack/data/nova/instances/_base/becf07383c7b9f08a9568843d46ac652dc01998a.converted" returned: 0 in 0.490s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:49 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/becf07383c7b9f08a9568843d46ac652dc01998a.converted --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:49 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/becf07383c7b9f08a9568843d46ac652dc01998a.converted --force-share --output=json" returned: 0 in 0.164s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:49 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "becf07383c7b9f08a9568843d46ac652dc01998a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.990s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:26:49 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquiring lock "becf07383c7b9f08a9568843d46ac652dc01998a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:26:49 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "becf07383c7b9f08a9568843d46ac652dc01998a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:26:49 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/becf07383c7b9f08a9568843d46ac652dc01998a --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:49 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/becf07383c7b9f08a9568843d46ac652dc01998a --force-share --output=json" returned: 0 in 0.290s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:49 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/becf07383c7b9f08a9568843d46ac652dc01998a,backing_fmt=raw /opt/stack/data/nova/instances/e019064c-955e-4f80-9b00-6b32b3835d58/disk.rescue {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:49 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:26:49 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72418) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 18:26:49 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:26:49 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/becf07383c7b9f08a9568843d46ac652dc01998a,backing_fmt=raw /opt/stack/data/nova/instances/e019064c-955e-4f80-9b00-6b32b3835d58/disk.rescue" returned: 0 in 0.059s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:49 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "becf07383c7b9f08a9568843d46ac652dc01998a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.355s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:26:49 user nova-compute[72418]: DEBUG nova.objects.instance [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lazy-loading 'migration_context' on Instance uuid e019064c-955e-4f80-9b00-6b32b3835d58 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:26:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Created local disks {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 18:26:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Start _get_guest_xml network_info=[{"id": "4c6c632a-142b-4cda-92c8-77026645af09", "address": "fa:16:3e:15:18:a4", "network": {"id": "beaefb5c-f5e4-47e7-ab68-60131f532ade", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "vif_mac": "fa:16:3e:15:18:a4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e5863cda54487682a4edcc24202c91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c6c632a-14", "ovs_interfaceid": "4c6c632a-142b-4cda-92c8-77026645af09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ebea4570-280b-4728-ba1d-ad5a41503b99', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '95659ef3-c2cd-499d-bbf4-c85323fd49ae', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EYQJoplb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'e019064c-955e-4f80-9b00-6b32b3835d58', 'attached_at': '', 'detached_at': '', 'volume_id': 'bf6e1fe4-e93e-4920-bdab-02a219161292', 'serial': 'bf6e1fe4-e93e-4920-bdab-02a219161292'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 18:26:49 user nova-compute[72418]: DEBUG nova.objects.instance [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lazy-loading 'resources' on Instance uuid e019064c-955e-4f80-9b00-6b32b3835d58 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:26:49 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:26:49 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:26:49 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:26:49 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Auditing locally available compute resources for user (node: user) {{(pid=72418) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 18:26:49 user nova-compute[72418]: DEBUG nova.objects.instance [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lazy-loading 'numa_topology' on Instance uuid e019064c-955e-4f80-9b00-6b32b3835d58 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:26:50 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:26:50 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:26:50 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] CPU controller missing on host. {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] CPU controller found on host. {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72418) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T18:17:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Flavor limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Image limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Flavor pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Image pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Got 1 possible topologies {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG nova.objects.instance [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lazy-loading 'vcpu_model' on Instance uuid e019064c-955e-4f80-9b00-6b32b3835d58 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Calling os-brick to attach iSCSI Volume {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EYQJoplb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:26:50 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:26:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:26:50 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:26:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:26:50 user nova-compute[72418]: INFO os_brick.initiator.connectors.iscsi [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 18:26:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 -p 172.16.0.220:3260 {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[be420d6f-2f9e-4a55-969b-e3a673f605a4]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = EYQJoplb\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 09 18:26:50 user nova-compute[72418]: node.name = iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292
Aug 09 18:26:50 user nova-compute[72418]: node.tpgt = -1
Aug 09 18:26:50 user nova-compute[72418]: node.startup = automatic
Aug 09 18:26:50 user nova-compute[72418]: node.leading_login = No
Aug 09 18:26:50 user nova-compute[72418]: iface.iscsi_ifacename = default
Aug 09 18:26:50 user nova-compute[72418]: iface.net_ifacename = <empty>
Aug 09 18:26:50 user nova-compute[72418]: iface.ipaddress = <empty>
Aug 09 18:26:50 user nova-compute[72418]: iface.prefix_len = 0
Aug 09 18:26:50 user nova-compute[72418]: iface.hwaddress = <empty>
Aug 09 18:26:50 user nova-compute[72418]: iface.transport_name = tcp
Aug 09 18:26:50 user nova-compute[72418]: iface.initiatorname = <empty>
Aug 09 18:26:50 user nova-compute[72418]: iface.state = <empty>
Aug 09 18:26:50 user nova-compute[72418]: iface.vlan_id = 0
Aug 09 18:26:50 user nova-compute[72418]: iface.vlan_priority = 0
Aug 09 18:26:50 user nova-compute[72418]: iface.vlan_state = <empty>
Aug 09 18:26:50 user nova-compute[72418]: iface.iface_num = 0
Aug 09 18:26:50 user nova-compute[72418]: iface.mtu = 0
Aug 09 18:26:50 user nova-compute[72418]: iface.port = 0
Aug 09 18:26:50 user nova-compute[72418]: iface.bootproto = <empty>
Aug 09 18:26:50 user nova-compute[72418]: iface.subnet_mask = <empty>
Aug 09 18:26:50 user nova-compute[72418]: iface.gateway = <empty>
Aug 09 18:26:50 user nova-compute[72418]: iface.dhcp_alt_client_id_state = <empty>
Aug 09 18:26:50 user nova-compute[72418]: iface.dhcp_alt_client_id = <empty>
Aug 09 18:26:50 user nova-compute[72418]: iface.dhcp_dns = <empty>
Aug 09 18:26:50 user nova-compute[72418]: iface.dhcp_learn_iqn = <empty>
Aug 09 18:26:50 user nova-compute[72418]: iface.dhcp_req_vendor_id_state = <empty>
Aug 09 18:26:50 user nova-compute[72418]: iface.dhcp_vendor_id_state = <empty>
Aug 09 18:26:50 user nova-compute[72418]: iface.dhcp_vendor_id = <empty>
Aug 09 18:26:50 user nova-compute[72418]: iface.dhcp_slp_da = <empty>
Aug 09 18:26:50 user nova-compute[72418]: iface.fragmentation = <empty>
Aug 09 18:26:50 user nova-compute[72418]: iface.gratuitous_arp = <empty>
Aug 09 18:26:50 user nova-compute[72418]: iface.incoming_forwarding = <empty>
Aug 09 18:26:50 user nova-compute[72418]: iface.tos_state = <empty>
Aug 09 18:26:50 user nova-compute[72418]: iface.tos = 0
Aug 09 18:26:50 user nova-compute[72418]: iface.ttl = 0
Aug 09 18:26:50 user nova-compute[72418]: iface.delayed_ack = <empty>
Aug 09 18:26:50 user nova-compute[72418]: iface.tcp_nagle = <empty>
Aug 09 18:26:50 user nova-compute[72418]: iface.tcp_wsf_state = <empty>
Aug 09 18:26:50 user nova-compute[72418]: iface.tcp_wsf = 0
Aug 09 18:26:50 user nova-compute[72418]: iface.tcp_timer_scale = 0
Aug 09 18:26:50 user nova-compute[72418]: iface.tcp_timestamp = <empty>
Aug 09 18:26:50 user nova-compute[72418]: iface.redirect = <empty>
Aug 09 18:26:50 user nova-compute[72418]: iface.def_task_mgmt_timeout = 0
Aug 09 18:26:50 user nova-compute[72418]: iface.header_digest = <empty>
Aug 09 18:26:50 user nova-compute[72418]: iface.data_digest = <empty>
Aug 09 18:26:50 user nova-compute[72418]: iface.immediate_data = <empty>
Aug 09 18:26:50 user nova-compute[72418]: iface.initial_r2t = <empty>
Aug 09 18:26:50 user nova-compute[72418]: iface.data_seq_inorder = <empty>
Aug 09 18:26:50 user nova-compute[72418]: iface.data_pdu_inorder = <empty>
Aug 09 18:26:50 user nova-compute[72418]: iface.erl = 0
Aug 09 18:26:50 user nova-compute[72418]: iface.max_receive_data_len = 0
Aug 09 18:26:50 user nova-compute[72418]: iface.first_burst_len = 0
Aug 09 18:26:50 user nova-compute[72418]: iface.max_outstanding_r2t = 0
Aug 09 18:26:50 user nova-compute[72418]: iface.max_burst_len = 0
Aug 09 18:26:50 user nova-compute[72418]: iface.chap_auth = <empty>
Aug 09 18:26:50 user nova-compute[72418]: iface.bidi_chap = <empty>
Aug 09 18:26:50 user nova-compute[72418]: iface.strict_login_compliance = <empty>
Aug 09 18:26:50 user nova-compute[72418]: iface.discovery_auth = <empty>
Aug 09 18:26:50 user nova-compute[72418]: iface.discovery_logout = <empty>
Aug 09 18:26:50 user nova-compute[72418]: node.discovery_address = <empty>
Aug 09 18:26:50 user nova-compute[72418]: node.discovery_port = 0
Aug 09 18:26:50 user nova-compute[72418]: node.discovery_type = static
Aug 09 18:26:50 user nova-compute[72418]: node.session.initial_cmdsn = 0
Aug 09 18:26:50 user nova-compute[72418]: node.session.initial_login_retry_max = 8
Aug 09 18:26:50 user nova-compute[72418]: node.session.xmit_thread_priority = -20
Aug 09 18:26:50 user nova-compute[72418]: node.session.cmds_max = 128
Aug 09 18:26:50 user nova-compute[72418]: node.session.queue_depth = 32
Aug 09 18:26:50 user nova-compute[72418]: node.session.nr_sessions = 1
Aug 09 18:26:50 user nova-compute[72418]: node.session.auth.authmethod = CHAP
Aug 09 18:26:50 user nova-compute[72418]: node.session.auth.username = EYQJoplb
Aug 09 18:26:50 user nova-compute[72418]: node.session.auth.password = ***
Aug 09 18:26:50 user nova-compute[72418]: node.session.auth.username_in = <empty>
Aug 09 18:26:50 user nova-compute[72418]: node.session.auth.password_in = <empty>
Aug 09 18:26:50 user nova-compute[72418]: node.session.auth.chap_algs = MD5
Aug 09 18:26:50 user nova-compute[72418]: node.session.timeo.replacement_timeout = 120
Aug 09 18:26:50 user nova-compute[72418]: node.session.err_timeo.abort_timeout = 15
Aug 09 18:26:50 user nova-compute[72418]: node.session.err_timeo.lu_reset_timeout = 30
Aug 09 18:26:50 user nova-compute[72418]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 09 18:26:50 user nova-compute[72418]: node.session.err_timeo.host_reset_timeout = 60
Aug 09 18:26:50 user nova-compute[72418]: node.session.iscsi.FastAbort = Yes
Aug 09 18:26:50 user nova-compute[72418]: node.session.iscsi.InitialR2T = No
Aug 09 18:26:50 user nova-compute[72418]: node.session.iscsi.ImmediateData = Yes
Aug 09 18:26:50 user nova-compute[72418]: node.session.iscsi.FirstBurstLength = 262144
Aug 09 18:26:50 user nova-compute[72418]: node.session.iscsi.MaxBurstLength = 16776192
Aug 09 18:26:50 user nova-compute[72418]: node.session.iscsi.DefaultTime2Retain = 0
Aug 09 18:26:50 user nova-compute[72418]: node.session.iscsi.DefaultTime2Wait = 2
Aug 09 18:26:50 user nova-compute[72418]: node.session.iscsi.MaxConnections = 1
Aug 09 18:26:50 user nova-compute[72418]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 09 18:26:50 user nova-compute[72418]: node.session.iscsi.ERL = 0
Aug 09 18:26:50 user nova-compute[72418]: node.session.scan = manual
Aug 09 18:26:50 user nova-compute[72418]: node.session.reopen_max = 0
Aug 09 18:26:50 user nova-compute[72418]: node.conn[0].address = 172.16.0.220
Aug 09 18:26:50 user nova-compute[72418]: node.conn[0].port = 3260
Aug 09 18:26:50 user nova-compute[72418]: node.conn[0].startup = manual
Aug 09 18:26:50 user nova-compute[72418]: node.conn[0].tcp.window_size = 524288
Aug 09 18:26:50 user nova-compute[72418]: node.conn[0].tcp.type_of_service = 0
Aug 09 18:26:50 user nova-compute[72418]: node.conn[0].timeo.logout_timeout = 15
Aug 09 18:26:50 user nova-compute[72418]: node.conn[0].timeo.login_timeout = 15
Aug 09 18:26:50 user nova-compute[72418]: node.conn[0].timeo.auth_timeout = 45
Aug 09 18:26:50 user nova-compute[72418]: node.conn[0].timeo.noop_out_interval = 5
Aug 09 18:26:50 user nova-compute[72418]: node.conn[0].timeo.noop_out_timeout = 5
Aug 09 18:26:50 user nova-compute[72418]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 09 18:26:50 user nova-compute[72418]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 09 18:26:50 user nova-compute[72418]: node.conn[0].iscsi.HeaderDigest = None
Aug 09 18:26:50 user nova-compute[72418]: node.conn[0].iscsi.DataDigest = None
Aug 09 18:26:50 user nova-compute[72418]: node.conn[0].iscsi.IFMarker = No
Aug 09 18:26:50 user nova-compute[72418]: node.conn[0].iscsi.OFMarker = No
Aug 09 18:26:50 user nova-compute[72418]: # END RECORD
Aug 09 18:26:50 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[789df4d7-1d05-4da9-8306-1547b4a41d56]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[00bbaeaa-836b-475d-a1ec-2e7a84b2d9e6]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EYQJoplb {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EYQJoplb" returned: 0 in 0.023s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7304030-ff68-46b8-92ea-e1ba926ce919]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EYQJoplb'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea120dae-f114-4704-965d-e72298c4dc85]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[92977d6f-db26-4103-8a32-12d4c2c2fbc7]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:26:50 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:26:50 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.205s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Connected to 172.16.0.220:3260 {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] HCTL ('33', '0', '0', 0) found on session 14 with lun 0 {{(pid=72418) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=72418) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e728ff9-f434-451a-8684-6e553e937447]: (4, ('0 0 0', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Searching for a device in session 14 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=72418) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EYQJoplb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.243s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] <== connect_volume: return (245ms) {'type': 'block', 'scsi_wwn': '23465646465323466', 'path': '/dev/sdb'} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23465646465323466', 'path': '/dev/sdb'} {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:24:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1312766715',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1312766715',id=14,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:25:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52e5863cda54487682a4edcc24202c91',ramdisk_id='',reservation_id='r-k5vy0lqf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1120385592',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:25:18Z,user_data=None,user_id='621fd2b971c543d197a354c38e0d1867',uuid=e019064c-955e-4f80-9b00-6b32b3835d58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c6c632a-142b-4cda-92c8-77026645af09", "address": "fa:16:3e:15:18:a4", "network": {"id": "beaefb5c-f5e4-47e7-ab68-60131f532ade", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "vif_mac": "fa:16:3e:15:18:a4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e5863cda54487682a4edcc24202c91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c6c632a-14", "ovs_interfaceid": "4c6c632a-142b-4cda-92c8-77026645af09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Converting VIF {"id": "4c6c632a-142b-4cda-92c8-77026645af09", "address": "fa:16:3e:15:18:a4", "network": {"id": "beaefb5c-f5e4-47e7-ab68-60131f532ade", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "vif_mac": "fa:16:3e:15:18:a4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e5863cda54487682a4edcc24202c91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c6c632a-14", "ovs_interfaceid": "4c6c632a-142b-4cda-92c8-77026645af09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:18:a4,bridge_name='br-int',has_traffic_filtering=True,id=4c6c632a-142b-4cda-92c8-77026645af09,network=Network(beaefb5c-f5e4-47e7-ab68-60131f532ade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c6c632a-14') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG nova.objects.instance [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lazy-loading 'pci_devices' on Instance uuid e019064c-955e-4f80-9b00-6b32b3835d58 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] End _get_guest_xml xml=<domain type="kvm">
Aug 09 18:26:50 user nova-compute[72418]:   <uuid>e019064c-955e-4f80-9b00-6b32b3835d58</uuid>
Aug 09 18:26:50 user nova-compute[72418]:   <name>instance-0000000e</name>
Aug 09 18:26:50 user nova-compute[72418]:   <memory>524288</memory>
Aug 09 18:26:50 user nova-compute[72418]:   <vcpu>1</vcpu>
Aug 09 18:26:50 user nova-compute[72418]:   <metadata>
Aug 09 18:26:50 user nova-compute[72418]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:26:50 user nova-compute[72418]:       <nova:package version="0.0.0"/>
Aug 09 18:26:50 user nova-compute[72418]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1312766715</nova:name>
Aug 09 18:26:50 user nova-compute[72418]:       <nova:creationTime>2023-08-09 18:26:50</nova:creationTime>
Aug 09 18:26:50 user nova-compute[72418]:       <nova:flavor name="m1.tiny">
Aug 09 18:26:50 user nova-compute[72418]:         <nova:memory>512</nova:memory>
Aug 09 18:26:50 user nova-compute[72418]:         <nova:disk>1</nova:disk>
Aug 09 18:26:50 user nova-compute[72418]:         <nova:swap>0</nova:swap>
Aug 09 18:26:50 user nova-compute[72418]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:26:50 user nova-compute[72418]:         <nova:vcpus>1</nova:vcpus>
Aug 09 18:26:50 user nova-compute[72418]:       </nova:flavor>
Aug 09 18:26:50 user nova-compute[72418]:       <nova:owner>
Aug 09 18:26:50 user nova-compute[72418]:         <nova:user uuid="621fd2b971c543d197a354c38e0d1867">tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member</nova:user>
Aug 09 18:26:50 user nova-compute[72418]:         <nova:project uuid="52e5863cda54487682a4edcc24202c91">tempest-ServerBootFromVolumeStableRescueTest-1120385592</nova:project>
Aug 09 18:26:50 user nova-compute[72418]:       </nova:owner>
Aug 09 18:26:50 user nova-compute[72418]:       <nova:root type="image" uuid="8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e"/>
Aug 09 18:26:50 user nova-compute[72418]:       <nova:ports>
Aug 09 18:26:50 user nova-compute[72418]:         <nova:port uuid="4c6c632a-142b-4cda-92c8-77026645af09">
Aug 09 18:26:50 user nova-compute[72418]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 18:26:50 user nova-compute[72418]:         </nova:port>
Aug 09 18:26:50 user nova-compute[72418]:       </nova:ports>
Aug 09 18:26:50 user nova-compute[72418]:     </nova:instance>
Aug 09 18:26:50 user nova-compute[72418]:   </metadata>
Aug 09 18:26:50 user nova-compute[72418]:   <sysinfo type="smbios">
Aug 09 18:26:50 user nova-compute[72418]:     <system>
Aug 09 18:26:50 user nova-compute[72418]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 18:26:50 user nova-compute[72418]:       <entry name="product">OpenStack Nova</entry>
Aug 09 18:26:50 user nova-compute[72418]:       <entry name="version">0.0.0</entry>
Aug 09 18:26:50 user nova-compute[72418]:       <entry name="serial">e019064c-955e-4f80-9b00-6b32b3835d58</entry>
Aug 09 18:26:50 user nova-compute[72418]:       <entry name="uuid">e019064c-955e-4f80-9b00-6b32b3835d58</entry>
Aug 09 18:26:50 user nova-compute[72418]:       <entry name="family">Virtual Machine</entry>
Aug 09 18:26:50 user nova-compute[72418]:     </system>
Aug 09 18:26:50 user nova-compute[72418]:   </sysinfo>
Aug 09 18:26:50 user nova-compute[72418]:   <os>
Aug 09 18:26:50 user nova-compute[72418]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 18:26:50 user nova-compute[72418]:     <smbios mode="sysinfo"/>
Aug 09 18:26:50 user nova-compute[72418]:   </os>
Aug 09 18:26:50 user nova-compute[72418]:   <features>
Aug 09 18:26:50 user nova-compute[72418]:     <acpi/>
Aug 09 18:26:50 user nova-compute[72418]:     <apic/>
Aug 09 18:26:50 user nova-compute[72418]:     <vmcoreinfo/>
Aug 09 18:26:50 user nova-compute[72418]:   </features>
Aug 09 18:26:50 user nova-compute[72418]:   <clock offset="utc">
Aug 09 18:26:50 user nova-compute[72418]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 18:26:50 user nova-compute[72418]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 18:26:50 user nova-compute[72418]:     <timer name="hpet" present="no"/>
Aug 09 18:26:50 user nova-compute[72418]:   </clock>
Aug 09 18:26:50 user nova-compute[72418]:   <cpu mode="custom" match="exact">
Aug 09 18:26:50 user nova-compute[72418]:     <model>Nehalem</model>
Aug 09 18:26:50 user nova-compute[72418]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 18:26:50 user nova-compute[72418]:   </cpu>
Aug 09 18:26:50 user nova-compute[72418]:   <devices>
Aug 09 18:26:50 user nova-compute[72418]:     <disk type="block" device="disk">
Aug 09 18:26:50 user nova-compute[72418]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:26:50 user nova-compute[72418]:       <source dev="/dev/sdb"/>
Aug 09 18:26:50 user nova-compute[72418]:       <target dev="vda" bus="virtio"/>
Aug 09 18:26:50 user nova-compute[72418]:       <serial>bf6e1fe4-e93e-4920-bdab-02a219161292</serial>
Aug 09 18:26:50 user nova-compute[72418]:     </disk>
Aug 09 18:26:50 user nova-compute[72418]:     <disk type="file" device="disk">
Aug 09 18:26:50 user nova-compute[72418]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 18:26:50 user nova-compute[72418]:       <source file="/opt/stack/data/nova/instances/e019064c-955e-4f80-9b00-6b32b3835d58/disk.rescue"/>
Aug 09 18:26:50 user nova-compute[72418]:       <target dev="vdb" bus="virtio"/>
Aug 09 18:26:50 user nova-compute[72418]:       <boot order="1"/>
Aug 09 18:26:50 user nova-compute[72418]:     </disk>
Aug 09 18:26:50 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:26:50 user nova-compute[72418]:       <mac address="fa:16:3e:15:18:a4"/>
Aug 09 18:26:50 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:26:50 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:26:50 user nova-compute[72418]:       <target dev="tap4c6c632a-14"/>
Aug 09 18:26:50 user nova-compute[72418]:     </interface>
Aug 09 18:26:50 user nova-compute[72418]:     <serial type="pty">
Aug 09 18:26:50 user nova-compute[72418]:       <log file="/opt/stack/data/nova/instances/e019064c-955e-4f80-9b00-6b32b3835d58/console.log" append="off"/>
Aug 09 18:26:50 user nova-compute[72418]:     </serial>
Aug 09 18:26:50 user nova-compute[72418]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 18:26:50 user nova-compute[72418]:     <video>
Aug 09 18:26:50 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:26:50 user nova-compute[72418]:     </video>
Aug 09 18:26:50 user nova-compute[72418]:     <rng model="virtio">
Aug 09 18:26:50 user nova-compute[72418]:       <backend model="random">/dev/urandom</backend>
Aug 09 18:26:50 user nova-compute[72418]:     </rng>
Aug 09 18:26:50 user nova-compute[72418]:     <controller type="usb" index="0" model="none"/>
Aug 09 18:26:50 user nova-compute[72418]:     <memballoon model="virtio">
Aug 09 18:26:50 user nova-compute[72418]:       <stats period="10"/>
Aug 09 18:26:50 user nova-compute[72418]:     </memballoon>
Aug 09 18:26:50 user nova-compute[72418]:   </devices>
Aug 09 18:26:50 user nova-compute[72418]: </domain>
Aug 09 18:26:50 user nova-compute[72418]:  {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 18:26:50 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Instance destroyed successfully.
Aug 09 18:26:50 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] No VIF found with MAC fa:16:3e:15:18:a4, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/479ea4c3-ad7f-4da0-a901-defe46d96065/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/479ea4c3-ad7f-4da0-a901-defe46d96065/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/479ea4c3-ad7f-4da0-a901-defe46d96065/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/479ea4c3-ad7f-4da0-a901-defe46d96065/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8abe9dfb-2bc7-41f3-adba-7ba00f3af83c/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8abe9dfb-2bc7-41f3-adba-7ba00f3af83c/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8abe9dfb-2bc7-41f3-adba-7ba00f3af83c/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8abe9dfb-2bc7-41f3-adba-7ba00f3af83c/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json" returned: 0 in 0.156s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json" returned: 0 in 0.164s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:51 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:51 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:51 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:52 user nova-compute[72418]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691605597.0338025, 28dad451-f27e-4c62-8353-e3b89e0196cd => Stopped> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:26:52 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] VM Stopped (Lifecycle Event)
Aug 09 18:26:52 user nova-compute[72418]: DEBUG nova.compute.manager [None req-aec450f3-d312-4fe3-9932-f5d6bd4d150b None None] [instance: 28dad451-f27e-4c62-8353-e3b89e0196cd] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:26:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:52 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:52 user nova-compute[72418]: DEBUG nova.compute.manager [req-d0a7f788-6dd0-401d-b173-218093ab5621 req-e54357f6-42eb-4eb1-98b8-d9a0968fc3a3 service nova] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Received event network-vif-plugged-4c6c632a-142b-4cda-92c8-77026645af09 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:26:52 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-d0a7f788-6dd0-401d-b173-218093ab5621 req-e54357f6-42eb-4eb1-98b8-d9a0968fc3a3 service nova] Acquiring lock "e019064c-955e-4f80-9b00-6b32b3835d58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:26:52 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-d0a7f788-6dd0-401d-b173-218093ab5621 req-e54357f6-42eb-4eb1-98b8-d9a0968fc3a3 service nova] Lock "e019064c-955e-4f80-9b00-6b32b3835d58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:26:52 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-d0a7f788-6dd0-401d-b173-218093ab5621 req-e54357f6-42eb-4eb1-98b8-d9a0968fc3a3 service nova] Lock "e019064c-955e-4f80-9b00-6b32b3835d58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:26:52 user nova-compute[72418]: DEBUG nova.compute.manager [req-d0a7f788-6dd0-401d-b173-218093ab5621 req-e54357f6-42eb-4eb1-98b8-d9a0968fc3a3 service nova] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] No waiting events found dispatching network-vif-plugged-4c6c632a-142b-4cda-92c8-77026645af09 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:26:52 user nova-compute[72418]: WARNING nova.compute.manager [req-d0a7f788-6dd0-401d-b173-218093ab5621 req-e54357f6-42eb-4eb1-98b8-d9a0968fc3a3 service nova] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Received unexpected event network-vif-plugged-4c6c632a-142b-4cda-92c8-77026645af09 for instance with vm_state active and task_state rescuing.
Aug 09 18:26:52 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk.rescue --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:52 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk.rescue --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk.rescue --force-share --output=json" returned: 0 in 0.153s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd87d56d-3aa5-43cf-ac55-fb3c41e092b1/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd87d56d-3aa5-43cf-ac55-fb3c41e092b1/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd87d56d-3aa5-43cf-ac55-fb3c41e092b1/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd87d56d-3aa5-43cf-ac55-fb3c41e092b1/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:54 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:26:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e019064c-955e-4f80-9b00-6b32b3835d58/disk.rescue --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e019064c-955e-4f80-9b00-6b32b3835d58/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e019064c-955e-4f80-9b00-6b32b3835d58/disk.rescue --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:26:54 user nova-compute[72418]: DEBUG nova.compute.manager [req-0d9f5d9a-014e-46a6-9c7d-a70b61f596ef req-479223e5-d39e-4e3f-bdfa-9ad9e70858bf service nova] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Received event network-vif-plugged-4c6c632a-142b-4cda-92c8-77026645af09 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:26:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-0d9f5d9a-014e-46a6-9c7d-a70b61f596ef req-479223e5-d39e-4e3f-bdfa-9ad9e70858bf service nova] Acquiring lock "e019064c-955e-4f80-9b00-6b32b3835d58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:26:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-0d9f5d9a-014e-46a6-9c7d-a70b61f596ef req-479223e5-d39e-4e3f-bdfa-9ad9e70858bf service nova] Lock "e019064c-955e-4f80-9b00-6b32b3835d58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:26:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-0d9f5d9a-014e-46a6-9c7d-a70b61f596ef req-479223e5-d39e-4e3f-bdfa-9ad9e70858bf service nova] Lock "e019064c-955e-4f80-9b00-6b32b3835d58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:26:54 user nova-compute[72418]: DEBUG nova.compute.manager [req-0d9f5d9a-014e-46a6-9c7d-a70b61f596ef req-479223e5-d39e-4e3f-bdfa-9ad9e70858bf service nova] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] No waiting events found dispatching network-vif-plugged-4c6c632a-142b-4cda-92c8-77026645af09 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:26:54 user nova-compute[72418]: WARNING nova.compute.manager [req-0d9f5d9a-014e-46a6-9c7d-a70b61f596ef req-479223e5-d39e-4e3f-bdfa-9ad9e70858bf service nova] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Received unexpected event network-vif-plugged-4c6c632a-142b-4cda-92c8-77026645af09 for instance with vm_state active and task_state rescuing.
Aug 09 18:26:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e019064c-955e-4f80-9b00-6b32b3835d58/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:26:54 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Removed pending event for e019064c-955e-4f80-9b00-6b32b3835d58 due to event {{(pid=72418) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 18:26:54 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605614.5168052, e019064c-955e-4f80-9b00-6b32b3835d58 => Resumed> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:26:54 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] VM Resumed (Lifecycle Event)
Aug 09 18:26:55 user nova-compute[72418]: DEBUG nova.compute.manager [None req-26092997-9bec-4b43-850a-550f67984bb0 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:26:55 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:26:55 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:26:55 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:26:55 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Hypervisor/Node resource view: name=user free_ram=7507MB free_disk=25.665878295898438GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72418) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 18:26:55 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:26:55 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:26:55 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:26:55 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 09 18:26:55 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605614.5187, e019064c-955e-4f80-9b00-6b32b3835d58 => Started> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:26:55 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] VM Started (Lifecycle Event)
Aug 09 18:26:55 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:26:55 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:26:55 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 6af7918a-ce90-45ab-93d8-684e1489e891 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:26:55 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 8fe41968-a219-4a5a-afdb-32eb2082bb40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:26:55 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 01c46b33-6788-44a5-a43c-88ee4acc4d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:26:55 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 479ea4c3-ad7f-4da0-a901-defe46d96065 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:26:55 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:26:55 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance e019064c-955e-4f80-9b00-6b32b3835d58 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:26:55 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance bd87d56d-3aa5-43cf-ac55-fb3c41e092b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:26:55 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance e07beace-59d8-4c02-844b-1db1a6e81198 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:26:55 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance c46f2599-93f8-412e-9918-7ace8a9f19dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:26:55 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:26:55 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 18:26:55 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 18:26:55 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:26:55 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:26:55 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Compute_service record updated for user:user {{(pid=72418) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 18:26:55 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.640s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:26:57 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:57 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:26:59 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:26:59 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Starting heal instance info cache {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 18:27:00 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "refresh_cache-4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:27:00 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquired lock "refresh_cache-4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:27:00 user nova-compute[72418]: DEBUG nova.network.neutron [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Forcefully refreshing network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 18:27:00 user nova-compute[72418]: DEBUG nova.network.neutron [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Updating instance_info_cache with network_info: [{"id": "e6c1511d-0765-4136-854a-e9a673db5071", "address": "fa:16:3e:ca:f9:2b", "network": {"id": "57e1bdad-aad5-47b8-854b-68f3c1375325", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1415993909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f09f1028304efd84f2e694efdae063", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c1511d-07", "ovs_interfaceid": "e6c1511d-0765-4136-854a-e9a673db5071", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:27:00 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Releasing lock "refresh_cache-4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:27:00 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Updated the network info_cache for instance {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 18:27:02 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:02 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:02 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:05 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Acquiring lock "c052c2b2-e823-4929-912b-40968130f964" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:27:05 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Lock "c052c2b2-e823-4929-912b-40968130f964" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:27:05 user nova-compute[72418]: DEBUG nova.compute.manager [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: c052c2b2-e823-4929-912b-40968130f964] Starting instance... {{(pid=72418) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 18:27:05 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:27:05 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:27:05 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72418) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 18:27:05 user nova-compute[72418]: INFO nova.compute.claims [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: c052c2b2-e823-4929-912b-40968130f964] Claim successful on node user
Aug 09 18:27:05 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:27:05 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:27:05 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.548s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:27:05 user nova-compute[72418]: DEBUG nova.compute.manager [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: c052c2b2-e823-4929-912b-40968130f964] Start building networks asynchronously for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 18:27:06 user nova-compute[72418]: DEBUG nova.compute.manager [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: c052c2b2-e823-4929-912b-40968130f964] Allocating IP information in the background. {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 18:27:06 user nova-compute[72418]: DEBUG nova.network.neutron [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: c052c2b2-e823-4929-912b-40968130f964] allocate_for_instance() {{(pid=72418) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 18:27:06 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: c052c2b2-e823-4929-912b-40968130f964] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 18:27:06 user nova-compute[72418]: DEBUG nova.compute.manager [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: c052c2b2-e823-4929-912b-40968130f964] Start building block device mappings for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 18:27:06 user nova-compute[72418]: DEBUG nova.policy [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cb031f5ca0bc4b7dbb600ee287a26e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7a7d69112347edb919fb26f98e55e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72418) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 18:27:06 user nova-compute[72418]: DEBUG nova.compute.manager [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: c052c2b2-e823-4929-912b-40968130f964] Start spawning the instance on the hypervisor. {{(pid=72418) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 18:27:06 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: c052c2b2-e823-4929-912b-40968130f964] Creating instance directory {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 18:27:06 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: c052c2b2-e823-4929-912b-40968130f964] Creating image(s)
Aug 09 18:27:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Acquiring lock "/opt/stack/data/nova/instances/c052c2b2-e823-4929-912b-40968130f964/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:27:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Lock "/opt/stack/data/nova/instances/c052c2b2-e823-4929-912b-40968130f964/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:27:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Lock "/opt/stack/data/nova/instances/c052c2b2-e823-4929-912b-40968130f964/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:27:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:27:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.164s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:27:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Acquiring lock "458773cfa7230b717e41c60277832e9f83806d71" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:27:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:27:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:27:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.147s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:27:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/c052c2b2-e823-4929-912b-40968130f964/disk 1073741824 {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:27:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/c052c2b2-e823-4929-912b-40968130f964/disk 1073741824" returned: 0 in 0.055s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:27:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:27:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:27:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.132s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:27:06 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c052c2b2-e823-4929-912b-40968130f964/disk. size=1073741824 {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 18:27:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c052c2b2-e823-4929-912b-40968130f964/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:27:06 user nova-compute[72418]: DEBUG nova.network.neutron [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: c052c2b2-e823-4929-912b-40968130f964] Successfully created port: b0775e0d-bee0-4b6d-a85e-7668c873b3cc {{(pid=72418) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 18:27:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c052c2b2-e823-4929-912b-40968130f964/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:27:06 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Cannot resize image /opt/stack/data/nova/instances/c052c2b2-e823-4929-912b-40968130f964/disk to a smaller size. {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 18:27:06 user nova-compute[72418]: DEBUG nova.objects.instance [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Lazy-loading 'migration_context' on Instance uuid c052c2b2-e823-4929-912b-40968130f964 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:27:06 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: c052c2b2-e823-4929-912b-40968130f964] Created local disks {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 18:27:06 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: c052c2b2-e823-4929-912b-40968130f964] Ensure instance console log exists: /opt/stack/data/nova/instances/c052c2b2-e823-4929-912b-40968130f964/console.log {{(pid=72418) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 18:27:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:27:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:27:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:27:07 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:07 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:07 user nova-compute[72418]: DEBUG nova.network.neutron [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: c052c2b2-e823-4929-912b-40968130f964] Successfully updated port: b0775e0d-bee0-4b6d-a85e-7668c873b3cc {{(pid=72418) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 18:27:07 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Acquiring lock "refresh_cache-c052c2b2-e823-4929-912b-40968130f964" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:27:07 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Acquired lock "refresh_cache-c052c2b2-e823-4929-912b-40968130f964" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:27:07 user nova-compute[72418]: DEBUG nova.network.neutron [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: c052c2b2-e823-4929-912b-40968130f964] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:27:07 user nova-compute[72418]: DEBUG nova.network.neutron [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: c052c2b2-e823-4929-912b-40968130f964] Instance cache missing network info. {{(pid=72418) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 18:27:07 user nova-compute[72418]: DEBUG nova.compute.manager [req-d5d7d54b-3442-4abf-b746-6ec8d4d70bec req-bb015639-d06d-4573-8626-cfbbed4d5c38 service nova] [instance: c052c2b2-e823-4929-912b-40968130f964] Received event network-changed-b0775e0d-bee0-4b6d-a85e-7668c873b3cc {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:27:07 user nova-compute[72418]: DEBUG nova.compute.manager [req-d5d7d54b-3442-4abf-b746-6ec8d4d70bec req-bb015639-d06d-4573-8626-cfbbed4d5c38 service nova] [instance: c052c2b2-e823-4929-912b-40968130f964] Refreshing instance network info cache due to event network-changed-b0775e0d-bee0-4b6d-a85e-7668c873b3cc. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:27:07 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-d5d7d54b-3442-4abf-b746-6ec8d4d70bec req-bb015639-d06d-4573-8626-cfbbed4d5c38 service nova] Acquiring lock "refresh_cache-c052c2b2-e823-4929-912b-40968130f964" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:27:08 user nova-compute[72418]: DEBUG nova.network.neutron [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: c052c2b2-e823-4929-912b-40968130f964] Updating instance_info_cache with network_info: [{"id": "b0775e0d-bee0-4b6d-a85e-7668c873b3cc", "address": "fa:16:3e:3f:06:d0", "network": {"id": "c14fe632-b9ef-4551-8767-8bd9520ab900", "bridge": "br-int", "label": "tempest-VolumesActionsTest-889666224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7a7d69112347edb919fb26f98e55e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0775e0d-be", "ovs_interfaceid": "b0775e0d-bee0-4b6d-a85e-7668c873b3cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:27:08 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Releasing lock "refresh_cache-c052c2b2-e823-4929-912b-40968130f964" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:27:08 user nova-compute[72418]: DEBUG nova.compute.manager [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: c052c2b2-e823-4929-912b-40968130f964] Instance network_info: |[{"id": "b0775e0d-bee0-4b6d-a85e-7668c873b3cc", "address": "fa:16:3e:3f:06:d0", "network": {"id": "c14fe632-b9ef-4551-8767-8bd9520ab900", "bridge": "br-int", "label": "tempest-VolumesActionsTest-889666224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7a7d69112347edb919fb26f98e55e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0775e0d-be", "ovs_interfaceid": "b0775e0d-bee0-4b6d-a85e-7668c873b3cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 18:27:08 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-d5d7d54b-3442-4abf-b746-6ec8d4d70bec req-bb015639-d06d-4573-8626-cfbbed4d5c38 service nova] Acquired lock "refresh_cache-c052c2b2-e823-4929-912b-40968130f964" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:27:08 user nova-compute[72418]: DEBUG nova.network.neutron [req-d5d7d54b-3442-4abf-b746-6ec8d4d70bec req-bb015639-d06d-4573-8626-cfbbed4d5c38 service nova] [instance: c052c2b2-e823-4929-912b-40968130f964] Refreshing network info cache for port b0775e0d-bee0-4b6d-a85e-7668c873b3cc {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:27:08 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: c052c2b2-e823-4929-912b-40968130f964] Start _get_guest_xml network_info=[{"id": "b0775e0d-bee0-4b6d-a85e-7668c873b3cc", "address": "fa:16:3e:3f:06:d0", "network": {"id": "c14fe632-b9ef-4551-8767-8bd9520ab900", "bridge": "br-int", "label": "tempest-VolumesActionsTest-889666224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7a7d69112347edb919fb26f98e55e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0775e0d-be", "ovs_interfaceid": "b0775e0d-bee0-4b6d-a85e-7668c873b3cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 18:27:08 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:27:08 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:27:08 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 18:27:08 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] CPU controller missing on host. {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 18:27:08 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 18:27:08 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] CPU controller found on host. {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 18:27:08 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72418) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 18:27:08 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T18:17:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 18:27:08 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Flavor limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 18:27:08 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Image limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 18:27:08 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Flavor pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 18:27:08 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Image pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 18:27:08 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 18:27:08 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 18:27:08 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 18:27:08 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Got 1 possible topologies {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 18:27:08 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 18:27:08 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 18:27:08 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:27:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-195696140',display_name='tempest-VolumesActionsTest-instance-195696140',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-195696140',id=19,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af7a7d69112347edb919fb26f98e55e3',ramdisk_id='',reservation_id='r-u26q2si6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1905077092',owner_user_name='tempest-VolumesActionsTest-1905077092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:27:06Z,user_data=None,user_id='cb031f5ca0bc4b7dbb600ee287a26e6f',uuid=c052c2b2-e823-4929-912b-40968130f964,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0775e0d-bee0-4b6d-a85e-7668c873b3cc", "address": "fa:16:3e:3f:06:d0", "network": {"id": "c14fe632-b9ef-4551-8767-8bd9520ab900", "bridge": "br-int", "label": "tempest-VolumesActionsTest-889666224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7a7d69112347edb919fb26f98e55e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0775e0d-be", "ovs_interfaceid": "b0775e0d-bee0-4b6d-a85e-7668c873b3cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:27:08 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Converting VIF {"id": "b0775e0d-bee0-4b6d-a85e-7668c873b3cc", "address": "fa:16:3e:3f:06:d0", "network": {"id": "c14fe632-b9ef-4551-8767-8bd9520ab900", "bridge": "br-int", "label": "tempest-VolumesActionsTest-889666224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7a7d69112347edb919fb26f98e55e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0775e0d-be", "ovs_interfaceid": "b0775e0d-bee0-4b6d-a85e-7668c873b3cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:27:08 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:06:d0,bridge_name='br-int',has_traffic_filtering=True,id=b0775e0d-bee0-4b6d-a85e-7668c873b3cc,network=Network(c14fe632-b9ef-4551-8767-8bd9520ab900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0775e0d-be') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:27:08 user nova-compute[72418]: DEBUG nova.objects.instance [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Lazy-loading 'pci_devices' on Instance uuid c052c2b2-e823-4929-912b-40968130f964 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:27:08 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: c052c2b2-e823-4929-912b-40968130f964] End _get_guest_xml xml=<domain type="kvm">
Aug 09 18:27:08 user nova-compute[72418]:   <uuid>c052c2b2-e823-4929-912b-40968130f964</uuid>
Aug 09 18:27:08 user nova-compute[72418]:   <name>instance-00000013</name>
Aug 09 18:27:08 user nova-compute[72418]:   <memory>524288</memory>
Aug 09 18:27:08 user nova-compute[72418]:   <vcpu>1</vcpu>
Aug 09 18:27:08 user nova-compute[72418]:   <metadata>
Aug 09 18:27:08 user nova-compute[72418]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:27:08 user nova-compute[72418]:       <nova:package version="0.0.0"/>
Aug 09 18:27:08 user nova-compute[72418]:       <nova:name>tempest-VolumesActionsTest-instance-195696140</nova:name>
Aug 09 18:27:08 user nova-compute[72418]:       <nova:creationTime>2023-08-09 18:27:08</nova:creationTime>
Aug 09 18:27:08 user nova-compute[72418]:       <nova:flavor name="m1.tiny">
Aug 09 18:27:08 user nova-compute[72418]:         <nova:memory>512</nova:memory>
Aug 09 18:27:08 user nova-compute[72418]:         <nova:disk>1</nova:disk>
Aug 09 18:27:08 user nova-compute[72418]:         <nova:swap>0</nova:swap>
Aug 09 18:27:08 user nova-compute[72418]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:27:08 user nova-compute[72418]:         <nova:vcpus>1</nova:vcpus>
Aug 09 18:27:08 user nova-compute[72418]:       </nova:flavor>
Aug 09 18:27:08 user nova-compute[72418]:       <nova:owner>
Aug 09 18:27:08 user nova-compute[72418]:         <nova:user uuid="cb031f5ca0bc4b7dbb600ee287a26e6f">tempest-VolumesActionsTest-1905077092-project-member</nova:user>
Aug 09 18:27:08 user nova-compute[72418]:         <nova:project uuid="af7a7d69112347edb919fb26f98e55e3">tempest-VolumesActionsTest-1905077092</nova:project>
Aug 09 18:27:08 user nova-compute[72418]:       </nova:owner>
Aug 09 18:27:08 user nova-compute[72418]:       <nova:root type="image" uuid="8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e"/>
Aug 09 18:27:08 user nova-compute[72418]:       <nova:ports>
Aug 09 18:27:08 user nova-compute[72418]:         <nova:port uuid="b0775e0d-bee0-4b6d-a85e-7668c873b3cc">
Aug 09 18:27:08 user nova-compute[72418]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 09 18:27:08 user nova-compute[72418]:         </nova:port>
Aug 09 18:27:08 user nova-compute[72418]:       </nova:ports>
Aug 09 18:27:08 user nova-compute[72418]:     </nova:instance>
Aug 09 18:27:08 user nova-compute[72418]:   </metadata>
Aug 09 18:27:08 user nova-compute[72418]:   <sysinfo type="smbios">
Aug 09 18:27:08 user nova-compute[72418]:     <system>
Aug 09 18:27:08 user nova-compute[72418]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 18:27:08 user nova-compute[72418]:       <entry name="product">OpenStack Nova</entry>
Aug 09 18:27:08 user nova-compute[72418]:       <entry name="version">0.0.0</entry>
Aug 09 18:27:08 user nova-compute[72418]:       <entry name="serial">c052c2b2-e823-4929-912b-40968130f964</entry>
Aug 09 18:27:08 user nova-compute[72418]:       <entry name="uuid">c052c2b2-e823-4929-912b-40968130f964</entry>
Aug 09 18:27:08 user nova-compute[72418]:       <entry name="family">Virtual Machine</entry>
Aug 09 18:27:08 user nova-compute[72418]:     </system>
Aug 09 18:27:08 user nova-compute[72418]:   </sysinfo>
Aug 09 18:27:08 user nova-compute[72418]:   <os>
Aug 09 18:27:08 user nova-compute[72418]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 18:27:08 user nova-compute[72418]:     <boot dev="hd"/>
Aug 09 18:27:08 user nova-compute[72418]:     <smbios mode="sysinfo"/>
Aug 09 18:27:08 user nova-compute[72418]:   </os>
Aug 09 18:27:08 user nova-compute[72418]:   <features>
Aug 09 18:27:08 user nova-compute[72418]:     <acpi/>
Aug 09 18:27:08 user nova-compute[72418]:     <apic/>
Aug 09 18:27:08 user nova-compute[72418]:     <vmcoreinfo/>
Aug 09 18:27:08 user nova-compute[72418]:   </features>
Aug 09 18:27:08 user nova-compute[72418]:   <clock offset="utc">
Aug 09 18:27:08 user nova-compute[72418]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 18:27:08 user nova-compute[72418]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 18:27:08 user nova-compute[72418]:     <timer name="hpet" present="no"/>
Aug 09 18:27:08 user nova-compute[72418]:   </clock>
Aug 09 18:27:08 user nova-compute[72418]:   <cpu mode="custom" match="exact">
Aug 09 18:27:08 user nova-compute[72418]:     <model>Nehalem</model>
Aug 09 18:27:08 user nova-compute[72418]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 18:27:08 user nova-compute[72418]:   </cpu>
Aug 09 18:27:08 user nova-compute[72418]:   <devices>
Aug 09 18:27:08 user nova-compute[72418]:     <disk type="file" device="disk">
Aug 09 18:27:08 user nova-compute[72418]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 18:27:08 user nova-compute[72418]:       <source file="/opt/stack/data/nova/instances/c052c2b2-e823-4929-912b-40968130f964/disk"/>
Aug 09 18:27:08 user nova-compute[72418]:       <target dev="vda" bus="virtio"/>
Aug 09 18:27:08 user nova-compute[72418]:     </disk>
Aug 09 18:27:08 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:27:08 user nova-compute[72418]:       <mac address="fa:16:3e:3f:06:d0"/>
Aug 09 18:27:08 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:27:08 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:27:08 user nova-compute[72418]:       <target dev="tapb0775e0d-be"/>
Aug 09 18:27:08 user nova-compute[72418]:     </interface>
Aug 09 18:27:08 user nova-compute[72418]:     <serial type="pty">
Aug 09 18:27:08 user nova-compute[72418]:       <log file="/opt/stack/data/nova/instances/c052c2b2-e823-4929-912b-40968130f964/console.log" append="off"/>
Aug 09 18:27:08 user nova-compute[72418]:     </serial>
Aug 09 18:27:08 user nova-compute[72418]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 18:27:08 user nova-compute[72418]:     <video>
Aug 09 18:27:08 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:27:08 user nova-compute[72418]:     </video>
Aug 09 18:27:08 user nova-compute[72418]:     <rng model="virtio">
Aug 09 18:27:08 user nova-compute[72418]:       <backend model="random">/dev/urandom</backend>
Aug 09 18:27:08 user nova-compute[72418]:     </rng>
Aug 09 18:27:08 user nova-compute[72418]:     <controller type="usb" index="0" model="none"/>
Aug 09 18:27:08 user nova-compute[72418]:     <memballoon model="virtio">
Aug 09 18:27:08 user nova-compute[72418]:       <stats period="10"/>
Aug 09 18:27:08 user nova-compute[72418]:     </memballoon>
Aug 09 18:27:08 user nova-compute[72418]:   </devices>
Aug 09 18:27:08 user nova-compute[72418]: </domain>
Aug 09 18:27:08 user nova-compute[72418]:  {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 18:27:08 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:27:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-195696140',display_name='tempest-VolumesActionsTest-instance-195696140',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-195696140',id=19,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af7a7d69112347edb919fb26f98e55e3',ramdisk_id='',reservation_id='r-u26q2si6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1905077092',owner_user_name='tempest-VolumesActionsTest-1905077092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:27:06Z,user_data=None,user_id='cb031f5ca0bc4b7dbb600ee287a26e6f',uuid=c052c2b2-e823-4929-912b-40968130f964,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0775e0d-bee0-4b6d-a85e-7668c873b3cc", "address": "fa:16:3e:3f:06:d0", "network": {"id": "c14fe632-b9ef-4551-8767-8bd9520ab900", "bridge": "br-int", "label": "tempest-VolumesActionsTest-889666224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7a7d69112347edb919fb26f98e55e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0775e0d-be", "ovs_interfaceid": "b0775e0d-bee0-4b6d-a85e-7668c873b3cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:27:08 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Converting VIF {"id": "b0775e0d-bee0-4b6d-a85e-7668c873b3cc", "address": "fa:16:3e:3f:06:d0", "network": {"id": "c14fe632-b9ef-4551-8767-8bd9520ab900", "bridge": "br-int", "label": "tempest-VolumesActionsTest-889666224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7a7d69112347edb919fb26f98e55e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0775e0d-be", "ovs_interfaceid": "b0775e0d-bee0-4b6d-a85e-7668c873b3cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:27:08 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:06:d0,bridge_name='br-int',has_traffic_filtering=True,id=b0775e0d-bee0-4b6d-a85e-7668c873b3cc,network=Network(c14fe632-b9ef-4551-8767-8bd9520ab900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0775e0d-be') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:27:08 user nova-compute[72418]: DEBUG os_vif [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:06:d0,bridge_name='br-int',has_traffic_filtering=True,id=b0775e0d-bee0-4b6d-a85e-7668c873b3cc,network=Network(c14fe632-b9ef-4551-8767-8bd9520ab900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0775e0d-be') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:27:08 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:08 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:27:08 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:27:08 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:08 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb0775e0d-be, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:27:08 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb0775e0d-be, col_values=(('external_ids', {'iface-id': 'b0775e0d-bee0-4b6d-a85e-7668c873b3cc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:06:d0', 'vm-uuid': 'c052c2b2-e823-4929-912b-40968130f964'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:27:08 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:08 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:27:08 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:08 user nova-compute[72418]: INFO os_vif [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:06:d0,bridge_name='br-int',has_traffic_filtering=True,id=b0775e0d-bee0-4b6d-a85e-7668c873b3cc,network=Network(c14fe632-b9ef-4551-8767-8bd9520ab900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0775e0d-be')
Aug 09 18:27:08 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:27:08 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] No VIF found with MAC fa:16:3e:3f:06:d0, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:27:08 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:08 user nova-compute[72418]: DEBUG nova.network.neutron [req-d5d7d54b-3442-4abf-b746-6ec8d4d70bec req-bb015639-d06d-4573-8626-cfbbed4d5c38 service nova] [instance: c052c2b2-e823-4929-912b-40968130f964] Updated VIF entry in instance network info cache for port b0775e0d-bee0-4b6d-a85e-7668c873b3cc. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:27:08 user nova-compute[72418]: DEBUG nova.network.neutron [req-d5d7d54b-3442-4abf-b746-6ec8d4d70bec req-bb015639-d06d-4573-8626-cfbbed4d5c38 service nova] [instance: c052c2b2-e823-4929-912b-40968130f964] Updating instance_info_cache with network_info: [{"id": "b0775e0d-bee0-4b6d-a85e-7668c873b3cc", "address": "fa:16:3e:3f:06:d0", "network": {"id": "c14fe632-b9ef-4551-8767-8bd9520ab900", "bridge": "br-int", "label": "tempest-VolumesActionsTest-889666224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7a7d69112347edb919fb26f98e55e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0775e0d-be", "ovs_interfaceid": "b0775e0d-bee0-4b6d-a85e-7668c873b3cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:27:08 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-d5d7d54b-3442-4abf-b746-6ec8d4d70bec req-bb015639-d06d-4573-8626-cfbbed4d5c38 service nova] Releasing lock "refresh_cache-c052c2b2-e823-4929-912b-40968130f964" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:27:09 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:09 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:09 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:10 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:10 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:10 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:10 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:10 user nova-compute[72418]: DEBUG nova.compute.manager [req-c3387212-a25f-496c-9ad3-0d95daaed6c7 req-558eb674-66ca-4735-828d-e0e4a6d05be7 service nova] [instance: c052c2b2-e823-4929-912b-40968130f964] Received event network-vif-plugged-b0775e0d-bee0-4b6d-a85e-7668c873b3cc {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:27:10 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-c3387212-a25f-496c-9ad3-0d95daaed6c7 req-558eb674-66ca-4735-828d-e0e4a6d05be7 service nova] Acquiring lock "c052c2b2-e823-4929-912b-40968130f964-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:27:10 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-c3387212-a25f-496c-9ad3-0d95daaed6c7 req-558eb674-66ca-4735-828d-e0e4a6d05be7 service nova] Lock "c052c2b2-e823-4929-912b-40968130f964-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:27:10 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-c3387212-a25f-496c-9ad3-0d95daaed6c7 req-558eb674-66ca-4735-828d-e0e4a6d05be7 service nova] Lock "c052c2b2-e823-4929-912b-40968130f964-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:27:10 user nova-compute[72418]: DEBUG nova.compute.manager [req-c3387212-a25f-496c-9ad3-0d95daaed6c7 req-558eb674-66ca-4735-828d-e0e4a6d05be7 service nova] [instance: c052c2b2-e823-4929-912b-40968130f964] No waiting events found dispatching network-vif-plugged-b0775e0d-bee0-4b6d-a85e-7668c873b3cc {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:27:10 user nova-compute[72418]: WARNING nova.compute.manager [req-c3387212-a25f-496c-9ad3-0d95daaed6c7 req-558eb674-66ca-4735-828d-e0e4a6d05be7 service nova] [instance: c052c2b2-e823-4929-912b-40968130f964] Received unexpected event network-vif-plugged-b0775e0d-bee0-4b6d-a85e-7668c873b3cc for instance with vm_state building and task_state spawning.
Aug 09 18:27:11 user nova-compute[72418]: DEBUG nova.compute.manager [req-edad9843-00a8-4da3-86ad-ec3bbf3b8e8a req-726a863d-b6df-4f34-b1c8-815fc58b8a00 service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Received event network-changed-301d9f8c-022d-4c02-90dd-374ead3daa23 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:27:11 user nova-compute[72418]: DEBUG nova.compute.manager [req-edad9843-00a8-4da3-86ad-ec3bbf3b8e8a req-726a863d-b6df-4f34-b1c8-815fc58b8a00 service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Refreshing instance network info cache due to event network-changed-301d9f8c-022d-4c02-90dd-374ead3daa23. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:27:11 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-edad9843-00a8-4da3-86ad-ec3bbf3b8e8a req-726a863d-b6df-4f34-b1c8-815fc58b8a00 service nova] Acquiring lock "refresh_cache-e07beace-59d8-4c02-844b-1db1a6e81198" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:27:11 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-edad9843-00a8-4da3-86ad-ec3bbf3b8e8a req-726a863d-b6df-4f34-b1c8-815fc58b8a00 service nova] Acquired lock "refresh_cache-e07beace-59d8-4c02-844b-1db1a6e81198" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:27:11 user nova-compute[72418]: DEBUG nova.network.neutron [req-edad9843-00a8-4da3-86ad-ec3bbf3b8e8a req-726a863d-b6df-4f34-b1c8-815fc58b8a00 service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Refreshing network info cache for port 301d9f8c-022d-4c02-90dd-374ead3daa23 {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:27:11 user nova-compute[72418]: DEBUG nova.compute.manager [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: c052c2b2-e823-4929-912b-40968130f964] Instance event wait completed in 0 seconds for  {{(pid=72418) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 18:27:11 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: c052c2b2-e823-4929-912b-40968130f964] Guest created on hypervisor {{(pid=72418) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 18:27:11 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605631.7723017, c052c2b2-e823-4929-912b-40968130f964 => Resumed> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:27:11 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: c052c2b2-e823-4929-912b-40968130f964] VM Resumed (Lifecycle Event)
Aug 09 18:27:11 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: c052c2b2-e823-4929-912b-40968130f964] Instance spawned successfully.
Aug 09 18:27:11 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: c052c2b2-e823-4929-912b-40968130f964] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 18:27:11 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: c052c2b2-e823-4929-912b-40968130f964] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:27:11 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: c052c2b2-e823-4929-912b-40968130f964] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:27:11 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: c052c2b2-e823-4929-912b-40968130f964] Found default for hw_cdrom_bus of ide {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:27:11 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: c052c2b2-e823-4929-912b-40968130f964] Found default for hw_disk_bus of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:27:11 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: c052c2b2-e823-4929-912b-40968130f964] Found default for hw_input_bus of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:27:11 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: c052c2b2-e823-4929-912b-40968130f964] Found default for hw_pointer_model of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:27:11 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: c052c2b2-e823-4929-912b-40968130f964] Found default for hw_video_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:27:11 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: c052c2b2-e823-4929-912b-40968130f964] Found default for hw_vif_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:27:11 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: c052c2b2-e823-4929-912b-40968130f964] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:27:11 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605631.7726018, c052c2b2-e823-4929-912b-40968130f964 => Started> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:27:11 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: c052c2b2-e823-4929-912b-40968130f964] VM Started (Lifecycle Event)
Aug 09 18:27:11 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: c052c2b2-e823-4929-912b-40968130f964] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:27:11 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: c052c2b2-e823-4929-912b-40968130f964] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:27:11 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: c052c2b2-e823-4929-912b-40968130f964] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:27:11 user nova-compute[72418]: INFO nova.compute.manager [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: c052c2b2-e823-4929-912b-40968130f964] Took 5.72 seconds to spawn the instance on the hypervisor.
Aug 09 18:27:11 user nova-compute[72418]: DEBUG nova.compute.manager [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: c052c2b2-e823-4929-912b-40968130f964] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:27:11 user nova-compute[72418]: INFO nova.compute.manager [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: c052c2b2-e823-4929-912b-40968130f964] Took 6.61 seconds to build instance.
Aug 09 18:27:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-56904435-0279-484b-8037-6433f90d03d9 tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Lock "c052c2b2-e823-4929-912b-40968130f964" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.726s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:27:12 user nova-compute[72418]: DEBUG nova.compute.manager [req-a8b2f40d-ba8b-4e02-a77b-64e02ce83875 req-b21998a7-42a5-48ac-a8ca-9ab69bb1e238 service nova] [instance: c052c2b2-e823-4929-912b-40968130f964] Received event network-vif-plugged-b0775e0d-bee0-4b6d-a85e-7668c873b3cc {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:27:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a8b2f40d-ba8b-4e02-a77b-64e02ce83875 req-b21998a7-42a5-48ac-a8ca-9ab69bb1e238 service nova] Acquiring lock "c052c2b2-e823-4929-912b-40968130f964-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:27:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a8b2f40d-ba8b-4e02-a77b-64e02ce83875 req-b21998a7-42a5-48ac-a8ca-9ab69bb1e238 service nova] Lock "c052c2b2-e823-4929-912b-40968130f964-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:27:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a8b2f40d-ba8b-4e02-a77b-64e02ce83875 req-b21998a7-42a5-48ac-a8ca-9ab69bb1e238 service nova] Lock "c052c2b2-e823-4929-912b-40968130f964-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:27:12 user nova-compute[72418]: DEBUG nova.compute.manager [req-a8b2f40d-ba8b-4e02-a77b-64e02ce83875 req-b21998a7-42a5-48ac-a8ca-9ab69bb1e238 service nova] [instance: c052c2b2-e823-4929-912b-40968130f964] No waiting events found dispatching network-vif-plugged-b0775e0d-bee0-4b6d-a85e-7668c873b3cc {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:27:12 user nova-compute[72418]: WARNING nova.compute.manager [req-a8b2f40d-ba8b-4e02-a77b-64e02ce83875 req-b21998a7-42a5-48ac-a8ca-9ab69bb1e238 service nova] [instance: c052c2b2-e823-4929-912b-40968130f964] Received unexpected event network-vif-plugged-b0775e0d-bee0-4b6d-a85e-7668c873b3cc for instance with vm_state active and task_state None.
Aug 09 18:27:12 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:12 user nova-compute[72418]: DEBUG nova.network.neutron [req-edad9843-00a8-4da3-86ad-ec3bbf3b8e8a req-726a863d-b6df-4f34-b1c8-815fc58b8a00 service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Updated VIF entry in instance network info cache for port 301d9f8c-022d-4c02-90dd-374ead3daa23. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:27:12 user nova-compute[72418]: DEBUG nova.network.neutron [req-edad9843-00a8-4da3-86ad-ec3bbf3b8e8a req-726a863d-b6df-4f34-b1c8-815fc58b8a00 service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Updating instance_info_cache with network_info: [{"id": "301d9f8c-022d-4c02-90dd-374ead3daa23", "address": "fa:16:3e:a6:38:d9", "network": {"id": "7621f03d-76ac-49da-89a8-0753bb11e329", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596253708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5242fb37f9664dbf9a8b50449f8dd129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap301d9f8c-02", "ovs_interfaceid": "301d9f8c-022d-4c02-90dd-374ead3daa23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:27:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-edad9843-00a8-4da3-86ad-ec3bbf3b8e8a req-726a863d-b6df-4f34-b1c8-815fc58b8a00 service nova] Releasing lock "refresh_cache-e07beace-59d8-4c02-844b-1db1a6e81198" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:27:13 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:14 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-7021b7d6-bdbb-4963-879b-509aea68ecbf tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Acquiring lock "bd87d56d-3aa5-43cf-ac55-fb3c41e092b1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:27:14 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-7021b7d6-bdbb-4963-879b-509aea68ecbf tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Lock "bd87d56d-3aa5-43cf-ac55-fb3c41e092b1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:27:14 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-7021b7d6-bdbb-4963-879b-509aea68ecbf tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Acquiring lock "bd87d56d-3aa5-43cf-ac55-fb3c41e092b1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:27:14 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-7021b7d6-bdbb-4963-879b-509aea68ecbf tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Lock "bd87d56d-3aa5-43cf-ac55-fb3c41e092b1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:27:14 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-7021b7d6-bdbb-4963-879b-509aea68ecbf tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Lock "bd87d56d-3aa5-43cf-ac55-fb3c41e092b1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:27:14 user nova-compute[72418]: INFO nova.compute.manager [None req-7021b7d6-bdbb-4963-879b-509aea68ecbf tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Terminating instance
Aug 09 18:27:14 user nova-compute[72418]: DEBUG nova.compute.manager [None req-7021b7d6-bdbb-4963-879b-509aea68ecbf tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Start destroying the instance on the hypervisor. {{(pid=72418) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 18:27:14 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:15 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:15 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:15 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:15 user nova-compute[72418]: DEBUG nova.compute.manager [req-dad26569-7682-4504-ba8e-a5181dafc680 req-3ba91b40-be76-4002-a1a2-28bb7d0882dc service nova] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Received event network-vif-unplugged-616dd3b1-68e6-47e9-b7ff-a4b63c3e702f {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:27:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-dad26569-7682-4504-ba8e-a5181dafc680 req-3ba91b40-be76-4002-a1a2-28bb7d0882dc service nova] Acquiring lock "bd87d56d-3aa5-43cf-ac55-fb3c41e092b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:27:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-dad26569-7682-4504-ba8e-a5181dafc680 req-3ba91b40-be76-4002-a1a2-28bb7d0882dc service nova] Lock "bd87d56d-3aa5-43cf-ac55-fb3c41e092b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:27:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-dad26569-7682-4504-ba8e-a5181dafc680 req-3ba91b40-be76-4002-a1a2-28bb7d0882dc service nova] Lock "bd87d56d-3aa5-43cf-ac55-fb3c41e092b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:27:15 user nova-compute[72418]: DEBUG nova.compute.manager [req-dad26569-7682-4504-ba8e-a5181dafc680 req-3ba91b40-be76-4002-a1a2-28bb7d0882dc service nova] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] No waiting events found dispatching network-vif-unplugged-616dd3b1-68e6-47e9-b7ff-a4b63c3e702f {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:27:15 user nova-compute[72418]: DEBUG nova.compute.manager [req-dad26569-7682-4504-ba8e-a5181dafc680 req-3ba91b40-be76-4002-a1a2-28bb7d0882dc service nova] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Received event network-vif-unplugged-616dd3b1-68e6-47e9-b7ff-a4b63c3e702f for instance with task_state deleting. {{(pid=72418) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 18:27:15 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Instance destroyed successfully.
Aug 09 18:27:15 user nova-compute[72418]: DEBUG nova.objects.instance [None req-7021b7d6-bdbb-4963-879b-509aea68ecbf tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Lazy-loading 'resources' on Instance uuid bd87d56d-3aa5-43cf-ac55-fb3c41e092b1 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:27:15 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-7021b7d6-bdbb-4963-879b-509aea68ecbf tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:25:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-357261135',display_name='tempest-VolumesAdminNegativeTest-server-357261135',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-357261135',id=15,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:25:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5f09f1028304efd84f2e694efdae063',ramdisk_id='',reservation_id='r-aqa08l3v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-612744035',owner_user_name='tempest-VolumesAdminNegativeTest-612744035-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:25:23Z,user_data=None,user_id='3edbabbb69494929a4d671b4113f7753',uuid=bd87d56d-3aa5-43cf-ac55-fb3c41e092b1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "616dd3b1-68e6-47e9-b7ff-a4b63c3e702f", "address": "fa:16:3e:3a:5d:2f", "network": {"id": "57e1bdad-aad5-47b8-854b-68f3c1375325", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1415993909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f09f1028304efd84f2e694efdae063", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap616dd3b1-68", "ovs_interfaceid": "616dd3b1-68e6-47e9-b7ff-a4b63c3e702f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 18:27:15 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-7021b7d6-bdbb-4963-879b-509aea68ecbf tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Converting VIF {"id": "616dd3b1-68e6-47e9-b7ff-a4b63c3e702f", "address": "fa:16:3e:3a:5d:2f", "network": {"id": "57e1bdad-aad5-47b8-854b-68f3c1375325", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1415993909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f09f1028304efd84f2e694efdae063", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap616dd3b1-68", "ovs_interfaceid": "616dd3b1-68e6-47e9-b7ff-a4b63c3e702f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:27:15 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-7021b7d6-bdbb-4963-879b-509aea68ecbf tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:5d:2f,bridge_name='br-int',has_traffic_filtering=True,id=616dd3b1-68e6-47e9-b7ff-a4b63c3e702f,network=Network(57e1bdad-aad5-47b8-854b-68f3c1375325),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap616dd3b1-68') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:27:15 user nova-compute[72418]: DEBUG os_vif [None req-7021b7d6-bdbb-4963-879b-509aea68ecbf tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:5d:2f,bridge_name='br-int',has_traffic_filtering=True,id=616dd3b1-68e6-47e9-b7ff-a4b63c3e702f,network=Network(57e1bdad-aad5-47b8-854b-68f3c1375325),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap616dd3b1-68') {{(pid=72418) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 18:27:15 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:15 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap616dd3b1-68, bridge=br-int, if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:27:15 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:15 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:27:15 user nova-compute[72418]: INFO os_vif [None req-7021b7d6-bdbb-4963-879b-509aea68ecbf tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:5d:2f,bridge_name='br-int',has_traffic_filtering=True,id=616dd3b1-68e6-47e9-b7ff-a4b63c3e702f,network=Network(57e1bdad-aad5-47b8-854b-68f3c1375325),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap616dd3b1-68')
Aug 09 18:27:15 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-7021b7d6-bdbb-4963-879b-509aea68ecbf tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Deleting instance files /opt/stack/data/nova/instances/bd87d56d-3aa5-43cf-ac55-fb3c41e092b1_del
Aug 09 18:27:15 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-7021b7d6-bdbb-4963-879b-509aea68ecbf tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Deletion of /opt/stack/data/nova/instances/bd87d56d-3aa5-43cf-ac55-fb3c41e092b1_del complete
Aug 09 18:27:15 user nova-compute[72418]: INFO nova.compute.manager [None req-7021b7d6-bdbb-4963-879b-509aea68ecbf tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Took 0.74 seconds to destroy the instance on the hypervisor.
Aug 09 18:27:15 user nova-compute[72418]: DEBUG oslo.service.loopingcall [None req-7021b7d6-bdbb-4963-879b-509aea68ecbf tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72418) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 18:27:15 user nova-compute[72418]: DEBUG nova.compute.manager [-] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Deallocating network for instance {{(pid=72418) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 18:27:15 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] deallocate_for_instance() {{(pid=72418) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 18:27:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d09fbc7d-8ea2-437f-86ee-d5e6e5c60de1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Acquiring lock "e07beace-59d8-4c02-844b-1db1a6e81198" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:27:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d09fbc7d-8ea2-437f-86ee-d5e6e5c60de1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "e07beace-59d8-4c02-844b-1db1a6e81198" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:27:15 user nova-compute[72418]: DEBUG nova.objects.instance [None req-d09fbc7d-8ea2-437f-86ee-d5e6e5c60de1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lazy-loading 'flavor' on Instance uuid e07beace-59d8-4c02-844b-1db1a6e81198 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:27:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d09fbc7d-8ea2-437f-86ee-d5e6e5c60de1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "e07beace-59d8-4c02-844b-1db1a6e81198" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:27:16 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:16 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d09fbc7d-8ea2-437f-86ee-d5e6e5c60de1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Acquiring lock "e07beace-59d8-4c02-844b-1db1a6e81198" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:27:16 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d09fbc7d-8ea2-437f-86ee-d5e6e5c60de1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "e07beace-59d8-4c02-844b-1db1a6e81198" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:27:16 user nova-compute[72418]: INFO nova.compute.manager [None req-d09fbc7d-8ea2-437f-86ee-d5e6e5c60de1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Attaching volume 3fca4401-afce-4779-b7f0-3c2a0a64757f to /dev/vdb
Aug 09 18:27:16 user nova-compute[72418]: DEBUG os_brick.utils [None req-d09fbc7d-8ea2-437f-86ee-d5e6e5c60de1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:27:16 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:27:16 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:27:16 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15f5ba8-037c-4eb9-885d-c937e93e3875]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ad56b243ad71\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:27:16 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:27:16 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:27:16 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2b1133-f52f-44fa-822d-a12e44b1b314]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:27:16 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:27:16 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:27:16 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed75964-c05a-4739-b524-a8646d589caa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:27:16 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f4c52f-02a0-4154-8b2b-a50e16f04cad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:27:16 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-d09fbc7d-8ea2-437f-86ee-d5e6e5c60de1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Running cmd (subprocess): nvme version {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:27:16 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-d09fbc7d-8ea2-437f-86ee-d5e6e5c60de1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] 'nvme version' failed. Not Retrying. {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:27:16 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d09fbc7d-8ea2-437f-86ee-d5e6e5c60de1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] nvme not present on system {{(pid=72418) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 18:27:16 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:27:16 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:27:16 user nova-compute[72418]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 18:27:16 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68b340a-2a52-4424-b8f2-ee002a0cc3ef]: (4, '') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:27:16 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-d09fbc7d-8ea2-437f-86ee-d5e6e5c60de1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72418) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 18:27:16 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-d09fbc7d-8ea2-437f-86ee-d5e6e5c60de1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 18:27:16 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-d09fbc7d-8ea2-437f-86ee-d5e6e5c60de1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] LIGHTOS: no hostnqn found. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 18:27:16 user nova-compute[72418]: DEBUG os_brick.utils [None req-d09fbc7d-8ea2-437f-86ee-d5e6e5c60de1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ad56b243ad71', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:27:16 user nova-compute[72418]: DEBUG nova.virt.block_device [None req-d09fbc7d-8ea2-437f-86ee-d5e6e5c60de1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Updating existing volume attachment record: bb0bb93f-e8a7-445c-a16d-89f33f880875 {{(pid=72418) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 18:27:16 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:27:16 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Took 0.89 seconds to deallocate network for instance.
Aug 09 18:27:16 user nova-compute[72418]: DEBUG nova.compute.manager [req-e80999c2-89b0-47a7-8a67-bec401e1d21e req-83fe2788-aff2-442a-a2ad-5aa72799a5e8 service nova] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Received event network-vif-deleted-616dd3b1-68e6-47e9-b7ff-a4b63c3e702f {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:27:16 user nova-compute[72418]: INFO nova.compute.manager [req-e80999c2-89b0-47a7-8a67-bec401e1d21e req-83fe2788-aff2-442a-a2ad-5aa72799a5e8 service nova] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Neutron deleted interface 616dd3b1-68e6-47e9-b7ff-a4b63c3e702f; detaching it from the instance and deleting it from the info cache
Aug 09 18:27:16 user nova-compute[72418]: DEBUG nova.network.neutron [req-e80999c2-89b0-47a7-8a67-bec401e1d21e req-83fe2788-aff2-442a-a2ad-5aa72799a5e8 service nova] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:27:16 user nova-compute[72418]: DEBUG nova.compute.manager [req-e80999c2-89b0-47a7-8a67-bec401e1d21e req-83fe2788-aff2-442a-a2ad-5aa72799a5e8 service nova] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Detach interface failed, port_id=616dd3b1-68e6-47e9-b7ff-a4b63c3e702f, reason: Instance bd87d56d-3aa5-43cf-ac55-fb3c41e092b1 could not be found. {{(pid=72418) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 18:27:16 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-7021b7d6-bdbb-4963-879b-509aea68ecbf tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:27:16 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-7021b7d6-bdbb-4963-879b-509aea68ecbf tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:27:16 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-7021b7d6-bdbb-4963-879b-509aea68ecbf tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:27:16 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-7021b7d6-bdbb-4963-879b-509aea68ecbf tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:27:17 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-7021b7d6-bdbb-4963-879b-509aea68ecbf tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.424s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:27:17 user nova-compute[72418]: INFO nova.scheduler.client.report [None req-7021b7d6-bdbb-4963-879b-509aea68ecbf tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Deleted allocations for instance bd87d56d-3aa5-43cf-ac55-fb3c41e092b1
Aug 09 18:27:17 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-7021b7d6-bdbb-4963-879b-509aea68ecbf tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Lock "bd87d56d-3aa5-43cf-ac55-fb3c41e092b1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.269s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:27:17 user nova-compute[72418]: DEBUG nova.compute.manager [req-f894c1f9-6159-4810-9ab0-e7a8335656a2 req-549887c3-910a-4859-8edb-fb331a5dbb22 service nova] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Received event network-vif-plugged-616dd3b1-68e6-47e9-b7ff-a4b63c3e702f {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:27:17 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-f894c1f9-6159-4810-9ab0-e7a8335656a2 req-549887c3-910a-4859-8edb-fb331a5dbb22 service nova] Acquiring lock "bd87d56d-3aa5-43cf-ac55-fb3c41e092b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:27:17 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-f894c1f9-6159-4810-9ab0-e7a8335656a2 req-549887c3-910a-4859-8edb-fb331a5dbb22 service nova] Lock "bd87d56d-3aa5-43cf-ac55-fb3c41e092b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:27:17 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-f894c1f9-6159-4810-9ab0-e7a8335656a2 req-549887c3-910a-4859-8edb-fb331a5dbb22 service nova] Lock "bd87d56d-3aa5-43cf-ac55-fb3c41e092b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:27:17 user nova-compute[72418]: DEBUG nova.compute.manager [req-f894c1f9-6159-4810-9ab0-e7a8335656a2 req-549887c3-910a-4859-8edb-fb331a5dbb22 service nova] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] No waiting events found dispatching network-vif-plugged-616dd3b1-68e6-47e9-b7ff-a4b63c3e702f {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:27:17 user nova-compute[72418]: WARNING nova.compute.manager [req-f894c1f9-6159-4810-9ab0-e7a8335656a2 req-549887c3-910a-4859-8edb-fb331a5dbb22 service nova] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Received unexpected event network-vif-plugged-616dd3b1-68e6-47e9-b7ff-a4b63c3e702f for instance with vm_state deleted and task_state None.
Aug 09 18:27:17 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:18 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:20 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:20 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:22 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:23 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:25 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d09fbc7d-8ea2-437f-86ee-d5e6e5c60de1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Calling os-brick to attach iSCSI Volume {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 18:27:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09fbc7d-8ea2-437f-86ee-d5e6e5c60de1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'idOFSGrK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:27:25 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-d09fbc7d-8ea2-437f-86ee-d5e6e5c60de1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:27:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-d09fbc7d-8ea2-437f-86ee-d5e6e5c60de1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:27:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-d09fbc7d-8ea2-437f-86ee-d5e6e5c60de1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:27:25 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-d09fbc7d-8ea2-437f-86ee-d5e6e5c60de1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:27:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-d09fbc7d-8ea2-437f-86ee-d5e6e5c60de1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:27:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-d09fbc7d-8ea2-437f-86ee-d5e6e5c60de1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:27:25 user nova-compute[72418]: INFO os_brick.initiator.connectors.iscsi [None req-d09fbc7d-8ea2-437f-86ee-d5e6e5c60de1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 18:27:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f -p 172.16.0.220:3260 {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:27:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:27:25 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9e4908-5e57-4fbc-ae13-2fedd17550bb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:27:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09fbc7d-8ea2-437f-86ee-d5e6e5c60de1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 18:27:25 user nova-compute[72418]:  {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:27:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f -p 172.16.0.220:3260 --interface default --op new {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:27:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:27:25 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a938aad-21ea-44bb-ab70-2f734cb34d8e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f] added\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:27:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09fbc7d-8ea2-437f-86ee-d5e6e5c60de1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f] added
Aug 09 18:27:25 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:27:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:27:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:27:25 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a211c9-8e74-4962-bc6b-0ae1ad5c166c]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:27:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09fbc7d-8ea2-437f-86ee-d5e6e5c60de1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:27:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:27:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:27:25 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ffc31e-cbe9-4d1f-acdc-d8ad5ecde3bd]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:27:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09fbc7d-8ea2-437f-86ee-d5e6e5c60de1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:27:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v idOFSGrK {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:27:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v idOFSGrK" returned: 0 in 0.023s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:27:25 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[e702ba8f-3533-4366-b052-2fb602b5af5b]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:27:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09fbc7d-8ea2-437f-86ee-d5e6e5c60de1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'idOFSGrK'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:27:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:27:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:27:25 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6968ac2-c0fc-4c0a-aad8-78a755487bfa]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:27:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09fbc7d-8ea2-437f-86ee-d5e6e5c60de1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:27:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:27:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:27:25 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fde7ac1-cff2-474c-8dbb-86dc0afe665e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:27:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09fbc7d-8ea2-437f-86ee-d5e6e5c60de1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:27:25 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:27:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09fbc7d-8ea2-437f-86ee-d5e6e5c60de1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:27:25 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:27:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f -p 172.16.0.220:3260 --login {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:27:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:27:25 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[306688b6-69d9-4019-9cb9-43dd009d04b3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:27:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09fbc7d-8ea2-437f-86ee-d5e6e5c60de1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f, portal: 172.16.0.220,3260]
Aug 09 18:27:25 user nova-compute[72418]: Login to [iface: default, target: iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f, portal: 172.16.0.220,3260] successful.
Aug 09 18:27:25 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:27:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:27:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:27:25 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f9660f-4fad-418d-a857-e65ea8230588]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:27:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09fbc7d-8ea2-437f-86ee-d5e6e5c60de1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:27:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:27:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:27:25 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f35d2d-3d2c-4de5-b080-77cda8f4b04b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:27:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09fbc7d-8ea2-437f-86ee-d5e6e5c60de1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:27:25 user nova-compute[72418]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f (non-flash)
Aug 09 18:27:25 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:27:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09fbc7d-8ea2-437f-86ee-d5e6e5c60de1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:27:25 user nova-compute[72418]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f (non-flash)
Aug 09 18:27:25 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:27:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-d09fbc7d-8ea2-437f-86ee-d5e6e5c60de1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:27:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09fbc7d-8ea2-437f-86ee-d5e6e5c60de1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Connected to 172.16.0.220:3260 {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 18:27:25 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-d09fbc7d-8ea2-437f-86ee-d5e6e5c60de1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=72418) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 18:27:25 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-d09fbc7d-8ea2-437f-86ee-d5e6e5c60de1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72418) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 18:27:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:27:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.029s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:27:25 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4cb57fc-36d8-4316-bcf7-d2bd970238d9]: (4, ('- - 0', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:27:25 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-d09fbc7d-8ea2-437f-86ee-d5e6e5c60de1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72418) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 18:27:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09fbc7d-8ea2-437f-86ee-d5e6e5c60de1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'idOFSGrK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 18:27:26 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-d09fbc7d-8ea2-437f-86ee-d5e6e5c60de1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:27:26 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-d09fbc7d-8ea2-437f-86ee-d5e6e5c60de1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '26536343362656339', 'path': '/dev/sdc'} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:27:26 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d09fbc7d-8ea2-437f-86ee-d5e6e5c60de1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536343362656339', 'path': '/dev/sdc'} {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 18:27:26 user nova-compute[72418]: DEBUG nova.objects.instance [None req-d09fbc7d-8ea2-437f-86ee-d5e6e5c60de1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lazy-loading 'flavor' on Instance uuid e07beace-59d8-4c02-844b-1db1a6e81198 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:27:26 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-d09fbc7d-8ea2-437f-86ee-d5e6e5c60de1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 18:27:26 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:27:26 user nova-compute[72418]:   <source dev="/dev/sdc"/>
Aug 09 18:27:26 user nova-compute[72418]:   <target dev="vdb" bus="virtio"/>
Aug 09 18:27:26 user nova-compute[72418]:   <serial>3fca4401-afce-4779-b7f0-3c2a0a64757f</serial>
Aug 09 18:27:26 user nova-compute[72418]: </disk>
Aug 09 18:27:26 user nova-compute[72418]:  {{(pid=72418) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 18:27:27 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-d09fbc7d-8ea2-437f-86ee-d5e6e5c60de1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:27:27 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-d09fbc7d-8ea2-437f-86ee-d5e6e5c60de1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:27:27 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-d09fbc7d-8ea2-437f-86ee-d5e6e5c60de1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] No VIF found with MAC fa:16:3e:a6:38:d9, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:27:27 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:27 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d09fbc7d-8ea2-437f-86ee-d5e6e5c60de1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "e07beace-59d8-4c02-844b-1db1a6e81198" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.478s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:27:28 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ddeaae25-043d-4131-b247-9dc970d1ca03 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Acquiring lock "e07beace-59d8-4c02-844b-1db1a6e81198" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:27:28 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ddeaae25-043d-4131-b247-9dc970d1ca03 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "e07beace-59d8-4c02-844b-1db1a6e81198" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:27:28 user nova-compute[72418]: DEBUG nova.compute.manager [None req-ddeaae25-043d-4131-b247-9dc970d1ca03 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:27:28 user nova-compute[72418]: DEBUG nova.compute.manager [None req-ddeaae25-043d-4131-b247-9dc970d1ca03 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72418) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 09 18:27:28 user nova-compute[72418]: DEBUG nova.objects.instance [None req-ddeaae25-043d-4131-b247-9dc970d1ca03 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lazy-loading 'flavor' on Instance uuid e07beace-59d8-4c02-844b-1db1a6e81198 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:27:28 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:28 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:28 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:28 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:28 user nova-compute[72418]: DEBUG nova.compute.manager [req-7dfee887-accf-45ef-bcc3-5e348ea27cd7 req-abe999bc-237a-46dd-a500-44512781cd90 service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Received event network-vif-unplugged-301d9f8c-022d-4c02-90dd-374ead3daa23 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:27:28 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-7dfee887-accf-45ef-bcc3-5e348ea27cd7 req-abe999bc-237a-46dd-a500-44512781cd90 service nova] Acquiring lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:27:28 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-7dfee887-accf-45ef-bcc3-5e348ea27cd7 req-abe999bc-237a-46dd-a500-44512781cd90 service nova] Lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:27:28 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-7dfee887-accf-45ef-bcc3-5e348ea27cd7 req-abe999bc-237a-46dd-a500-44512781cd90 service nova] Lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:27:28 user nova-compute[72418]: DEBUG nova.compute.manager [req-7dfee887-accf-45ef-bcc3-5e348ea27cd7 req-abe999bc-237a-46dd-a500-44512781cd90 service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] No waiting events found dispatching network-vif-unplugged-301d9f8c-022d-4c02-90dd-374ead3daa23 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:27:28 user nova-compute[72418]: WARNING nova.compute.manager [req-7dfee887-accf-45ef-bcc3-5e348ea27cd7 req-abe999bc-237a-46dd-a500-44512781cd90 service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Received unexpected event network-vif-unplugged-301d9f8c-022d-4c02-90dd-374ead3daa23 for instance with vm_state active and task_state powering-off.
Aug 09 18:27:29 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Instance destroyed successfully.
Aug 09 18:27:29 user nova-compute[72418]: DEBUG nova.compute.manager [None req-ddeaae25-043d-4131-b247-9dc970d1ca03 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:27:29 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ddeaae25-043d-4131-b247-9dc970d1ca03 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "e07beace-59d8-4c02-844b-1db1a6e81198" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.037s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:27:30 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:30 user nova-compute[72418]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691605635.523357, bd87d56d-3aa5-43cf-ac55-fb3c41e092b1 => Stopped> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:27:30 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] VM Stopped (Lifecycle Event)
Aug 09 18:27:30 user nova-compute[72418]: DEBUG nova.compute.manager [None req-1f244b9e-ed9b-42cf-b1a9-36e5983cc4a1 None None] [instance: bd87d56d-3aa5-43cf-ac55-fb3c41e092b1] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:27:30 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:30 user nova-compute[72418]: DEBUG nova.compute.manager [req-da29e7c8-c45e-4fe3-bbaa-9a3fc510b75c req-557c1499-b45c-48d9-b6ff-7d0d6f7959ce service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Received event network-vif-plugged-301d9f8c-022d-4c02-90dd-374ead3daa23 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:27:30 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-da29e7c8-c45e-4fe3-bbaa-9a3fc510b75c req-557c1499-b45c-48d9-b6ff-7d0d6f7959ce service nova] Acquiring lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:27:30 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-da29e7c8-c45e-4fe3-bbaa-9a3fc510b75c req-557c1499-b45c-48d9-b6ff-7d0d6f7959ce service nova] Lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:27:30 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-da29e7c8-c45e-4fe3-bbaa-9a3fc510b75c req-557c1499-b45c-48d9-b6ff-7d0d6f7959ce service nova] Lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:27:30 user nova-compute[72418]: DEBUG nova.compute.manager [req-da29e7c8-c45e-4fe3-bbaa-9a3fc510b75c req-557c1499-b45c-48d9-b6ff-7d0d6f7959ce service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] No waiting events found dispatching network-vif-plugged-301d9f8c-022d-4c02-90dd-374ead3daa23 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:27:30 user nova-compute[72418]: WARNING nova.compute.manager [req-da29e7c8-c45e-4fe3-bbaa-9a3fc510b75c req-557c1499-b45c-48d9-b6ff-7d0d6f7959ce service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Received unexpected event network-vif-plugged-301d9f8c-022d-4c02-90dd-374ead3daa23 for instance with vm_state stopped and task_state None.
Aug 09 18:27:32 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:34 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:35 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Acquiring lock "688f50af-0e41-4467-b2db-04ac22f62963" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:27:35 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Lock "688f50af-0e41-4467-b2db-04ac22f62963" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:27:35 user nova-compute[72418]: DEBUG nova.compute.manager [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Starting instance... {{(pid=72418) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 18:27:35 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:27:35 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:27:35 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72418) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 18:27:35 user nova-compute[72418]: INFO nova.compute.claims [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Claim successful on node user
Aug 09 18:27:35 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:35 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:27:35 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:27:35 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.511s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:27:35 user nova-compute[72418]: DEBUG nova.compute.manager [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Start building networks asynchronously for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 18:27:35 user nova-compute[72418]: DEBUG nova.compute.manager [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Allocating IP information in the background. {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 18:27:35 user nova-compute[72418]: DEBUG nova.network.neutron [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] allocate_for_instance() {{(pid=72418) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 18:27:35 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 18:27:35 user nova-compute[72418]: DEBUG nova.compute.manager [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Start building block device mappings for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 18:27:35 user nova-compute[72418]: DEBUG nova.policy [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'df6cd3ad06524ae59968b133efceaa4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86896e6544164fda93f7bea95a751707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72418) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 18:27:36 user nova-compute[72418]: DEBUG nova.compute.manager [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Start spawning the instance on the hypervisor. {{(pid=72418) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 18:27:36 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Creating instance directory {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 18:27:36 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Creating image(s)
Aug 09 18:27:36 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Acquiring lock "/opt/stack/data/nova/instances/688f50af-0e41-4467-b2db-04ac22f62963/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:27:36 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Lock "/opt/stack/data/nova/instances/688f50af-0e41-4467-b2db-04ac22f62963/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:27:36 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Lock "/opt/stack/data/nova/instances/688f50af-0e41-4467-b2db-04ac22f62963/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:27:36 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:27:36 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.141s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:27:36 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Acquiring lock "458773cfa7230b717e41c60277832e9f83806d71" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:27:36 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:27:36 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:27:36 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.135s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:27:36 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/688f50af-0e41-4467-b2db-04ac22f62963/disk 1073741824 {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:27:36 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/688f50af-0e41-4467-b2db-04ac22f62963/disk 1073741824" returned: 0 in 0.050s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:27:36 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:27:36 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:27:36 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.133s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:27:36 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Checking if we can resize image /opt/stack/data/nova/instances/688f50af-0e41-4467-b2db-04ac22f62963/disk. size=1073741824 {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 18:27:36 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/688f50af-0e41-4467-b2db-04ac22f62963/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:27:36 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/688f50af-0e41-4467-b2db-04ac22f62963/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:27:36 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Cannot resize image /opt/stack/data/nova/instances/688f50af-0e41-4467-b2db-04ac22f62963/disk to a smaller size. {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 18:27:36 user nova-compute[72418]: DEBUG nova.objects.instance [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Lazy-loading 'migration_context' on Instance uuid 688f50af-0e41-4467-b2db-04ac22f62963 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:27:36 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Created local disks {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 18:27:36 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Ensure instance console log exists: /opt/stack/data/nova/instances/688f50af-0e41-4467-b2db-04ac22f62963/console.log {{(pid=72418) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 18:27:36 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:27:36 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:27:36 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:27:36 user nova-compute[72418]: DEBUG nova.network.neutron [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Successfully created port: b2c3fa50-5615-4a58-8820-54c67c5d65bc {{(pid=72418) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 18:27:37 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:37 user nova-compute[72418]: DEBUG nova.network.neutron [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Successfully updated port: b2c3fa50-5615-4a58-8820-54c67c5d65bc {{(pid=72418) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 18:27:37 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Acquiring lock "refresh_cache-688f50af-0e41-4467-b2db-04ac22f62963" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:27:37 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Acquired lock "refresh_cache-688f50af-0e41-4467-b2db-04ac22f62963" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:27:37 user nova-compute[72418]: DEBUG nova.network.neutron [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:27:37 user nova-compute[72418]: DEBUG nova.compute.manager [req-4f5388f6-21d9-411c-9fe8-f45d5d9e83c9 req-22855e79-56bd-46fa-a050-57e706cb7074 service nova] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Received event network-changed-b2c3fa50-5615-4a58-8820-54c67c5d65bc {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:27:37 user nova-compute[72418]: DEBUG nova.compute.manager [req-4f5388f6-21d9-411c-9fe8-f45d5d9e83c9 req-22855e79-56bd-46fa-a050-57e706cb7074 service nova] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Refreshing instance network info cache due to event network-changed-b2c3fa50-5615-4a58-8820-54c67c5d65bc. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:27:37 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-4f5388f6-21d9-411c-9fe8-f45d5d9e83c9 req-22855e79-56bd-46fa-a050-57e706cb7074 service nova] Acquiring lock "refresh_cache-688f50af-0e41-4467-b2db-04ac22f62963" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:27:37 user nova-compute[72418]: DEBUG nova.network.neutron [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Instance cache missing network info. {{(pid=72418) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 18:27:38 user nova-compute[72418]: DEBUG nova.network.neutron [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Updating instance_info_cache with network_info: [{"id": "b2c3fa50-5615-4a58-8820-54c67c5d65bc", "address": "fa:16:3e:0a:9c:69", "network": {"id": "e24f7df5-d3a9-477d-997c-c145a2613ec8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1802267495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86896e6544164fda93f7bea95a751707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c3fa50-56", "ovs_interfaceid": "b2c3fa50-5615-4a58-8820-54c67c5d65bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:27:38 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Releasing lock "refresh_cache-688f50af-0e41-4467-b2db-04ac22f62963" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:27:38 user nova-compute[72418]: DEBUG nova.compute.manager [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Instance network_info: |[{"id": "b2c3fa50-5615-4a58-8820-54c67c5d65bc", "address": "fa:16:3e:0a:9c:69", "network": {"id": "e24f7df5-d3a9-477d-997c-c145a2613ec8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1802267495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86896e6544164fda93f7bea95a751707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c3fa50-56", "ovs_interfaceid": "b2c3fa50-5615-4a58-8820-54c67c5d65bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 18:27:38 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-4f5388f6-21d9-411c-9fe8-f45d5d9e83c9 req-22855e79-56bd-46fa-a050-57e706cb7074 service nova] Acquired lock "refresh_cache-688f50af-0e41-4467-b2db-04ac22f62963" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:27:38 user nova-compute[72418]: DEBUG nova.network.neutron [req-4f5388f6-21d9-411c-9fe8-f45d5d9e83c9 req-22855e79-56bd-46fa-a050-57e706cb7074 service nova] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Refreshing network info cache for port b2c3fa50-5615-4a58-8820-54c67c5d65bc {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:27:38 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Start _get_guest_xml network_info=[{"id": "b2c3fa50-5615-4a58-8820-54c67c5d65bc", "address": "fa:16:3e:0a:9c:69", "network": {"id": "e24f7df5-d3a9-477d-997c-c145a2613ec8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1802267495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86896e6544164fda93f7bea95a751707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c3fa50-56", "ovs_interfaceid": "b2c3fa50-5615-4a58-8820-54c67c5d65bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 18:27:38 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:27:38 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:27:38 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 18:27:38 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] CPU controller missing on host. {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 18:27:38 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 18:27:38 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] CPU controller found on host. {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 18:27:38 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72418) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 18:27:38 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T18:17:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 18:27:38 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Flavor limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 18:27:38 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Image limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 18:27:38 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Flavor pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 18:27:38 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Image pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 18:27:38 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 18:27:38 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 18:27:38 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 18:27:38 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Got 1 possible topologies {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 18:27:38 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 18:27:38 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 18:27:38 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T18:27:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-630623237',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-630623237',id=20,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJchtztQL/UH2D7W5ks5SFjnLeiOZKRpefilUR0gjk7AuwJAWWS/gJOgdgu+Tp4jMu5wIaL/uSL50sh+6WeG1BBlMsFAUgEPx6/v6KmgLX0CBGzXIbAnMWDK0rX8sqetTQ==',key_name='tempest-keypair-267340570',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86896e6544164fda93f7bea95a751707',ramdisk_id='',reservation_id='r-fo0cn966',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1428601923',owner_user_name='tempest-TaggedAttachmentsTest-1428601923-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:27:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df6cd3ad06524ae59968b133efceaa4c',uuid=688f50af-0e41-4467-b2db-04ac22f62963,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2c3fa50-5615-4a58-8820-54c67c5d65bc", "address": "fa:16:3e:0a:9c:69", "network": {"id": "e24f7df5-d3a9-477d-997c-c145a2613ec8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1802267495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86896e6544164fda93f7bea95a751707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c3fa50-56", "ovs_interfaceid": "b2c3fa50-5615-4a58-8820-54c67c5d65bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:27:38 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Converting VIF {"id": "b2c3fa50-5615-4a58-8820-54c67c5d65bc", "address": "fa:16:3e:0a:9c:69", "network": {"id": "e24f7df5-d3a9-477d-997c-c145a2613ec8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1802267495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86896e6544164fda93f7bea95a751707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c3fa50-56", "ovs_interfaceid": "b2c3fa50-5615-4a58-8820-54c67c5d65bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:27:38 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:9c:69,bridge_name='br-int',has_traffic_filtering=True,id=b2c3fa50-5615-4a58-8820-54c67c5d65bc,network=Network(e24f7df5-d3a9-477d-997c-c145a2613ec8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2c3fa50-56') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:27:38 user nova-compute[72418]: DEBUG nova.objects.instance [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Lazy-loading 'pci_devices' on Instance uuid 688f50af-0e41-4467-b2db-04ac22f62963 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:27:38 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] End _get_guest_xml xml=<domain type="kvm">
Aug 09 18:27:38 user nova-compute[72418]:   <uuid>688f50af-0e41-4467-b2db-04ac22f62963</uuid>
Aug 09 18:27:38 user nova-compute[72418]:   <name>instance-00000014</name>
Aug 09 18:27:38 user nova-compute[72418]:   <memory>524288</memory>
Aug 09 18:27:38 user nova-compute[72418]:   <vcpu>1</vcpu>
Aug 09 18:27:38 user nova-compute[72418]:   <metadata>
Aug 09 18:27:38 user nova-compute[72418]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:27:38 user nova-compute[72418]:       <nova:package version="0.0.0"/>
Aug 09 18:27:38 user nova-compute[72418]:       <nova:name>tempest-device-tagging-server-630623237</nova:name>
Aug 09 18:27:38 user nova-compute[72418]:       <nova:creationTime>2023-08-09 18:27:38</nova:creationTime>
Aug 09 18:27:38 user nova-compute[72418]:       <nova:flavor name="m1.tiny">
Aug 09 18:27:38 user nova-compute[72418]:         <nova:memory>512</nova:memory>
Aug 09 18:27:38 user nova-compute[72418]:         <nova:disk>1</nova:disk>
Aug 09 18:27:38 user nova-compute[72418]:         <nova:swap>0</nova:swap>
Aug 09 18:27:38 user nova-compute[72418]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:27:38 user nova-compute[72418]:         <nova:vcpus>1</nova:vcpus>
Aug 09 18:27:38 user nova-compute[72418]:       </nova:flavor>
Aug 09 18:27:38 user nova-compute[72418]:       <nova:owner>
Aug 09 18:27:38 user nova-compute[72418]:         <nova:user uuid="df6cd3ad06524ae59968b133efceaa4c">tempest-TaggedAttachmentsTest-1428601923-project-member</nova:user>
Aug 09 18:27:38 user nova-compute[72418]:         <nova:project uuid="86896e6544164fda93f7bea95a751707">tempest-TaggedAttachmentsTest-1428601923</nova:project>
Aug 09 18:27:38 user nova-compute[72418]:       </nova:owner>
Aug 09 18:27:38 user nova-compute[72418]:       <nova:root type="image" uuid="8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e"/>
Aug 09 18:27:38 user nova-compute[72418]:       <nova:ports>
Aug 09 18:27:38 user nova-compute[72418]:         <nova:port uuid="b2c3fa50-5615-4a58-8820-54c67c5d65bc">
Aug 09 18:27:38 user nova-compute[72418]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 09 18:27:38 user nova-compute[72418]:         </nova:port>
Aug 09 18:27:38 user nova-compute[72418]:       </nova:ports>
Aug 09 18:27:38 user nova-compute[72418]:     </nova:instance>
Aug 09 18:27:38 user nova-compute[72418]:   </metadata>
Aug 09 18:27:38 user nova-compute[72418]:   <sysinfo type="smbios">
Aug 09 18:27:38 user nova-compute[72418]:     <system>
Aug 09 18:27:38 user nova-compute[72418]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 18:27:38 user nova-compute[72418]:       <entry name="product">OpenStack Nova</entry>
Aug 09 18:27:38 user nova-compute[72418]:       <entry name="version">0.0.0</entry>
Aug 09 18:27:38 user nova-compute[72418]:       <entry name="serial">688f50af-0e41-4467-b2db-04ac22f62963</entry>
Aug 09 18:27:38 user nova-compute[72418]:       <entry name="uuid">688f50af-0e41-4467-b2db-04ac22f62963</entry>
Aug 09 18:27:38 user nova-compute[72418]:       <entry name="family">Virtual Machine</entry>
Aug 09 18:27:38 user nova-compute[72418]:     </system>
Aug 09 18:27:38 user nova-compute[72418]:   </sysinfo>
Aug 09 18:27:38 user nova-compute[72418]:   <os>
Aug 09 18:27:38 user nova-compute[72418]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 18:27:38 user nova-compute[72418]:     <boot dev="hd"/>
Aug 09 18:27:38 user nova-compute[72418]:     <smbios mode="sysinfo"/>
Aug 09 18:27:38 user nova-compute[72418]:   </os>
Aug 09 18:27:38 user nova-compute[72418]:   <features>
Aug 09 18:27:38 user nova-compute[72418]:     <acpi/>
Aug 09 18:27:38 user nova-compute[72418]:     <apic/>
Aug 09 18:27:38 user nova-compute[72418]:     <vmcoreinfo/>
Aug 09 18:27:38 user nova-compute[72418]:   </features>
Aug 09 18:27:38 user nova-compute[72418]:   <clock offset="utc">
Aug 09 18:27:38 user nova-compute[72418]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 18:27:38 user nova-compute[72418]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 18:27:38 user nova-compute[72418]:     <timer name="hpet" present="no"/>
Aug 09 18:27:38 user nova-compute[72418]:   </clock>
Aug 09 18:27:38 user nova-compute[72418]:   <cpu mode="custom" match="exact">
Aug 09 18:27:38 user nova-compute[72418]:     <model>Nehalem</model>
Aug 09 18:27:38 user nova-compute[72418]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 18:27:38 user nova-compute[72418]:   </cpu>
Aug 09 18:27:38 user nova-compute[72418]:   <devices>
Aug 09 18:27:38 user nova-compute[72418]:     <disk type="file" device="disk">
Aug 09 18:27:38 user nova-compute[72418]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 18:27:38 user nova-compute[72418]:       <source file="/opt/stack/data/nova/instances/688f50af-0e41-4467-b2db-04ac22f62963/disk"/>
Aug 09 18:27:38 user nova-compute[72418]:       <target dev="vda" bus="virtio"/>
Aug 09 18:27:38 user nova-compute[72418]:     </disk>
Aug 09 18:27:38 user nova-compute[72418]:     <disk type="file" device="cdrom">
Aug 09 18:27:38 user nova-compute[72418]:       <driver name="qemu" type="raw" cache="none"/>
Aug 09 18:27:38 user nova-compute[72418]:       <source file="/opt/stack/data/nova/instances/688f50af-0e41-4467-b2db-04ac22f62963/disk.config"/>
Aug 09 18:27:38 user nova-compute[72418]:       <target dev="hda" bus="ide"/>
Aug 09 18:27:38 user nova-compute[72418]:     </disk>
Aug 09 18:27:38 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:27:38 user nova-compute[72418]:       <mac address="fa:16:3e:0a:9c:69"/>
Aug 09 18:27:38 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:27:38 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:27:38 user nova-compute[72418]:       <target dev="tapb2c3fa50-56"/>
Aug 09 18:27:38 user nova-compute[72418]:     </interface>
Aug 09 18:27:38 user nova-compute[72418]:     <serial type="pty">
Aug 09 18:27:38 user nova-compute[72418]:       <log file="/opt/stack/data/nova/instances/688f50af-0e41-4467-b2db-04ac22f62963/console.log" append="off"/>
Aug 09 18:27:38 user nova-compute[72418]:     </serial>
Aug 09 18:27:38 user nova-compute[72418]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 18:27:38 user nova-compute[72418]:     <video>
Aug 09 18:27:38 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:27:38 user nova-compute[72418]:     </video>
Aug 09 18:27:38 user nova-compute[72418]:     <rng model="virtio">
Aug 09 18:27:38 user nova-compute[72418]:       <backend model="random">/dev/urandom</backend>
Aug 09 18:27:38 user nova-compute[72418]:     </rng>
Aug 09 18:27:38 user nova-compute[72418]:     <controller type="usb" index="0" model="none"/>
Aug 09 18:27:38 user nova-compute[72418]:     <memballoon model="virtio">
Aug 09 18:27:38 user nova-compute[72418]:       <stats period="10"/>
Aug 09 18:27:38 user nova-compute[72418]:     </memballoon>
Aug 09 18:27:38 user nova-compute[72418]:   </devices>
Aug 09 18:27:38 user nova-compute[72418]: </domain>
Aug 09 18:27:38 user nova-compute[72418]:  {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 18:27:38 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T18:27:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-630623237',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-630623237',id=20,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJchtztQL/UH2D7W5ks5SFjnLeiOZKRpefilUR0gjk7AuwJAWWS/gJOgdgu+Tp4jMu5wIaL/uSL50sh+6WeG1BBlMsFAUgEPx6/v6KmgLX0CBGzXIbAnMWDK0rX8sqetTQ==',key_name='tempest-keypair-267340570',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86896e6544164fda93f7bea95a751707',ramdisk_id='',reservation_id='r-fo0cn966',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1428601923',owner_user_name='tempest-TaggedAttachmentsTest-1428601923-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:27:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df6cd3ad06524ae59968b133efceaa4c',uuid=688f50af-0e41-4467-b2db-04ac22f62963,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2c3fa50-5615-4a58-8820-54c67c5d65bc", "address": "fa:16:3e:0a:9c:69", "network": {"id": "e24f7df5-d3a9-477d-997c-c145a2613ec8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1802267495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86896e6544164fda93f7bea95a751707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c3fa50-56", "ovs_interfaceid": "b2c3fa50-5615-4a58-8820-54c67c5d65bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:27:38 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Converting VIF {"id": "b2c3fa50-5615-4a58-8820-54c67c5d65bc", "address": "fa:16:3e:0a:9c:69", "network": {"id": "e24f7df5-d3a9-477d-997c-c145a2613ec8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1802267495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86896e6544164fda93f7bea95a751707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c3fa50-56", "ovs_interfaceid": "b2c3fa50-5615-4a58-8820-54c67c5d65bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:27:38 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:9c:69,bridge_name='br-int',has_traffic_filtering=True,id=b2c3fa50-5615-4a58-8820-54c67c5d65bc,network=Network(e24f7df5-d3a9-477d-997c-c145a2613ec8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2c3fa50-56') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:27:38 user nova-compute[72418]: DEBUG os_vif [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:9c:69,bridge_name='br-int',has_traffic_filtering=True,id=b2c3fa50-5615-4a58-8820-54c67c5d65bc,network=Network(e24f7df5-d3a9-477d-997c-c145a2613ec8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2c3fa50-56') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:27:38 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:38 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:27:38 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:27:38 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:38 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb2c3fa50-56, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:27:38 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb2c3fa50-56, col_values=(('external_ids', {'iface-id': 'b2c3fa50-5615-4a58-8820-54c67c5d65bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:9c:69', 'vm-uuid': '688f50af-0e41-4467-b2db-04ac22f62963'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:27:38 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:38 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:27:38 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:38 user nova-compute[72418]: INFO os_vif [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:9c:69,bridge_name='br-int',has_traffic_filtering=True,id=b2c3fa50-5615-4a58-8820-54c67c5d65bc,network=Network(e24f7df5-d3a9-477d-997c-c145a2613ec8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2c3fa50-56')
Aug 09 18:27:38 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:27:38 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] No BDM found with device name hda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:27:38 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] No VIF found with MAC fa:16:3e:0a:9c:69, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:27:38 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Using config drive
Aug 09 18:27:38 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Creating config drive at /opt/stack/data/nova/instances/688f50af-0e41-4467-b2db-04ac22f62963/disk.config
Aug 09 18:27:38 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/688f50af-0e41-4467-b2db-04ac22f62963/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp93osmn5c {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:27:38 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/688f50af-0e41-4467-b2db-04ac22f62963/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp93osmn5c" returned: 0 in 0.069s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:27:38 user nova-compute[72418]: DEBUG nova.network.neutron [req-4f5388f6-21d9-411c-9fe8-f45d5d9e83c9 req-22855e79-56bd-46fa-a050-57e706cb7074 service nova] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Updated VIF entry in instance network info cache for port b2c3fa50-5615-4a58-8820-54c67c5d65bc. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:27:38 user nova-compute[72418]: DEBUG nova.network.neutron [req-4f5388f6-21d9-411c-9fe8-f45d5d9e83c9 req-22855e79-56bd-46fa-a050-57e706cb7074 service nova] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Updating instance_info_cache with network_info: [{"id": "b2c3fa50-5615-4a58-8820-54c67c5d65bc", "address": "fa:16:3e:0a:9c:69", "network": {"id": "e24f7df5-d3a9-477d-997c-c145a2613ec8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1802267495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86896e6544164fda93f7bea95a751707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c3fa50-56", "ovs_interfaceid": "b2c3fa50-5615-4a58-8820-54c67c5d65bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:27:38 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-4f5388f6-21d9-411c-9fe8-f45d5d9e83c9 req-22855e79-56bd-46fa-a050-57e706cb7074 service nova] Releasing lock "refresh_cache-688f50af-0e41-4467-b2db-04ac22f62963" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:27:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:40 user nova-compute[72418]: DEBUG nova.compute.manager [req-882b6713-21d4-4040-a256-8cfdb962dbef req-a2f45a1e-600a-40e7-8224-da3d9ae15273 service nova] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Received event network-vif-plugged-b2c3fa50-5615-4a58-8820-54c67c5d65bc {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:27:40 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-882b6713-21d4-4040-a256-8cfdb962dbef req-a2f45a1e-600a-40e7-8224-da3d9ae15273 service nova] Acquiring lock "688f50af-0e41-4467-b2db-04ac22f62963-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:27:40 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-882b6713-21d4-4040-a256-8cfdb962dbef req-a2f45a1e-600a-40e7-8224-da3d9ae15273 service nova] Lock "688f50af-0e41-4467-b2db-04ac22f62963-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:27:40 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-882b6713-21d4-4040-a256-8cfdb962dbef req-a2f45a1e-600a-40e7-8224-da3d9ae15273 service nova] Lock "688f50af-0e41-4467-b2db-04ac22f62963-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:27:40 user nova-compute[72418]: DEBUG nova.compute.manager [req-882b6713-21d4-4040-a256-8cfdb962dbef req-a2f45a1e-600a-40e7-8224-da3d9ae15273 service nova] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] No waiting events found dispatching network-vif-plugged-b2c3fa50-5615-4a58-8820-54c67c5d65bc {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:27:40 user nova-compute[72418]: WARNING nova.compute.manager [req-882b6713-21d4-4040-a256-8cfdb962dbef req-a2f45a1e-600a-40e7-8224-da3d9ae15273 service nova] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Received unexpected event network-vif-plugged-b2c3fa50-5615-4a58-8820-54c67c5d65bc for instance with vm_state building and task_state spawning.
Aug 09 18:27:40 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:40 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:40 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:40 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:40 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:42 user nova-compute[72418]: DEBUG nova.compute.manager [req-7268a700-5cf6-49a3-8317-7364a6128bc1 req-82f381dd-14bb-4615-a6df-be3a9da41774 service nova] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Received event network-vif-plugged-b2c3fa50-5615-4a58-8820-54c67c5d65bc {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:27:42 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-7268a700-5cf6-49a3-8317-7364a6128bc1 req-82f381dd-14bb-4615-a6df-be3a9da41774 service nova] Acquiring lock "688f50af-0e41-4467-b2db-04ac22f62963-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:27:42 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-7268a700-5cf6-49a3-8317-7364a6128bc1 req-82f381dd-14bb-4615-a6df-be3a9da41774 service nova] Lock "688f50af-0e41-4467-b2db-04ac22f62963-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:27:42 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-7268a700-5cf6-49a3-8317-7364a6128bc1 req-82f381dd-14bb-4615-a6df-be3a9da41774 service nova] Lock "688f50af-0e41-4467-b2db-04ac22f62963-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:27:42 user nova-compute[72418]: DEBUG nova.compute.manager [req-7268a700-5cf6-49a3-8317-7364a6128bc1 req-82f381dd-14bb-4615-a6df-be3a9da41774 service nova] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] No waiting events found dispatching network-vif-plugged-b2c3fa50-5615-4a58-8820-54c67c5d65bc {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:27:42 user nova-compute[72418]: WARNING nova.compute.manager [req-7268a700-5cf6-49a3-8317-7364a6128bc1 req-82f381dd-14bb-4615-a6df-be3a9da41774 service nova] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Received unexpected event network-vif-plugged-b2c3fa50-5615-4a58-8820-54c67c5d65bc for instance with vm_state building and task_state spawning.
Aug 09 18:27:42 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605662.473381, 688f50af-0e41-4467-b2db-04ac22f62963 => Resumed> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:27:42 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] VM Resumed (Lifecycle Event)
Aug 09 18:27:42 user nova-compute[72418]: DEBUG nova.compute.manager [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Instance event wait completed in 0 seconds for  {{(pid=72418) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 18:27:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Guest created on hypervisor {{(pid=72418) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 18:27:42 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Instance spawned successfully.
Aug 09 18:27:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 18:27:42 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:27:42 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:27:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Found default for hw_cdrom_bus of ide {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:27:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Found default for hw_disk_bus of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:27:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Found default for hw_input_bus of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:27:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Found default for hw_pointer_model of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:27:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Found default for hw_video_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:27:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Found default for hw_vif_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:27:42 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:27:42 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605662.4782124, 688f50af-0e41-4467-b2db-04ac22f62963 => Started> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:27:42 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] VM Started (Lifecycle Event)
Aug 09 18:27:42 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:27:42 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:27:42 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:42 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:27:42 user nova-compute[72418]: INFO nova.compute.manager [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Took 6.57 seconds to spawn the instance on the hypervisor.
Aug 09 18:27:42 user nova-compute[72418]: DEBUG nova.compute.manager [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:27:42 user nova-compute[72418]: INFO nova.compute.manager [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Took 7.46 seconds to build instance.
Aug 09 18:27:42 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-f81dd93c-25db-4f28-a53c-74e242b176ae tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Lock "688f50af-0e41-4467-b2db-04ac22f62963" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.579s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:27:43 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:44 user nova-compute[72418]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691605649.1366374, e07beace-59d8-4c02-844b-1db1a6e81198 => Stopped> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:27:44 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] VM Stopped (Lifecycle Event)
Aug 09 18:27:44 user nova-compute[72418]: DEBUG nova.compute.manager [None req-9b23f78d-5080-43de-951d-75d5149a6bb1 None None] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:27:44 user nova-compute[72418]: DEBUG nova.compute.manager [None req-9b23f78d-5080-43de-951d-75d5149a6bb1 None None] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:27:45 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:27:46 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:27:47 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:47 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:27:47 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:27:47 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72418) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 18:27:47 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:27:48 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:48 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:27:49 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:27:49 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:27:49 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:27:49 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72418) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 18:27:50 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:27:50 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:27:50 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:27:50 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:27:50 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:27:50 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Auditing locally available compute resources for user (node: user) {{(pid=72418) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 18:27:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:27:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:27:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:27:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:27:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/479ea4c3-ad7f-4da0-a901-defe46d96065/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:27:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/479ea4c3-ad7f-4da0-a901-defe46d96065/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:27:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/479ea4c3-ad7f-4da0-a901-defe46d96065/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:27:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/479ea4c3-ad7f-4da0-a901-defe46d96065/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:27:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8abe9dfb-2bc7-41f3-adba-7ba00f3af83c/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:27:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8abe9dfb-2bc7-41f3-adba-7ba00f3af83c/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:27:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8abe9dfb-2bc7-41f3-adba-7ba00f3af83c/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:27:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8abe9dfb-2bc7-41f3-adba-7ba00f3af83c/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:27:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:27:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:27:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:27:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:27:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:27:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:27:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:27:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:27:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:27:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:27:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:27:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:27:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk.rescue --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:27:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:27:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk.rescue --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:27:53 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk.rescue --force-share --output=json" returned: 0 in 0.156s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:27:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:27:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:27:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:27:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:27:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:27:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:27:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:27:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:27:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c052c2b2-e823-4929-912b-40968130f964/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:27:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c052c2b2-e823-4929-912b-40968130f964/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:27:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c052c2b2-e823-4929-912b-40968130f964/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:27:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c052c2b2-e823-4929-912b-40968130f964/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:27:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/688f50af-0e41-4467-b2db-04ac22f62963/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:27:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/688f50af-0e41-4467-b2db-04ac22f62963/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:27:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/688f50af-0e41-4467-b2db-04ac22f62963/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:27:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/688f50af-0e41-4467-b2db-04ac22f62963/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:27:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:27:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:27:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:27:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:27:54 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:27:54 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:27:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e019064c-955e-4f80-9b00-6b32b3835d58/disk.rescue --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:27:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e019064c-955e-4f80-9b00-6b32b3835d58/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:27:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e019064c-955e-4f80-9b00-6b32b3835d58/disk.rescue --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:27:55 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e019064c-955e-4f80-9b00-6b32b3835d58/disk.rescue --force-share --output=json" returned: 0 in 0.164s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:27:55 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:27:55 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:27:55 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Hypervisor/Node resource view: name=user free_ram=7096MB free_disk=25.59288787841797GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72418) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 18:27:55 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:27:55 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:27:55 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 6af7918a-ce90-45ab-93d8-684e1489e891 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:27:55 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 8fe41968-a219-4a5a-afdb-32eb2082bb40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:27:55 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 01c46b33-6788-44a5-a43c-88ee4acc4d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:27:55 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 479ea4c3-ad7f-4da0-a901-defe46d96065 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:27:55 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:27:55 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance e019064c-955e-4f80-9b00-6b32b3835d58 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:27:55 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance e07beace-59d8-4c02-844b-1db1a6e81198 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:27:55 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance c46f2599-93f8-412e-9918-7ace8a9f19dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:27:55 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:27:55 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance c052c2b2-e823-4929-912b-40968130f964 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:27:55 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 688f50af-0e41-4467-b2db-04ac22f62963 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:27:55 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 18:27:55 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 18:27:55 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Refreshing inventories for resource provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 18:27:55 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Updating ProviderTree inventory for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 18:27:55 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Updating inventory in ProviderTree for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 18:27:55 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Refreshing aggregate associations for resource provider 50628e48-0a01-4c3f-9ff5-2a66453cd194, aggregates: None {{(pid=72418) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 18:27:56 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Refreshing trait associations for resource provider 50628e48-0a01-4c3f-9ff5-2a66453cd194, traits: HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=72418) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 18:27:56 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:27:56 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:27:56 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Compute_service record updated for user:user {{(pid=72418) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 18:27:56 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.878s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:27:56 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:27:56 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Cleaning up deleted instances {{(pid=72418) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 18:27:56 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] There are 0 instances to clean {{(pid=72418) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 18:27:57 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:27:58 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:00 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:28:00 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Starting heal instance info cache {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 18:28:00 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Didn't find any instances for network info cache update. {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 18:28:02 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:07 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:08 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:10 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-42e04534-ac38-43b3-a1c9-a1b65cc66326 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Acquiring lock "4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:28:10 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-42e04534-ac38-43b3-a1c9-a1b65cc66326 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Lock "4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:28:10 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-42e04534-ac38-43b3-a1c9-a1b65cc66326 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Acquiring lock "4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:28:10 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-42e04534-ac38-43b3-a1c9-a1b65cc66326 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Lock "4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:28:10 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-42e04534-ac38-43b3-a1c9-a1b65cc66326 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Lock "4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:28:10 user nova-compute[72418]: INFO nova.compute.manager [None req-42e04534-ac38-43b3-a1c9-a1b65cc66326 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Terminating instance
Aug 09 18:28:10 user nova-compute[72418]: DEBUG nova.compute.manager [None req-42e04534-ac38-43b3-a1c9-a1b65cc66326 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Start destroying the instance on the hypervisor. {{(pid=72418) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 18:28:10 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:10 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:10 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:11 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:11 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:11 user nova-compute[72418]: DEBUG nova.compute.manager [req-526790a5-80ef-4ba9-a5ff-77ae462cfea6 req-93e66f48-4409-4ec4-96fc-9add2a62b973 service nova] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Received event network-vif-unplugged-e6c1511d-0765-4136-854a-e9a673db5071 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:28:11 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-526790a5-80ef-4ba9-a5ff-77ae462cfea6 req-93e66f48-4409-4ec4-96fc-9add2a62b973 service nova] Acquiring lock "4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:28:11 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-526790a5-80ef-4ba9-a5ff-77ae462cfea6 req-93e66f48-4409-4ec4-96fc-9add2a62b973 service nova] Lock "4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:28:11 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-526790a5-80ef-4ba9-a5ff-77ae462cfea6 req-93e66f48-4409-4ec4-96fc-9add2a62b973 service nova] Lock "4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:28:11 user nova-compute[72418]: DEBUG nova.compute.manager [req-526790a5-80ef-4ba9-a5ff-77ae462cfea6 req-93e66f48-4409-4ec4-96fc-9add2a62b973 service nova] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] No waiting events found dispatching network-vif-unplugged-e6c1511d-0765-4136-854a-e9a673db5071 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:28:11 user nova-compute[72418]: DEBUG nova.compute.manager [req-526790a5-80ef-4ba9-a5ff-77ae462cfea6 req-93e66f48-4409-4ec4-96fc-9add2a62b973 service nova] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Received event network-vif-unplugged-e6c1511d-0765-4136-854a-e9a673db5071 for instance with task_state deleting. {{(pid=72418) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 18:28:11 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:11 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Instance destroyed successfully.
Aug 09 18:28:11 user nova-compute[72418]: DEBUG nova.objects.instance [None req-42e04534-ac38-43b3-a1c9-a1b65cc66326 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Lazy-loading 'resources' on Instance uuid 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:28:11 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-42e04534-ac38-43b3-a1c9-a1b65cc66326 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:22:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-968743662',display_name='tempest-VolumesAdminNegativeTest-server-968743662',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-968743662',id=7,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQ6zWIitmeu0DLu53Uuort2xj9NFnMCtkMwpHM+WpmwBwNoSmJfS3Fw7RZw4UJ9us1isjM/nSmzX/jdTNP+JBXVyF+0ywXOXRqse7blCLLMzYlEBVVNIjsdzsPKdtZ8TQ==',key_name='tempest-keypair-2131917963',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:22:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5f09f1028304efd84f2e694efdae063',ramdisk_id='',reservation_id='r-572wet15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-612744035',owner_user_name='tempest-VolumesAdminNegativeTest-612744035-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:22:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3edbabbb69494929a4d671b4113f7753',uuid=4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6c1511d-0765-4136-854a-e9a673db5071", "address": "fa:16:3e:ca:f9:2b", "network": {"id": "57e1bdad-aad5-47b8-854b-68f3c1375325", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1415993909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f09f1028304efd84f2e694efdae063", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c1511d-07", "ovs_interfaceid": "e6c1511d-0765-4136-854a-e9a673db5071", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 18:28:11 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-42e04534-ac38-43b3-a1c9-a1b65cc66326 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Converting VIF {"id": "e6c1511d-0765-4136-854a-e9a673db5071", "address": "fa:16:3e:ca:f9:2b", "network": {"id": "57e1bdad-aad5-47b8-854b-68f3c1375325", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1415993909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f09f1028304efd84f2e694efdae063", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c1511d-07", "ovs_interfaceid": "e6c1511d-0765-4136-854a-e9a673db5071", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:28:11 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-42e04534-ac38-43b3-a1c9-a1b65cc66326 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:f9:2b,bridge_name='br-int',has_traffic_filtering=True,id=e6c1511d-0765-4136-854a-e9a673db5071,network=Network(57e1bdad-aad5-47b8-854b-68f3c1375325),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c1511d-07') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:28:11 user nova-compute[72418]: DEBUG os_vif [None req-42e04534-ac38-43b3-a1c9-a1b65cc66326 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:f9:2b,bridge_name='br-int',has_traffic_filtering=True,id=e6c1511d-0765-4136-854a-e9a673db5071,network=Network(57e1bdad-aad5-47b8-854b-68f3c1375325),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c1511d-07') {{(pid=72418) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 18:28:11 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:11 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape6c1511d-07, bridge=br-int, if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:28:11 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:11 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:28:11 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:11 user nova-compute[72418]: INFO os_vif [None req-42e04534-ac38-43b3-a1c9-a1b65cc66326 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:f9:2b,bridge_name='br-int',has_traffic_filtering=True,id=e6c1511d-0765-4136-854a-e9a673db5071,network=Network(57e1bdad-aad5-47b8-854b-68f3c1375325),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c1511d-07')
Aug 09 18:28:11 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-42e04534-ac38-43b3-a1c9-a1b65cc66326 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Deleting instance files /opt/stack/data/nova/instances/4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf_del
Aug 09 18:28:11 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-42e04534-ac38-43b3-a1c9-a1b65cc66326 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Deletion of /opt/stack/data/nova/instances/4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf_del complete
Aug 09 18:28:11 user nova-compute[72418]: INFO nova.compute.manager [None req-42e04534-ac38-43b3-a1c9-a1b65cc66326 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 09 18:28:11 user nova-compute[72418]: DEBUG oslo.service.loopingcall [None req-42e04534-ac38-43b3-a1c9-a1b65cc66326 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72418) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 18:28:11 user nova-compute[72418]: DEBUG nova.compute.manager [-] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Deallocating network for instance {{(pid=72418) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 18:28:11 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] deallocate_for_instance() {{(pid=72418) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 18:28:12 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:28:12 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Took 0.81 seconds to deallocate network for instance.
Aug 09 18:28:12 user nova-compute[72418]: DEBUG nova.compute.manager [req-153ccf2f-62e5-45b5-a91a-b56199c01fcc req-415df597-2479-4616-bd45-5931ff7d7216 service nova] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Received event network-vif-deleted-e6c1511d-0765-4136-854a-e9a673db5071 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:28:12 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-42e04534-ac38-43b3-a1c9-a1b65cc66326 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:28:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-42e04534-ac38-43b3-a1c9-a1b65cc66326 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:28:12 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-42e04534-ac38-43b3-a1c9-a1b65cc66326 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:28:12 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-42e04534-ac38-43b3-a1c9-a1b65cc66326 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:28:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-42e04534-ac38-43b3-a1c9-a1b65cc66326 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.326s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:28:13 user nova-compute[72418]: INFO nova.scheduler.client.report [None req-42e04534-ac38-43b3-a1c9-a1b65cc66326 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Deleted allocations for instance 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf
Aug 09 18:28:13 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-42e04534-ac38-43b3-a1c9-a1b65cc66326 tempest-VolumesAdminNegativeTest-612744035 tempest-VolumesAdminNegativeTest-612744035-project-member] Lock "4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.241s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:28:13 user nova-compute[72418]: DEBUG nova.compute.manager [req-1cb5da0f-04a9-40ee-b654-934a05555114 req-65a5af98-661f-452b-b316-50d922bd4aa2 service nova] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Received event network-vif-plugged-e6c1511d-0765-4136-854a-e9a673db5071 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:28:13 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-1cb5da0f-04a9-40ee-b654-934a05555114 req-65a5af98-661f-452b-b316-50d922bd4aa2 service nova] Acquiring lock "4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:28:13 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-1cb5da0f-04a9-40ee-b654-934a05555114 req-65a5af98-661f-452b-b316-50d922bd4aa2 service nova] Lock "4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:28:13 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-1cb5da0f-04a9-40ee-b654-934a05555114 req-65a5af98-661f-452b-b316-50d922bd4aa2 service nova] Lock "4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:28:13 user nova-compute[72418]: DEBUG nova.compute.manager [req-1cb5da0f-04a9-40ee-b654-934a05555114 req-65a5af98-661f-452b-b316-50d922bd4aa2 service nova] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] No waiting events found dispatching network-vif-plugged-e6c1511d-0765-4136-854a-e9a673db5071 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:28:13 user nova-compute[72418]: WARNING nova.compute.manager [req-1cb5da0f-04a9-40ee-b654-934a05555114 req-65a5af98-661f-452b-b316-50d922bd4aa2 service nova] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Received unexpected event network-vif-plugged-e6c1511d-0765-4136-854a-e9a673db5071 for instance with vm_state deleted and task_state None.
Aug 09 18:28:16 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:21 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:28:23 user nova-compute[72418]: DEBUG nova.compute.manager [req-20207bdf-1c14-4d1b-9cbc-e38e487c2ab4 req-1b753301-614b-44e8-89d0-f3cba95b001e service nova] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Received event network-changed-6c9676d3-6e5d-4a95-a24f-0df4a15e993d {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:28:23 user nova-compute[72418]: DEBUG nova.compute.manager [req-20207bdf-1c14-4d1b-9cbc-e38e487c2ab4 req-1b753301-614b-44e8-89d0-f3cba95b001e service nova] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Refreshing instance network info cache due to event network-changed-6c9676d3-6e5d-4a95-a24f-0df4a15e993d. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:28:23 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-20207bdf-1c14-4d1b-9cbc-e38e487c2ab4 req-1b753301-614b-44e8-89d0-f3cba95b001e service nova] Acquiring lock "refresh_cache-c46f2599-93f8-412e-9918-7ace8a9f19dd" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:28:23 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-20207bdf-1c14-4d1b-9cbc-e38e487c2ab4 req-1b753301-614b-44e8-89d0-f3cba95b001e service nova] Acquired lock "refresh_cache-c46f2599-93f8-412e-9918-7ace8a9f19dd" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:28:23 user nova-compute[72418]: DEBUG nova.network.neutron [req-20207bdf-1c14-4d1b-9cbc-e38e487c2ab4 req-1b753301-614b-44e8-89d0-f3cba95b001e service nova] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Refreshing network info cache for port 6c9676d3-6e5d-4a95-a24f-0df4a15e993d {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:28:23 user nova-compute[72418]: DEBUG nova.network.neutron [req-20207bdf-1c14-4d1b-9cbc-e38e487c2ab4 req-1b753301-614b-44e8-89d0-f3cba95b001e service nova] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Updated VIF entry in instance network info cache for port 6c9676d3-6e5d-4a95-a24f-0df4a15e993d. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:28:23 user nova-compute[72418]: DEBUG nova.network.neutron [req-20207bdf-1c14-4d1b-9cbc-e38e487c2ab4 req-1b753301-614b-44e8-89d0-f3cba95b001e service nova] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Updating instance_info_cache with network_info: [{"id": "6c9676d3-6e5d-4a95-a24f-0df4a15e993d", "address": "fa:16:3e:80:17:d9", "network": {"id": "bd36ef30-e57d-473f-97bc-c51b5db08aa7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-425133239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78b6e36a5b61456092ce7de9212c3c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9676d3-6e", "ovs_interfaceid": "6c9676d3-6e5d-4a95-a24f-0df4a15e993d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:28:24 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-20207bdf-1c14-4d1b-9cbc-e38e487c2ab4 req-1b753301-614b-44e8-89d0-f3cba95b001e service nova] Releasing lock "refresh_cache-c46f2599-93f8-412e-9918-7ace8a9f19dd" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:28:26 user nova-compute[72418]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691605691.6299853, 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf => Stopped> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:28:26 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] VM Stopped (Lifecycle Event)
Aug 09 18:28:26 user nova-compute[72418]: DEBUG nova.compute.manager [None req-29fc806d-f9b1-4fea-9b3f-e701e8fdb846 None None] [instance: 4fbb38c7-4279-4fb6-b0d0-c89bca1bcfbf] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:28:26 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:27 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:29 user nova-compute[72418]: DEBUG nova.compute.manager [req-a16aba40-f3eb-4848-8856-6a7b30c62494 req-c452b9a9-5ad1-4ed6-a910-7b5201105aa2 service nova] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Received event network-changed-927916e6-8d94-4529-bb6f-0be5a98cafac {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:28:29 user nova-compute[72418]: DEBUG nova.compute.manager [req-a16aba40-f3eb-4848-8856-6a7b30c62494 req-c452b9a9-5ad1-4ed6-a910-7b5201105aa2 service nova] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Refreshing instance network info cache due to event network-changed-927916e6-8d94-4529-bb6f-0be5a98cafac. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:28:29 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a16aba40-f3eb-4848-8856-6a7b30c62494 req-c452b9a9-5ad1-4ed6-a910-7b5201105aa2 service nova] Acquiring lock "refresh_cache-8abe9dfb-2bc7-41f3-adba-7ba00f3af83c" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:28:29 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a16aba40-f3eb-4848-8856-6a7b30c62494 req-c452b9a9-5ad1-4ed6-a910-7b5201105aa2 service nova] Acquired lock "refresh_cache-8abe9dfb-2bc7-41f3-adba-7ba00f3af83c" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:28:29 user nova-compute[72418]: DEBUG nova.network.neutron [req-a16aba40-f3eb-4848-8856-6a7b30c62494 req-c452b9a9-5ad1-4ed6-a910-7b5201105aa2 service nova] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Refreshing network info cache for port 927916e6-8d94-4529-bb6f-0be5a98cafac {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:28:29 user nova-compute[72418]: DEBUG nova.network.neutron [req-a16aba40-f3eb-4848-8856-6a7b30c62494 req-c452b9a9-5ad1-4ed6-a910-7b5201105aa2 service nova] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Updated VIF entry in instance network info cache for port 927916e6-8d94-4529-bb6f-0be5a98cafac. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:28:29 user nova-compute[72418]: DEBUG nova.network.neutron [req-a16aba40-f3eb-4848-8856-6a7b30c62494 req-c452b9a9-5ad1-4ed6-a910-7b5201105aa2 service nova] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Updating instance_info_cache with network_info: [{"id": "927916e6-8d94-4529-bb6f-0be5a98cafac", "address": "fa:16:3e:a9:b9:b3", "network": {"id": "58f83624-fe55-4b3a-b3d6-a4a38df692e4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-638473817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "154f8492962c4c69876520aaa2b2e8aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap927916e6-8d", "ovs_interfaceid": "927916e6-8d94-4529-bb6f-0be5a98cafac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:28:29 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a16aba40-f3eb-4848-8856-6a7b30c62494 req-c452b9a9-5ad1-4ed6-a910-7b5201105aa2 service nova] Releasing lock "refresh_cache-8abe9dfb-2bc7-41f3-adba-7ba00f3af83c" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:28:31 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:31 user nova-compute[72418]: INFO nova.compute.manager [None req-af985f81-0875-47cf-88cb-3f1b1a0cc197 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Unrescuing
Aug 09 18:28:31 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-af985f81-0875-47cf-88cb-3f1b1a0cc197 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Acquiring lock "refresh_cache-6af7918a-ce90-45ab-93d8-684e1489e891" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:28:31 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-af985f81-0875-47cf-88cb-3f1b1a0cc197 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Acquired lock "refresh_cache-6af7918a-ce90-45ab-93d8-684e1489e891" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:28:31 user nova-compute[72418]: DEBUG nova.network.neutron [None req-af985f81-0875-47cf-88cb-3f1b1a0cc197 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:28:32 user nova-compute[72418]: DEBUG nova.network.neutron [None req-af985f81-0875-47cf-88cb-3f1b1a0cc197 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Updating instance_info_cache with network_info: [{"id": "2b44ecc4-13c5-43ba-8425-5f42d86bc716", "address": "fa:16:3e:8d:41:82", "network": {"id": "15a49d9b-3c0d-449b-9473-29f219960e2c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c68622cd79472ba6ad14a6876aeaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b44ecc4-13", "ovs_interfaceid": "2b44ecc4-13c5-43ba-8425-5f42d86bc716", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:28:32 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-af985f81-0875-47cf-88cb-3f1b1a0cc197 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Releasing lock "refresh_cache-6af7918a-ce90-45ab-93d8-684e1489e891" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:28:32 user nova-compute[72418]: DEBUG nova.objects.instance [None req-af985f81-0875-47cf-88cb-3f1b1a0cc197 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lazy-loading 'flavor' on Instance uuid 6af7918a-ce90-45ab-93d8-684e1489e891 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:28:32 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:32 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:32 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:32 user nova-compute[72418]: DEBUG nova.compute.manager [req-bcf46d5b-f603-40e9-b9bf-783fa2a3a636 req-5d1bf25a-ef25-4356-b2d1-aab5a24f33dd service nova] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Received event network-vif-unplugged-2b44ecc4-13c5-43ba-8425-5f42d86bc716 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:28:32 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-bcf46d5b-f603-40e9-b9bf-783fa2a3a636 req-5d1bf25a-ef25-4356-b2d1-aab5a24f33dd service nova] Acquiring lock "6af7918a-ce90-45ab-93d8-684e1489e891-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:28:32 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-bcf46d5b-f603-40e9-b9bf-783fa2a3a636 req-5d1bf25a-ef25-4356-b2d1-aab5a24f33dd service nova] Lock "6af7918a-ce90-45ab-93d8-684e1489e891-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:28:32 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-bcf46d5b-f603-40e9-b9bf-783fa2a3a636 req-5d1bf25a-ef25-4356-b2d1-aab5a24f33dd service nova] Lock "6af7918a-ce90-45ab-93d8-684e1489e891-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:28:32 user nova-compute[72418]: DEBUG nova.compute.manager [req-bcf46d5b-f603-40e9-b9bf-783fa2a3a636 req-5d1bf25a-ef25-4356-b2d1-aab5a24f33dd service nova] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] No waiting events found dispatching network-vif-unplugged-2b44ecc4-13c5-43ba-8425-5f42d86bc716 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:28:32 user nova-compute[72418]: WARNING nova.compute.manager [req-bcf46d5b-f603-40e9-b9bf-783fa2a3a636 req-5d1bf25a-ef25-4356-b2d1-aab5a24f33dd service nova] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Received unexpected event network-vif-unplugged-2b44ecc4-13c5-43ba-8425-5f42d86bc716 for instance with vm_state rescued and task_state unrescuing.
Aug 09 18:28:32 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:32 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:32 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-7e96c041-d49f-4058-8506-91d4e90f0261 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Acquiring lock "8abe9dfb-2bc7-41f3-adba-7ba00f3af83c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:28:32 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-7e96c041-d49f-4058-8506-91d4e90f0261 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Lock "8abe9dfb-2bc7-41f3-adba-7ba00f3af83c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:28:33 user nova-compute[72418]: DEBUG nova.objects.instance [None req-7e96c041-d49f-4058-8506-91d4e90f0261 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Lazy-loading 'flavor' on Instance uuid 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:28:33 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-7e96c041-d49f-4058-8506-91d4e90f0261 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Lock "8abe9dfb-2bc7-41f3-adba-7ba00f3af83c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:28:33 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Instance destroyed successfully.
Aug 09 18:28:33 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-7e96c041-d49f-4058-8506-91d4e90f0261 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Acquiring lock "8abe9dfb-2bc7-41f3-adba-7ba00f3af83c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:28:33 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-7e96c041-d49f-4058-8506-91d4e90f0261 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Lock "8abe9dfb-2bc7-41f3-adba-7ba00f3af83c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:28:33 user nova-compute[72418]: INFO nova.compute.manager [None req-7e96c041-d49f-4058-8506-91d4e90f0261 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Attaching volume 9b81ace9-7ec8-4698-8c54-56da6eb758f5 to /dev/sdc
Aug 09 18:28:33 user nova-compute[72418]: DEBUG os_brick.utils [None req-7e96c041-d49f-4058-8506-91d4e90f0261 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:28:33 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:28:33 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:28:33 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76816f9-3e02-4437-8fc9-9beb643976d3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ad56b243ad71\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:28:33 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:28:33 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:28:33 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b16659c-1c72-4ee1-a823-7ba7e00c6c18]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:28:33 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:28:33 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:28:33 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9d7ba0-b0d6-4758-8362-eed811c5d552]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:28:33 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce1062a-9bec-4a49-9db8-ba77c78d1efa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:28:33 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-7e96c041-d49f-4058-8506-91d4e90f0261 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Running cmd (subprocess): nvme version {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:28:33 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-7e96c041-d49f-4058-8506-91d4e90f0261 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] 'nvme version' failed. Not Retrying. {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:28:33 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7e96c041-d49f-4058-8506-91d4e90f0261 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] nvme not present on system {{(pid=72418) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 18:28:33 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:28:33 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:28:33 user nova-compute[72418]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 18:28:33 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[890c4628-b2b2-4377-b620-1d66dadbc7a1]: (4, '') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:28:33 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-7e96c041-d49f-4058-8506-91d4e90f0261 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72418) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 18:28:33 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-7e96c041-d49f-4058-8506-91d4e90f0261 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 18:28:33 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-7e96c041-d49f-4058-8506-91d4e90f0261 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] LIGHTOS: no hostnqn found. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 18:28:33 user nova-compute[72418]: DEBUG os_brick.utils [None req-7e96c041-d49f-4058-8506-91d4e90f0261 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ad56b243ad71', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:28:33 user nova-compute[72418]: DEBUG nova.virt.block_device [None req-7e96c041-d49f-4058-8506-91d4e90f0261 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Updating existing volume attachment record: 94e5e1cb-6a1c-4bd1-b5eb-bee74afc1181 {{(pid=72418) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 18:28:34 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:34 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:34 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:34 user nova-compute[72418]: DEBUG nova.compute.manager [req-65040408-8eae-4bae-8fc9-a16060429164 req-0c4c43a0-b9f5-4edf-a752-130a4689fc0f service nova] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Received event network-vif-plugged-2b44ecc4-13c5-43ba-8425-5f42d86bc716 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:28:34 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-65040408-8eae-4bae-8fc9-a16060429164 req-0c4c43a0-b9f5-4edf-a752-130a4689fc0f service nova] Acquiring lock "6af7918a-ce90-45ab-93d8-684e1489e891-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:28:34 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-65040408-8eae-4bae-8fc9-a16060429164 req-0c4c43a0-b9f5-4edf-a752-130a4689fc0f service nova] Lock "6af7918a-ce90-45ab-93d8-684e1489e891-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:28:34 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-65040408-8eae-4bae-8fc9-a16060429164 req-0c4c43a0-b9f5-4edf-a752-130a4689fc0f service nova] Lock "6af7918a-ce90-45ab-93d8-684e1489e891-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:28:34 user nova-compute[72418]: DEBUG nova.compute.manager [req-65040408-8eae-4bae-8fc9-a16060429164 req-0c4c43a0-b9f5-4edf-a752-130a4689fc0f service nova] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] No waiting events found dispatching network-vif-plugged-2b44ecc4-13c5-43ba-8425-5f42d86bc716 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:28:34 user nova-compute[72418]: WARNING nova.compute.manager [req-65040408-8eae-4bae-8fc9-a16060429164 req-0c4c43a0-b9f5-4edf-a752-130a4689fc0f service nova] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Received unexpected event network-vif-plugged-2b44ecc4-13c5-43ba-8425-5f42d86bc716 for instance with vm_state rescued and task_state unrescuing.
Aug 09 18:28:34 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:34 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:36 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Removed pending event for 6af7918a-ce90-45ab-93d8-684e1489e891 due to event {{(pid=72418) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 18:28:36 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605716.615934, 6af7918a-ce90-45ab-93d8-684e1489e891 => Resumed> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:28:36 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] VM Resumed (Lifecycle Event)
Aug 09 18:28:36 user nova-compute[72418]: DEBUG nova.compute.manager [None req-af985f81-0875-47cf-88cb-3f1b1a0cc197 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:28:36 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:28:36 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:28:36 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:36 user nova-compute[72418]: INFO nova.compute.manager [None req-0b02dd7c-f639-4c04-aa23-c1f952ea447b tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Unrescuing
Aug 09 18:28:36 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-0b02dd7c-f639-4c04-aa23-c1f952ea447b tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquiring lock "refresh_cache-e019064c-955e-4f80-9b00-6b32b3835d58" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:28:36 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-0b02dd7c-f639-4c04-aa23-c1f952ea447b tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquired lock "refresh_cache-e019064c-955e-4f80-9b00-6b32b3835d58" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:28:36 user nova-compute[72418]: DEBUG nova.network.neutron [None req-0b02dd7c-f639-4c04-aa23-c1f952ea447b tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:28:36 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 09 18:28:36 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605716.616816, 6af7918a-ce90-45ab-93d8-684e1489e891 => Started> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:28:36 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] VM Started (Lifecycle Event)
Aug 09 18:28:36 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:28:36 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:28:36 user nova-compute[72418]: DEBUG nova.compute.manager [req-5c5d9b47-af3f-4287-a74a-8e257ba605d7 req-eff3b7b5-ff5b-4d77-b057-0efdfcf03986 service nova] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Received event network-vif-plugged-2b44ecc4-13c5-43ba-8425-5f42d86bc716 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:28:36 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-5c5d9b47-af3f-4287-a74a-8e257ba605d7 req-eff3b7b5-ff5b-4d77-b057-0efdfcf03986 service nova] Acquiring lock "6af7918a-ce90-45ab-93d8-684e1489e891-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:28:36 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-5c5d9b47-af3f-4287-a74a-8e257ba605d7 req-eff3b7b5-ff5b-4d77-b057-0efdfcf03986 service nova] Lock "6af7918a-ce90-45ab-93d8-684e1489e891-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:28:36 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-5c5d9b47-af3f-4287-a74a-8e257ba605d7 req-eff3b7b5-ff5b-4d77-b057-0efdfcf03986 service nova] Lock "6af7918a-ce90-45ab-93d8-684e1489e891-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:28:36 user nova-compute[72418]: DEBUG nova.compute.manager [req-5c5d9b47-af3f-4287-a74a-8e257ba605d7 req-eff3b7b5-ff5b-4d77-b057-0efdfcf03986 service nova] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] No waiting events found dispatching network-vif-plugged-2b44ecc4-13c5-43ba-8425-5f42d86bc716 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:28:36 user nova-compute[72418]: WARNING nova.compute.manager [req-5c5d9b47-af3f-4287-a74a-8e257ba605d7 req-eff3b7b5-ff5b-4d77-b057-0efdfcf03986 service nova] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Received unexpected event network-vif-plugged-2b44ecc4-13c5-43ba-8425-5f42d86bc716 for instance with vm_state active and task_state None.
Aug 09 18:28:36 user nova-compute[72418]: DEBUG nova.compute.manager [req-5c5d9b47-af3f-4287-a74a-8e257ba605d7 req-eff3b7b5-ff5b-4d77-b057-0efdfcf03986 service nova] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Received event network-vif-plugged-2b44ecc4-13c5-43ba-8425-5f42d86bc716 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:28:36 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-5c5d9b47-af3f-4287-a74a-8e257ba605d7 req-eff3b7b5-ff5b-4d77-b057-0efdfcf03986 service nova] Acquiring lock "6af7918a-ce90-45ab-93d8-684e1489e891-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:28:36 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-5c5d9b47-af3f-4287-a74a-8e257ba605d7 req-eff3b7b5-ff5b-4d77-b057-0efdfcf03986 service nova] Lock "6af7918a-ce90-45ab-93d8-684e1489e891-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:28:36 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-5c5d9b47-af3f-4287-a74a-8e257ba605d7 req-eff3b7b5-ff5b-4d77-b057-0efdfcf03986 service nova] Lock "6af7918a-ce90-45ab-93d8-684e1489e891-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:28:36 user nova-compute[72418]: DEBUG nova.compute.manager [req-5c5d9b47-af3f-4287-a74a-8e257ba605d7 req-eff3b7b5-ff5b-4d77-b057-0efdfcf03986 service nova] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] No waiting events found dispatching network-vif-plugged-2b44ecc4-13c5-43ba-8425-5f42d86bc716 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:28:36 user nova-compute[72418]: WARNING nova.compute.manager [req-5c5d9b47-af3f-4287-a74a-8e257ba605d7 req-eff3b7b5-ff5b-4d77-b057-0efdfcf03986 service nova] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Received unexpected event network-vif-plugged-2b44ecc4-13c5-43ba-8425-5f42d86bc716 for instance with vm_state active and task_state None.
Aug 09 18:28:37 user nova-compute[72418]: DEBUG nova.network.neutron [None req-0b02dd7c-f639-4c04-aa23-c1f952ea447b tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Updating instance_info_cache with network_info: [{"id": "4c6c632a-142b-4cda-92c8-77026645af09", "address": "fa:16:3e:15:18:a4", "network": {"id": "beaefb5c-f5e4-47e7-ab68-60131f532ade", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e5863cda54487682a4edcc24202c91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c6c632a-14", "ovs_interfaceid": "4c6c632a-142b-4cda-92c8-77026645af09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:28:37 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-0b02dd7c-f639-4c04-aa23-c1f952ea447b tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Releasing lock "refresh_cache-e019064c-955e-4f80-9b00-6b32b3835d58" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:28:37 user nova-compute[72418]: DEBUG nova.objects.instance [None req-0b02dd7c-f639-4c04-aa23-c1f952ea447b tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lazy-loading 'flavor' on Instance uuid e019064c-955e-4f80-9b00-6b32b3835d58 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:28:37 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:37 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:37 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:37 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:37 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:38 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:38 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:38 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Instance destroyed successfully.
Aug 09 18:28:38 user nova-compute[72418]: DEBUG nova.compute.manager [req-bdc22199-1483-45ec-be3a-44b59bc14d39 req-525905af-f90e-46d8-b066-189b45406fdb service nova] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Received event network-vif-unplugged-4c6c632a-142b-4cda-92c8-77026645af09 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:28:38 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-bdc22199-1483-45ec-be3a-44b59bc14d39 req-525905af-f90e-46d8-b066-189b45406fdb service nova] Acquiring lock "e019064c-955e-4f80-9b00-6b32b3835d58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:28:38 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-bdc22199-1483-45ec-be3a-44b59bc14d39 req-525905af-f90e-46d8-b066-189b45406fdb service nova] Lock "e019064c-955e-4f80-9b00-6b32b3835d58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:28:38 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-bdc22199-1483-45ec-be3a-44b59bc14d39 req-525905af-f90e-46d8-b066-189b45406fdb service nova] Lock "e019064c-955e-4f80-9b00-6b32b3835d58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:28:38 user nova-compute[72418]: DEBUG nova.compute.manager [req-bdc22199-1483-45ec-be3a-44b59bc14d39 req-525905af-f90e-46d8-b066-189b45406fdb service nova] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] No waiting events found dispatching network-vif-unplugged-4c6c632a-142b-4cda-92c8-77026645af09 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:28:38 user nova-compute[72418]: WARNING nova.compute.manager [req-bdc22199-1483-45ec-be3a-44b59bc14d39 req-525905af-f90e-46d8-b066-189b45406fdb service nova] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Received unexpected event network-vif-unplugged-4c6c632a-142b-4cda-92c8-77026645af09 for instance with vm_state rescued and task_state unrescuing.
Aug 09 18:28:38 user nova-compute[72418]: DEBUG nova.compute.manager [req-bdc22199-1483-45ec-be3a-44b59bc14d39 req-525905af-f90e-46d8-b066-189b45406fdb service nova] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Received event network-vif-plugged-4c6c632a-142b-4cda-92c8-77026645af09 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:28:38 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-bdc22199-1483-45ec-be3a-44b59bc14d39 req-525905af-f90e-46d8-b066-189b45406fdb service nova] Acquiring lock "e019064c-955e-4f80-9b00-6b32b3835d58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:28:38 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-bdc22199-1483-45ec-be3a-44b59bc14d39 req-525905af-f90e-46d8-b066-189b45406fdb service nova] Lock "e019064c-955e-4f80-9b00-6b32b3835d58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:28:38 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-bdc22199-1483-45ec-be3a-44b59bc14d39 req-525905af-f90e-46d8-b066-189b45406fdb service nova] Lock "e019064c-955e-4f80-9b00-6b32b3835d58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:28:38 user nova-compute[72418]: DEBUG nova.compute.manager [req-bdc22199-1483-45ec-be3a-44b59bc14d39 req-525905af-f90e-46d8-b066-189b45406fdb service nova] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] No waiting events found dispatching network-vif-plugged-4c6c632a-142b-4cda-92c8-77026645af09 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:28:38 user nova-compute[72418]: WARNING nova.compute.manager [req-bdc22199-1483-45ec-be3a-44b59bc14d39 req-525905af-f90e-46d8-b066-189b45406fdb service nova] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Received unexpected event network-vif-plugged-4c6c632a-142b-4cda-92c8-77026645af09 for instance with vm_state rescued and task_state unrescuing.
Aug 09 18:28:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:40 user nova-compute[72418]: DEBUG nova.compute.manager [req-24e6d7b9-358c-45d7-9c6c-363d14ea44e1 req-82f10cb9-9ead-4f7f-8fde-2c302e2cbafe service nova] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Received event network-vif-plugged-4c6c632a-142b-4cda-92c8-77026645af09 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:28:40 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-24e6d7b9-358c-45d7-9c6c-363d14ea44e1 req-82f10cb9-9ead-4f7f-8fde-2c302e2cbafe service nova] Acquiring lock "e019064c-955e-4f80-9b00-6b32b3835d58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:28:40 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-24e6d7b9-358c-45d7-9c6c-363d14ea44e1 req-82f10cb9-9ead-4f7f-8fde-2c302e2cbafe service nova] Lock "e019064c-955e-4f80-9b00-6b32b3835d58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:28:40 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-24e6d7b9-358c-45d7-9c6c-363d14ea44e1 req-82f10cb9-9ead-4f7f-8fde-2c302e2cbafe service nova] Lock "e019064c-955e-4f80-9b00-6b32b3835d58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:28:40 user nova-compute[72418]: DEBUG nova.compute.manager [req-24e6d7b9-358c-45d7-9c6c-363d14ea44e1 req-82f10cb9-9ead-4f7f-8fde-2c302e2cbafe service nova] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] No waiting events found dispatching network-vif-plugged-4c6c632a-142b-4cda-92c8-77026645af09 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:28:40 user nova-compute[72418]: WARNING nova.compute.manager [req-24e6d7b9-358c-45d7-9c6c-363d14ea44e1 req-82f10cb9-9ead-4f7f-8fde-2c302e2cbafe service nova] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Received unexpected event network-vif-plugged-4c6c632a-142b-4cda-92c8-77026645af09 for instance with vm_state rescued and task_state unrescuing.
Aug 09 18:28:40 user nova-compute[72418]: DEBUG nova.compute.manager [req-24e6d7b9-358c-45d7-9c6c-363d14ea44e1 req-82f10cb9-9ead-4f7f-8fde-2c302e2cbafe service nova] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Received event network-vif-plugged-4c6c632a-142b-4cda-92c8-77026645af09 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:28:40 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-24e6d7b9-358c-45d7-9c6c-363d14ea44e1 req-82f10cb9-9ead-4f7f-8fde-2c302e2cbafe service nova] Acquiring lock "e019064c-955e-4f80-9b00-6b32b3835d58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:28:40 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-24e6d7b9-358c-45d7-9c6c-363d14ea44e1 req-82f10cb9-9ead-4f7f-8fde-2c302e2cbafe service nova] Lock "e019064c-955e-4f80-9b00-6b32b3835d58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:28:40 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-24e6d7b9-358c-45d7-9c6c-363d14ea44e1 req-82f10cb9-9ead-4f7f-8fde-2c302e2cbafe service nova] Lock "e019064c-955e-4f80-9b00-6b32b3835d58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:28:40 user nova-compute[72418]: DEBUG nova.compute.manager [req-24e6d7b9-358c-45d7-9c6c-363d14ea44e1 req-82f10cb9-9ead-4f7f-8fde-2c302e2cbafe service nova] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] No waiting events found dispatching network-vif-plugged-4c6c632a-142b-4cda-92c8-77026645af09 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:28:40 user nova-compute[72418]: WARNING nova.compute.manager [req-24e6d7b9-358c-45d7-9c6c-363d14ea44e1 req-82f10cb9-9ead-4f7f-8fde-2c302e2cbafe service nova] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Received unexpected event network-vif-plugged-4c6c632a-142b-4cda-92c8-77026645af09 for instance with vm_state rescued and task_state unrescuing.
Aug 09 18:28:41 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:28:41 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Triggering sync for uuid 6af7918a-ce90-45ab-93d8-684e1489e891 {{(pid=72418) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 18:28:41 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Triggering sync for uuid 8fe41968-a219-4a5a-afdb-32eb2082bb40 {{(pid=72418) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 18:28:41 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Triggering sync for uuid 01c46b33-6788-44a5-a43c-88ee4acc4d39 {{(pid=72418) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 18:28:41 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Triggering sync for uuid 479ea4c3-ad7f-4da0-a901-defe46d96065 {{(pid=72418) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 18:28:41 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Triggering sync for uuid e019064c-955e-4f80-9b00-6b32b3835d58 {{(pid=72418) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 18:28:41 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Triggering sync for uuid e07beace-59d8-4c02-844b-1db1a6e81198 {{(pid=72418) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 18:28:41 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Triggering sync for uuid c46f2599-93f8-412e-9918-7ace8a9f19dd {{(pid=72418) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 18:28:41 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Triggering sync for uuid 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c {{(pid=72418) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 18:28:41 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Triggering sync for uuid c052c2b2-e823-4929-912b-40968130f964 {{(pid=72418) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 18:28:41 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Triggering sync for uuid 688f50af-0e41-4467-b2db-04ac22f62963 {{(pid=72418) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 18:28:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "6af7918a-ce90-45ab-93d8-684e1489e891" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:28:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "6af7918a-ce90-45ab-93d8-684e1489e891" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:28:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "8fe41968-a219-4a5a-afdb-32eb2082bb40" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:28:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "8fe41968-a219-4a5a-afdb-32eb2082bb40" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:28:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "01c46b33-6788-44a5-a43c-88ee4acc4d39" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:28:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "01c46b33-6788-44a5-a43c-88ee4acc4d39" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:28:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "479ea4c3-ad7f-4da0-a901-defe46d96065" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:28:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "479ea4c3-ad7f-4da0-a901-defe46d96065" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:28:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "e019064c-955e-4f80-9b00-6b32b3835d58" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:28:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "e019064c-955e-4f80-9b00-6b32b3835d58" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:28:41 user nova-compute[72418]: INFO nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 09 18:28:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "e019064c-955e-4f80-9b00-6b32b3835d58" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:28:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "e07beace-59d8-4c02-844b-1db1a6e81198" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:28:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "e07beace-59d8-4c02-844b-1db1a6e81198" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:28:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "c46f2599-93f8-412e-9918-7ace8a9f19dd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:28:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "c46f2599-93f8-412e-9918-7ace8a9f19dd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:28:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "8abe9dfb-2bc7-41f3-adba-7ba00f3af83c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:28:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "c052c2b2-e823-4929-912b-40968130f964" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:28:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "c052c2b2-e823-4929-912b-40968130f964" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:28:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "688f50af-0e41-4467-b2db-04ac22f62963" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:28:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "688f50af-0e41-4467-b2db-04ac22f62963" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:28:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "01c46b33-6788-44a5-a43c-88ee4acc4d39" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.115s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:28:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "479ea4c3-ad7f-4da0-a901-defe46d96065" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.119s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:28:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "e07beace-59d8-4c02-844b-1db1a6e81198" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.124s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:28:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "6af7918a-ce90-45ab-93d8-684e1489e891" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.139s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:28:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "c46f2599-93f8-412e-9918-7ace8a9f19dd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.135s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:28:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "8fe41968-a219-4a5a-afdb-32eb2082bb40" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.146s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:28:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "688f50af-0e41-4467-b2db-04ac22f62963" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.144s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:28:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "c052c2b2-e823-4929-912b-40968130f964" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.148s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:28:41 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Removed pending event for e019064c-955e-4f80-9b00-6b32b3835d58 due to event {{(pid=72418) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 18:28:42 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605722.093304, e019064c-955e-4f80-9b00-6b32b3835d58 => Resumed> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:28:42 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] VM Resumed (Lifecycle Event)
Aug 09 18:28:42 user nova-compute[72418]: DEBUG nova.compute.manager [None req-0b02dd7c-f639-4c04-aa23-c1f952ea447b tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:28:42 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:28:42 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:28:42 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 09 18:28:42 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605722.095586, e019064c-955e-4f80-9b00-6b32b3835d58 => Started> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:28:42 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] VM Started (Lifecycle Event)
Aug 09 18:28:42 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:28:42 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:28:42 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e96c041-d49f-4058-8506-91d4e90f0261 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Calling os-brick to attach iSCSI Volume {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 18:28:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e96c041-d49f-4058-8506-91d4e90f0261 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9b81ace9-7ec8-4698-8c54-56da6eb758f5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mUJcRHFS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:28:42 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-7e96c041-d49f-4058-8506-91d4e90f0261 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:28:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-7e96c041-d49f-4058-8506-91d4e90f0261 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:28:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-7e96c041-d49f-4058-8506-91d4e90f0261 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:28:42 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-7e96c041-d49f-4058-8506-91d4e90f0261 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:28:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-7e96c041-d49f-4058-8506-91d4e90f0261 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b81ace9-7ec8-4698-8c54-56da6eb758f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:28:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-7e96c041-d49f-4058-8506-91d4e90f0261 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b81ace9-7ec8-4698-8c54-56da6eb758f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:28:42 user nova-compute[72418]: INFO os_brick.initiator.connectors.iscsi [None req-7e96c041-d49f-4058-8506-91d4e90f0261 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 18:28:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b81ace9-7ec8-4698-8c54-56da6eb758f5 -p 172.16.0.220:3260 {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:28:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b81ace9-7ec8-4698-8c54-56da6eb758f5 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:28:42 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9908367-3196-4b6c-8a68-8b303821b393]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:28:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e96c041-d49f-4058-8506-91d4e90f0261 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 18:28:42 user nova-compute[72418]:  {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:28:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b81ace9-7ec8-4698-8c54-56da6eb758f5 -p 172.16.0.220:3260 --interface default --op new {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:28:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b81ace9-7ec8-4698-8c54-56da6eb758f5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:28:42 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff890c0-3843-4847-95b0-b9c9611a80ff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9b81ace9-7ec8-4698-8c54-56da6eb758f5] added\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:28:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e96c041-d49f-4058-8506-91d4e90f0261 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9b81ace9-7ec8-4698-8c54-56da6eb758f5] added
Aug 09 18:28:42 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:28:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b81ace9-7ec8-4698-8c54-56da6eb758f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:28:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b81ace9-7ec8-4698-8c54-56da6eb758f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:28:42 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d88e08-c7d0-4957-aef4-77d8ab47d1fb]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:28:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e96c041-d49f-4058-8506-91d4e90f0261 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:28:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b81ace9-7ec8-4698-8c54-56da6eb758f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:28:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b81ace9-7ec8-4698-8c54-56da6eb758f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:28:42 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[50cc8179-d845-47c8-953f-95aec12d2f0e]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:28:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e96c041-d49f-4058-8506-91d4e90f0261 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:28:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b81ace9-7ec8-4698-8c54-56da6eb758f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mUJcRHFS {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:28:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b81ace9-7ec8-4698-8c54-56da6eb758f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mUJcRHFS" returned: 0 in 0.025s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:28:42 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbcf9b2d-2051-4020-afa8-f84dd40ed483]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:28:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e96c041-d49f-4058-8506-91d4e90f0261 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mUJcRHFS'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:28:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b81ace9-7ec8-4698-8c54-56da6eb758f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:28:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b81ace9-7ec8-4698-8c54-56da6eb758f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:28:42 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dda31c0-5539-4e6e-af41-6768eddb8115]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:28:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e96c041-d49f-4058-8506-91d4e90f0261 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:28:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:28:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:28:42 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa011e6-e728-45d2-94e2-68732a4694cf]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:28:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e96c041-d49f-4058-8506-91d4e90f0261 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:28:42 user nova-compute[72418]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f (non-flash)
Aug 09 18:28:42 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:28:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e96c041-d49f-4058-8506-91d4e90f0261 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:28:42 user nova-compute[72418]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f (non-flash)
Aug 09 18:28:42 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:28:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b81ace9-7ec8-4698-8c54-56da6eb758f5 -p 172.16.0.220:3260 --login {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:28:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b81ace9-7ec8-4698-8c54-56da6eb758f5 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:28:42 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4227b3a-720b-4e8e-aa6b-cb0182e71400]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9b81ace9-7ec8-4698-8c54-56da6eb758f5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9b81ace9-7ec8-4698-8c54-56da6eb758f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:28:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e96c041-d49f-4058-8506-91d4e90f0261 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9b81ace9-7ec8-4698-8c54-56da6eb758f5, portal: 172.16.0.220,3260]
Aug 09 18:28:42 user nova-compute[72418]: Login to [iface: default, target: iqn.2010-10.org.openstack:9b81ace9-7ec8-4698-8c54-56da6eb758f5, portal: 172.16.0.220,3260] successful.
Aug 09 18:28:42 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:28:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b81ace9-7ec8-4698-8c54-56da6eb758f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:28:43 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b81ace9-7ec8-4698-8c54-56da6eb758f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:28:43 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9e111d-c004-44fa-b724-1fd55d87d543]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:28:43 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e96c041-d49f-4058-8506-91d4e90f0261 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:28:43 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:28:43 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:28:43 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a9f551-7d72-4868-bca6-67761e5ab817]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b81ace9-7ec8-4698-8c54-56da6eb758f5 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:28:43 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e96c041-d49f-4058-8506-91d4e90f0261 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:28:43 user nova-compute[72418]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f (non-flash)
Aug 09 18:28:43 user nova-compute[72418]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b81ace9-7ec8-4698-8c54-56da6eb758f5 (non-flash)
Aug 09 18:28:43 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:28:43 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e96c041-d49f-4058-8506-91d4e90f0261 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:28:43 user nova-compute[72418]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f (non-flash)
Aug 09 18:28:43 user nova-compute[72418]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b81ace9-7ec8-4698-8c54-56da6eb758f5 (non-flash)
Aug 09 18:28:43 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:28:43 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-7e96c041-d49f-4058-8506-91d4e90f0261 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b81ace9-7ec8-4698-8c54-56da6eb758f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:28:43 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e96c041-d49f-4058-8506-91d4e90f0261 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Connected to 172.16.0.220:3260 {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 18:28:43 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-7e96c041-d49f-4058-8506-91d4e90f0261 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] HCTL ('35', '-', '-', 0) found on session 17 with lun 0 {{(pid=72418) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 18:28:43 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-7e96c041-d49f-4058-8506-91d4e90f0261 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72418) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 18:28:43 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:28:43 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:28:43 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56bc5a9-b7c6-4b37-b88f-1a21bb30f27f]: (4, ('- - 0', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:28:43 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-7e96c041-d49f-4058-8506-91d4e90f0261 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72418) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 18:28:43 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e96c041-d49f-4058-8506-91d4e90f0261 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mUJcRHFS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 18:28:44 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-7e96c041-d49f-4058-8506-91d4e90f0261 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:28:44 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e96c041-d49f-4058-8506-91d4e90f0261 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23734613932623164', 'path': '/dev/sdd'} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:28:44 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e96c041-d49f-4058-8506-91d4e90f0261 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734613932623164', 'path': '/dev/sdd'} {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 18:28:44 user nova-compute[72418]: DEBUG nova.objects.instance [None req-7e96c041-d49f-4058-8506-91d4e90f0261 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Lazy-loading 'flavor' on Instance uuid 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:28:44 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-7e96c041-d49f-4058-8506-91d4e90f0261 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 18:28:44 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:28:44 user nova-compute[72418]:   <source dev="/dev/sdd"/>
Aug 09 18:28:44 user nova-compute[72418]:   <target dev="sdc" bus="scsi"/>
Aug 09 18:28:44 user nova-compute[72418]:   <serial>9b81ace9-7ec8-4698-8c54-56da6eb758f5</serial>
Aug 09 18:28:44 user nova-compute[72418]:   <address type="drive" controller="0" unit="2"/>
Aug 09 18:28:44 user nova-compute[72418]: </disk>
Aug 09 18:28:44 user nova-compute[72418]:  {{(pid=72418) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 18:28:44 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-7e96c041-d49f-4058-8506-91d4e90f0261 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] No BDM found with device name sda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:28:44 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-7e96c041-d49f-4058-8506-91d4e90f0261 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:28:44 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-7e96c041-d49f-4058-8506-91d4e90f0261 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] No BDM found with device name sdc, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:28:44 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-7e96c041-d49f-4058-8506-91d4e90f0261 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] No VIF found with MAC fa:16:3e:a9:b9:b3, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:28:44 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-7e96c041-d49f-4058-8506-91d4e90f0261 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Lock "8abe9dfb-2bc7-41f3-adba-7ba00f3af83c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.547s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:28:44 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "8abe9dfb-2bc7-41f3-adba-7ba00f3af83c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 3.522s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:28:44 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "8abe9dfb-2bc7-41f3-adba-7ba00f3af83c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:28:45 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-8cb1b115-a3db-40c4-8fee-d4b783deab91 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Acquiring lock "8abe9dfb-2bc7-41f3-adba-7ba00f3af83c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:28:45 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-8cb1b115-a3db-40c4-8fee-d4b783deab91 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Lock "8abe9dfb-2bc7-41f3-adba-7ba00f3af83c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:28:45 user nova-compute[72418]: INFO nova.compute.manager [None req-8cb1b115-a3db-40c4-8fee-d4b783deab91 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Detaching volume 9b81ace9-7ec8-4698-8c54-56da6eb758f5
Aug 09 18:28:45 user nova-compute[72418]: INFO nova.virt.block_device [None req-8cb1b115-a3db-40c4-8fee-d4b783deab91 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Attempting to driver detach volume 9b81ace9-7ec8-4698-8c54-56da6eb758f5 from mountpoint /dev/sdc
Aug 09 18:28:45 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-8cb1b115-a3db-40c4-8fee-d4b783deab91 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Attempting to detach device sdc from instance 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c from the persistent domain config. {{(pid=72418) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 18:28:45 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-8cb1b115-a3db-40c4-8fee-d4b783deab91 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 18:28:45 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:28:45 user nova-compute[72418]:   <source dev="/dev/sdd"/>
Aug 09 18:28:45 user nova-compute[72418]:   <target dev="sdc" bus="scsi"/>
Aug 09 18:28:45 user nova-compute[72418]:   <serial>9b81ace9-7ec8-4698-8c54-56da6eb758f5</serial>
Aug 09 18:28:45 user nova-compute[72418]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 09 18:28:45 user nova-compute[72418]: </disk>
Aug 09 18:28:45 user nova-compute[72418]:  {{(pid=72418) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 18:28:45 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-8cb1b115-a3db-40c4-8fee-d4b783deab91 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Successfully detached device sdc from instance 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c from the persistent domain config.
Aug 09 18:28:45 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-8cb1b115-a3db-40c4-8fee-d4b783deab91 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c from the live domain config. {{(pid=72418) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 18:28:45 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-8cb1b115-a3db-40c4-8fee-d4b783deab91 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 18:28:45 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:28:45 user nova-compute[72418]:   <source dev="/dev/sdd"/>
Aug 09 18:28:45 user nova-compute[72418]:   <target dev="sdc" bus="scsi"/>
Aug 09 18:28:45 user nova-compute[72418]:   <serial>9b81ace9-7ec8-4698-8c54-56da6eb758f5</serial>
Aug 09 18:28:45 user nova-compute[72418]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 09 18:28:45 user nova-compute[72418]: </disk>
Aug 09 18:28:45 user nova-compute[72418]:  {{(pid=72418) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 18:28:45 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Received event <DeviceRemovedEvent: 1691605725.9738822, 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72418) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 18:28:45 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-8cb1b115-a3db-40c4-8fee-d4b783deab91 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c {{(pid=72418) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 18:28:45 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-8cb1b115-a3db-40c4-8fee-d4b783deab91 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Successfully detached device sdc from instance 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c from the live domain config.
Aug 09 18:28:45 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cb1b115-a3db-40c4-8fee-d4b783deab91 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] calling os-brick to detach iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 18:28:45 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb1b115-a3db-40c4-8fee-d4b783deab91 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, {'target_iqns': ['iqn.2010-10.org.openstack:9b81ace9-7ec8-4698-8c54-56da6eb758f5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mUJcRHFS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:28:45 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-8cb1b115-a3db-40c4-8fee-d4b783deab91 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:28:45 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-8cb1b115-a3db-40c4-8fee-d4b783deab91 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:28:45 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-8cb1b115-a3db-40c4-8fee-d4b783deab91 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:28:45 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb1b115-a3db-40c4-8fee-d4b783deab91 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b81ace9-7ec8-4698-8c54-56da6eb758f5', 0)] {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 18:28:45 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:28:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:28:46 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57e8f03-c029-48ad-b639-75bc34f7a981]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b81ace9-7ec8-4698-8c54-56da6eb758f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:28:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:28:46 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:28:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:28:46 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e872a44-53af-4a48-be24-429c69c049b9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b81ace9-7ec8-4698-8c54-56da6eb758f5 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:28:46 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb1b115-a3db-40c4-8fee-d4b783deab91 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:28:46 user nova-compute[72418]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f (non-flash)
Aug 09 18:28:46 user nova-compute[72418]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b81ace9-7ec8-4698-8c54-56da6eb758f5 (non-flash)
Aug 09 18:28:46 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:28:46 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb1b115-a3db-40c4-8fee-d4b783deab91 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:28:46 user nova-compute[72418]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f (non-flash)
Aug 09 18:28:46 user nova-compute[72418]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b81ace9-7ec8-4698-8c54-56da6eb758f5 (non-flash)
Aug 09 18:28:46 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:28:46 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb1b115-a3db-40c4-8fee-d4b783deab91 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f42d47e89d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b81ace9-7ec8-4698-8c54-56da6eb758f5'): ({'sdd'}, set())}) {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 18:28:46 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-8cb1b115-a3db-40c4-8fee-d4b783deab91 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Removing single pathed devices sdd {{(pid=72418) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 18:28:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:28:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:28:46 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b60990a-0ece-4856-a234-ad4bb409e5ad]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:28:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:28:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:28:46 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[47afb013-62fb-467a-ad30-a7afbb0e045d]: (4, ('ok\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:28:46 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-8cb1b115-a3db-40c4-8fee-d4b783deab91 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Flushing IO for device /dev/sdd {{(pid=72418) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 18:28:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:28:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:28:46 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2c283c-c955-496c-a856-5c3cf4818774]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:28:46 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-8cb1b115-a3db-40c4-8fee-d4b783deab91 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72418) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 18:28:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:28:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:28:46 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4f0673-534b-4c1a-bad1-8cb36f53de1d]: (4, ('1', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:28:46 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-8cb1b115-a3db-40c4-8fee-d4b783deab91 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 18:28:46 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-8cb1b115-a3db-40c4-8fee-d4b783deab91 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] SCSI volumes sdd have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 18:28:46 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb1b115-a3db-40c4-8fee-d4b783deab91 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b81ace9-7ec8-4698-8c54-56da6eb758f5')] {{(pid=72418) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 18:28:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b81ace9-7ec8-4698-8c54-56da6eb758f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:28:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b81ace9-7ec8-4698-8c54-56da6eb758f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:28:46 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c71fcc-42bd-4247-98b0-f3d2693824a1]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:28:46 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb1b115-a3db-40c4-8fee-d4b783deab91 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:28:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b81ace9-7ec8-4698-8c54-56da6eb758f5 -p 172.16.0.220:3260 --logout {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:28:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b81ace9-7ec8-4698-8c54-56da6eb758f5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:28:46 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b58ec6-feff-4f45-9f2c-6fdda757a319]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:9b81ace9-7ec8-4698-8c54-56da6eb758f5, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:9b81ace9-7ec8-4698-8c54-56da6eb758f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:28:46 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb1b115-a3db-40c4-8fee-d4b783deab91 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:9b81ace9-7ec8-4698-8c54-56da6eb758f5, portal: 172.16.0.220,3260]
Aug 09 18:28:46 user nova-compute[72418]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:9b81ace9-7ec8-4698-8c54-56da6eb758f5, portal: 172.16.0.220,3260] successful.
Aug 09 18:28:46 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:28:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b81ace9-7ec8-4698-8c54-56da6eb758f5 -p 172.16.0.220:3260 --op delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:28:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b81ace9-7ec8-4698-8c54-56da6eb758f5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:28:46 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd12b3f-27fd-424f-8454-13c890f664b2]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:28:46 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb1b115-a3db-40c4-8fee-d4b783deab91 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:28:46 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-8cb1b115-a3db-40c4-8fee-d4b783deab91 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:28:46 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb1b115-a3db-40c4-8fee-d4b783deab91 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] <== disconnect_volume: return (284ms) None {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:28:46 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cb1b115-a3db-40c4-8fee-d4b783deab91 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Disconnected iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 18:28:46 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:46 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:28:47 user nova-compute[72418]: DEBUG nova.objects.instance [None req-8cb1b115-a3db-40c4-8fee-d4b783deab91 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Lazy-loading 'flavor' on Instance uuid 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:28:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-8cb1b115-a3db-40c4-8fee-d4b783deab91 tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Lock "8abe9dfb-2bc7-41f3-adba-7ba00f3af83c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.587s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:28:47 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:47 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:28:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-7f8ac619-6a7b-4337-b861-ba2fca570fdb tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Acquiring lock "8abe9dfb-2bc7-41f3-adba-7ba00f3af83c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:28:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-7f8ac619-6a7b-4337-b861-ba2fca570fdb tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Lock "8abe9dfb-2bc7-41f3-adba-7ba00f3af83c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:28:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-7f8ac619-6a7b-4337-b861-ba2fca570fdb tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Acquiring lock "8abe9dfb-2bc7-41f3-adba-7ba00f3af83c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:28:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-7f8ac619-6a7b-4337-b861-ba2fca570fdb tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Lock "8abe9dfb-2bc7-41f3-adba-7ba00f3af83c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:28:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-7f8ac619-6a7b-4337-b861-ba2fca570fdb tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Lock "8abe9dfb-2bc7-41f3-adba-7ba00f3af83c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:28:47 user nova-compute[72418]: INFO nova.compute.manager [None req-7f8ac619-6a7b-4337-b861-ba2fca570fdb tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Terminating instance
Aug 09 18:28:47 user nova-compute[72418]: DEBUG nova.compute.manager [None req-7f8ac619-6a7b-4337-b861-ba2fca570fdb tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Start destroying the instance on the hypervisor. {{(pid=72418) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 18:28:48 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:48 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:48 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:48 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:48 user nova-compute[72418]: DEBUG nova.compute.manager [req-ef85d5a8-d5b0-462c-930f-0f68720a1036 req-32ac0896-2bf7-4485-b6c9-574b0a134f24 service nova] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Received event network-vif-unplugged-927916e6-8d94-4529-bb6f-0be5a98cafac {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:28:48 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-ef85d5a8-d5b0-462c-930f-0f68720a1036 req-32ac0896-2bf7-4485-b6c9-574b0a134f24 service nova] Acquiring lock "8abe9dfb-2bc7-41f3-adba-7ba00f3af83c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:28:48 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-ef85d5a8-d5b0-462c-930f-0f68720a1036 req-32ac0896-2bf7-4485-b6c9-574b0a134f24 service nova] Lock "8abe9dfb-2bc7-41f3-adba-7ba00f3af83c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:28:48 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-ef85d5a8-d5b0-462c-930f-0f68720a1036 req-32ac0896-2bf7-4485-b6c9-574b0a134f24 service nova] Lock "8abe9dfb-2bc7-41f3-adba-7ba00f3af83c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:28:48 user nova-compute[72418]: DEBUG nova.compute.manager [req-ef85d5a8-d5b0-462c-930f-0f68720a1036 req-32ac0896-2bf7-4485-b6c9-574b0a134f24 service nova] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] No waiting events found dispatching network-vif-unplugged-927916e6-8d94-4529-bb6f-0be5a98cafac {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:28:48 user nova-compute[72418]: DEBUG nova.compute.manager [req-ef85d5a8-d5b0-462c-930f-0f68720a1036 req-32ac0896-2bf7-4485-b6c9-574b0a134f24 service nova] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Received event network-vif-unplugged-927916e6-8d94-4529-bb6f-0be5a98cafac for instance with task_state deleting. {{(pid=72418) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 18:28:48 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Instance destroyed successfully.
Aug 09 18:28:48 user nova-compute[72418]: DEBUG nova.objects.instance [None req-7f8ac619-6a7b-4337-b861-ba2fca570fdb tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Lazy-loading 'resources' on Instance uuid 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:28:48 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-7f8ac619-6a7b-4337-b861-ba2fca570fdb tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T18:26:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-317502969',display_name='tempest-AttachSCSIVolumeTestJSON-server-317502969',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-317502969',id=18,image_ref='2dd3b5c7-4579-4bd7-b6f0-3425a2d3fa88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDvXzV9a+9+R9rG4sUxH35UR3XfOKob5UVPn7AuwH5O1QwX3a7b5J/z5l13L0879jSt64hhZV3MzsTzaUvqlZRPOHoS8MV02mA2nwvnMfpg3VrOo5xure1kCT1u/lo4pNw==',key_name='tempest-keypair-1156144079',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:26:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='154f8492962c4c69876520aaa2b2e8aa',ramdisk_id='',reservation_id='r-bf0jv510',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2dd3b5c7-4579-4bd7-b6f0-3425a2d3fa88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-633262233',owner_user_name='tempest-AttachSCSIVolumeTestJSON-633262233-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:26:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43008ce004de4019b0e7ea8a9fef7701',uuid=8abe9dfb-2bc7-41f3-adba-7ba00f3af83c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "927916e6-8d94-4529-bb6f-0be5a98cafac", "address": "fa:16:3e:a9:b9:b3", "network": {"id": "58f83624-fe55-4b3a-b3d6-a4a38df692e4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-638473817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "154f8492962c4c69876520aaa2b2e8aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap927916e6-8d", "ovs_interfaceid": "927916e6-8d94-4529-bb6f-0be5a98cafac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 18:28:48 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-7f8ac619-6a7b-4337-b861-ba2fca570fdb tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Converting VIF {"id": "927916e6-8d94-4529-bb6f-0be5a98cafac", "address": "fa:16:3e:a9:b9:b3", "network": {"id": "58f83624-fe55-4b3a-b3d6-a4a38df692e4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-638473817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "154f8492962c4c69876520aaa2b2e8aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap927916e6-8d", "ovs_interfaceid": "927916e6-8d94-4529-bb6f-0be5a98cafac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:28:48 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-7f8ac619-6a7b-4337-b861-ba2fca570fdb tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:b9:b3,bridge_name='br-int',has_traffic_filtering=True,id=927916e6-8d94-4529-bb6f-0be5a98cafac,network=Network(58f83624-fe55-4b3a-b3d6-a4a38df692e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap927916e6-8d') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:28:48 user nova-compute[72418]: DEBUG os_vif [None req-7f8ac619-6a7b-4337-b861-ba2fca570fdb tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:b9:b3,bridge_name='br-int',has_traffic_filtering=True,id=927916e6-8d94-4529-bb6f-0be5a98cafac,network=Network(58f83624-fe55-4b3a-b3d6-a4a38df692e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap927916e6-8d') {{(pid=72418) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 18:28:48 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:48 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap927916e6-8d, bridge=br-int, if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:28:48 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:48 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:28:48 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:48 user nova-compute[72418]: INFO os_vif [None req-7f8ac619-6a7b-4337-b861-ba2fca570fdb tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:b9:b3,bridge_name='br-int',has_traffic_filtering=True,id=927916e6-8d94-4529-bb6f-0be5a98cafac,network=Network(58f83624-fe55-4b3a-b3d6-a4a38df692e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap927916e6-8d')
Aug 09 18:28:48 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-7f8ac619-6a7b-4337-b861-ba2fca570fdb tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Deleting instance files /opt/stack/data/nova/instances/8abe9dfb-2bc7-41f3-adba-7ba00f3af83c_del
Aug 09 18:28:48 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-7f8ac619-6a7b-4337-b861-ba2fca570fdb tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Deletion of /opt/stack/data/nova/instances/8abe9dfb-2bc7-41f3-adba-7ba00f3af83c_del complete
Aug 09 18:28:48 user nova-compute[72418]: INFO nova.compute.manager [None req-7f8ac619-6a7b-4337-b861-ba2fca570fdb tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 09 18:28:48 user nova-compute[72418]: DEBUG oslo.service.loopingcall [None req-7f8ac619-6a7b-4337-b861-ba2fca570fdb tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72418) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 18:28:48 user nova-compute[72418]: DEBUG nova.compute.manager [-] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Deallocating network for instance {{(pid=72418) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 18:28:48 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] deallocate_for_instance() {{(pid=72418) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 18:28:49 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:28:49 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Took 1.02 seconds to deallocate network for instance.
Aug 09 18:28:49 user nova-compute[72418]: DEBUG nova.compute.manager [req-51178070-e965-4f3d-8574-0d3ee4de6d46 req-d49bb74a-d2ef-40a5-9083-c9d85fff4de1 service nova] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Received event network-vif-deleted-927916e6-8d94-4529-bb6f-0be5a98cafac {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:28:49 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-7f8ac619-6a7b-4337-b861-ba2fca570fdb tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:28:49 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-7f8ac619-6a7b-4337-b861-ba2fca570fdb tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:28:49 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:28:49 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72418) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 18:28:50 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-7f8ac619-6a7b-4337-b861-ba2fca570fdb tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:28:50 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-7f8ac619-6a7b-4337-b861-ba2fca570fdb tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:28:50 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-7f8ac619-6a7b-4337-b861-ba2fca570fdb tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.364s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:28:50 user nova-compute[72418]: INFO nova.scheduler.client.report [None req-7f8ac619-6a7b-4337-b861-ba2fca570fdb tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Deleted allocations for instance 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c
Aug 09 18:28:50 user nova-compute[72418]: DEBUG nova.compute.manager [req-ec039194-de05-49e6-8157-780936875745 req-9e17b072-092a-4d5e-b467-e8be72c6f707 service nova] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Received event network-vif-plugged-927916e6-8d94-4529-bb6f-0be5a98cafac {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:28:50 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-ec039194-de05-49e6-8157-780936875745 req-9e17b072-092a-4d5e-b467-e8be72c6f707 service nova] Acquiring lock "8abe9dfb-2bc7-41f3-adba-7ba00f3af83c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:28:50 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-ec039194-de05-49e6-8157-780936875745 req-9e17b072-092a-4d5e-b467-e8be72c6f707 service nova] Lock "8abe9dfb-2bc7-41f3-adba-7ba00f3af83c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:28:50 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-ec039194-de05-49e6-8157-780936875745 req-9e17b072-092a-4d5e-b467-e8be72c6f707 service nova] Lock "8abe9dfb-2bc7-41f3-adba-7ba00f3af83c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:28:50 user nova-compute[72418]: DEBUG nova.compute.manager [req-ec039194-de05-49e6-8157-780936875745 req-9e17b072-092a-4d5e-b467-e8be72c6f707 service nova] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] No waiting events found dispatching network-vif-plugged-927916e6-8d94-4529-bb6f-0be5a98cafac {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:28:50 user nova-compute[72418]: WARNING nova.compute.manager [req-ec039194-de05-49e6-8157-780936875745 req-9e17b072-092a-4d5e-b467-e8be72c6f707 service nova] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Received unexpected event network-vif-plugged-927916e6-8d94-4529-bb6f-0be5a98cafac for instance with vm_state deleted and task_state None.
Aug 09 18:28:50 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-7f8ac619-6a7b-4337-b861-ba2fca570fdb tempest-AttachSCSIVolumeTestJSON-633262233 tempest-AttachSCSIVolumeTestJSON-633262233-project-member] Lock "8abe9dfb-2bc7-41f3-adba-7ba00f3af83c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.416s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:28:50 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:28:50 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:28:51 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:28:51 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:28:51 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:28:51 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:28:51 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:28:51 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Auditing locally available compute resources for user (node: user) {{(pid=72418) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 18:28:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:28:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:28:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:28:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:28:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/479ea4c3-ad7f-4da0-a901-defe46d96065/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:28:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/479ea4c3-ad7f-4da0-a901-defe46d96065/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:28:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/479ea4c3-ad7f-4da0-a901-defe46d96065/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:28:52 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/479ea4c3-ad7f-4da0-a901-defe46d96065/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:28:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:28:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:28:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:28:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:28:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:28:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:28:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:28:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:28:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:28:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:28:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:28:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:28:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:28:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:28:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:28:53 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:28:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c052c2b2-e823-4929-912b-40968130f964/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:28:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c052c2b2-e823-4929-912b-40968130f964/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:28:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c052c2b2-e823-4929-912b-40968130f964/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:28:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c052c2b2-e823-4929-912b-40968130f964/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:28:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/688f50af-0e41-4467-b2db-04ac22f62963/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:28:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/688f50af-0e41-4467-b2db-04ac22f62963/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:28:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/688f50af-0e41-4467-b2db-04ac22f62963/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:28:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/688f50af-0e41-4467-b2db-04ac22f62963/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:28:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:28:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:28:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:28:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:28:54 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:28:54 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:28:55 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:28:55 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:28:55 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Hypervisor/Node resource view: name=user free_ram=7648MB free_disk=25.618602752685547GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72418) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 18:28:55 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:28:55 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:28:55 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 6af7918a-ce90-45ab-93d8-684e1489e891 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:28:55 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 8fe41968-a219-4a5a-afdb-32eb2082bb40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:28:55 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 01c46b33-6788-44a5-a43c-88ee4acc4d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:28:55 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 479ea4c3-ad7f-4da0-a901-defe46d96065 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:28:55 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance e019064c-955e-4f80-9b00-6b32b3835d58 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:28:55 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance e07beace-59d8-4c02-844b-1db1a6e81198 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:28:55 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance c46f2599-93f8-412e-9918-7ace8a9f19dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:28:55 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance c052c2b2-e823-4929-912b-40968130f964 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:28:55 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 688f50af-0e41-4467-b2db-04ac22f62963 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:28:55 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 18:28:55 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 18:28:55 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:28:55 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:28:55 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Compute_service record updated for user:user {{(pid=72418) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 18:28:55 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.427s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:28:55 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-252ac5b4-251a-4dac-a1ca-eb4d54783a8f tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Acquiring lock "c052c2b2-e823-4929-912b-40968130f964" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:28:55 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-252ac5b4-251a-4dac-a1ca-eb4d54783a8f tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Lock "c052c2b2-e823-4929-912b-40968130f964" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:28:55 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-252ac5b4-251a-4dac-a1ca-eb4d54783a8f tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Acquiring lock "c052c2b2-e823-4929-912b-40968130f964-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:28:55 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-252ac5b4-251a-4dac-a1ca-eb4d54783a8f tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Lock "c052c2b2-e823-4929-912b-40968130f964-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:28:55 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-252ac5b4-251a-4dac-a1ca-eb4d54783a8f tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Lock "c052c2b2-e823-4929-912b-40968130f964-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:28:55 user nova-compute[72418]: INFO nova.compute.manager [None req-252ac5b4-251a-4dac-a1ca-eb4d54783a8f tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: c052c2b2-e823-4929-912b-40968130f964] Terminating instance
Aug 09 18:28:55 user nova-compute[72418]: DEBUG nova.compute.manager [None req-252ac5b4-251a-4dac-a1ca-eb4d54783a8f tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: c052c2b2-e823-4929-912b-40968130f964] Start destroying the instance on the hypervisor. {{(pid=72418) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 18:28:55 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:55 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:55 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:55 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:56 user nova-compute[72418]: DEBUG nova.compute.manager [req-c0f197f3-4b51-401e-948e-e0ade291d771 req-2221a622-527c-4d49-8f75-20c66ae9f392 service nova] [instance: c052c2b2-e823-4929-912b-40968130f964] Received event network-vif-unplugged-b0775e0d-bee0-4b6d-a85e-7668c873b3cc {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:28:56 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-c0f197f3-4b51-401e-948e-e0ade291d771 req-2221a622-527c-4d49-8f75-20c66ae9f392 service nova] Acquiring lock "c052c2b2-e823-4929-912b-40968130f964-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:28:56 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-c0f197f3-4b51-401e-948e-e0ade291d771 req-2221a622-527c-4d49-8f75-20c66ae9f392 service nova] Lock "c052c2b2-e823-4929-912b-40968130f964-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:28:56 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-c0f197f3-4b51-401e-948e-e0ade291d771 req-2221a622-527c-4d49-8f75-20c66ae9f392 service nova] Lock "c052c2b2-e823-4929-912b-40968130f964-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:28:56 user nova-compute[72418]: DEBUG nova.compute.manager [req-c0f197f3-4b51-401e-948e-e0ade291d771 req-2221a622-527c-4d49-8f75-20c66ae9f392 service nova] [instance: c052c2b2-e823-4929-912b-40968130f964] No waiting events found dispatching network-vif-unplugged-b0775e0d-bee0-4b6d-a85e-7668c873b3cc {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:28:56 user nova-compute[72418]: DEBUG nova.compute.manager [req-c0f197f3-4b51-401e-948e-e0ade291d771 req-2221a622-527c-4d49-8f75-20c66ae9f392 service nova] [instance: c052c2b2-e823-4929-912b-40968130f964] Received event network-vif-unplugged-b0775e0d-bee0-4b6d-a85e-7668c873b3cc for instance with task_state deleting. {{(pid=72418) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 18:28:56 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: c052c2b2-e823-4929-912b-40968130f964] Instance destroyed successfully.
Aug 09 18:28:56 user nova-compute[72418]: DEBUG nova.objects.instance [None req-252ac5b4-251a-4dac-a1ca-eb4d54783a8f tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Lazy-loading 'resources' on Instance uuid c052c2b2-e823-4929-912b-40968130f964 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:28:56 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-252ac5b4-251a-4dac-a1ca-eb4d54783a8f tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:27:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-195696140',display_name='tempest-VolumesActionsTest-instance-195696140',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-195696140',id=19,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:27:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af7a7d69112347edb919fb26f98e55e3',ramdisk_id='',reservation_id='r-u26q2si6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1905077092',owner_user_name='tempest-VolumesActionsTest-1905077092-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:27:12Z,user_data=None,user_id='cb031f5ca0bc4b7dbb600ee287a26e6f',uuid=c052c2b2-e823-4929-912b-40968130f964,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b0775e0d-bee0-4b6d-a85e-7668c873b3cc", "address": "fa:16:3e:3f:06:d0", "network": {"id": "c14fe632-b9ef-4551-8767-8bd9520ab900", "bridge": "br-int", "label": "tempest-VolumesActionsTest-889666224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7a7d69112347edb919fb26f98e55e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0775e0d-be", "ovs_interfaceid": "b0775e0d-bee0-4b6d-a85e-7668c873b3cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 18:28:56 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-252ac5b4-251a-4dac-a1ca-eb4d54783a8f tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Converting VIF {"id": "b0775e0d-bee0-4b6d-a85e-7668c873b3cc", "address": "fa:16:3e:3f:06:d0", "network": {"id": "c14fe632-b9ef-4551-8767-8bd9520ab900", "bridge": "br-int", "label": "tempest-VolumesActionsTest-889666224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af7a7d69112347edb919fb26f98e55e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0775e0d-be", "ovs_interfaceid": "b0775e0d-bee0-4b6d-a85e-7668c873b3cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:28:56 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-252ac5b4-251a-4dac-a1ca-eb4d54783a8f tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:06:d0,bridge_name='br-int',has_traffic_filtering=True,id=b0775e0d-bee0-4b6d-a85e-7668c873b3cc,network=Network(c14fe632-b9ef-4551-8767-8bd9520ab900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0775e0d-be') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:28:56 user nova-compute[72418]: DEBUG os_vif [None req-252ac5b4-251a-4dac-a1ca-eb4d54783a8f tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:06:d0,bridge_name='br-int',has_traffic_filtering=True,id=b0775e0d-bee0-4b6d-a85e-7668c873b3cc,network=Network(c14fe632-b9ef-4551-8767-8bd9520ab900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0775e0d-be') {{(pid=72418) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 18:28:56 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:56 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb0775e0d-be, bridge=br-int, if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:28:56 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:28:56 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:56 user nova-compute[72418]: INFO os_vif [None req-252ac5b4-251a-4dac-a1ca-eb4d54783a8f tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:06:d0,bridge_name='br-int',has_traffic_filtering=True,id=b0775e0d-bee0-4b6d-a85e-7668c873b3cc,network=Network(c14fe632-b9ef-4551-8767-8bd9520ab900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0775e0d-be')
Aug 09 18:28:56 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-252ac5b4-251a-4dac-a1ca-eb4d54783a8f tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: c052c2b2-e823-4929-912b-40968130f964] Deleting instance files /opt/stack/data/nova/instances/c052c2b2-e823-4929-912b-40968130f964_del
Aug 09 18:28:56 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-252ac5b4-251a-4dac-a1ca-eb4d54783a8f tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: c052c2b2-e823-4929-912b-40968130f964] Deletion of /opt/stack/data/nova/instances/c052c2b2-e823-4929-912b-40968130f964_del complete
Aug 09 18:28:56 user nova-compute[72418]: INFO nova.compute.manager [None req-252ac5b4-251a-4dac-a1ca-eb4d54783a8f tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] [instance: c052c2b2-e823-4929-912b-40968130f964] Took 0.68 seconds to destroy the instance on the hypervisor.
Aug 09 18:28:56 user nova-compute[72418]: DEBUG oslo.service.loopingcall [None req-252ac5b4-251a-4dac-a1ca-eb4d54783a8f tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72418) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 18:28:56 user nova-compute[72418]: DEBUG nova.compute.manager [-] [instance: c052c2b2-e823-4929-912b-40968130f964] Deallocating network for instance {{(pid=72418) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 18:28:56 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: c052c2b2-e823-4929-912b-40968130f964] deallocate_for_instance() {{(pid=72418) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 18:28:56 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: c052c2b2-e823-4929-912b-40968130f964] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:28:56 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: c052c2b2-e823-4929-912b-40968130f964] Took 0.54 seconds to deallocate network for instance.
Aug 09 18:28:56 user nova-compute[72418]: DEBUG nova.compute.manager [req-214e7c87-62bc-42e4-a2fc-171b4fe1fa22 req-8bf971ab-4e5a-475f-be38-5124962e997d service nova] [instance: c052c2b2-e823-4929-912b-40968130f964] Received event network-vif-deleted-b0775e0d-bee0-4b6d-a85e-7668c873b3cc {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:28:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-252ac5b4-251a-4dac-a1ca-eb4d54783a8f tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:28:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-252ac5b4-251a-4dac-a1ca-eb4d54783a8f tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:28:57 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-252ac5b4-251a-4dac-a1ca-eb4d54783a8f tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:28:57 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-252ac5b4-251a-4dac-a1ca-eb4d54783a8f tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:28:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-252ac5b4-251a-4dac-a1ca-eb4d54783a8f tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.290s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:28:57 user nova-compute[72418]: INFO nova.scheduler.client.report [None req-252ac5b4-251a-4dac-a1ca-eb4d54783a8f tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Deleted allocations for instance c052c2b2-e823-4929-912b-40968130f964
Aug 09 18:28:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-252ac5b4-251a-4dac-a1ca-eb4d54783a8f tempest-VolumesActionsTest-1905077092 tempest-VolumesActionsTest-1905077092-project-member] Lock "c052c2b2-e823-4929-912b-40968130f964" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.693s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:28:57 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:28:58 user nova-compute[72418]: DEBUG nova.compute.manager [req-37ec49ca-294a-4e2a-aa4d-012e2ae4f127 req-0c55b0a1-cfaf-40b0-9892-328ba650af1c service nova] [instance: c052c2b2-e823-4929-912b-40968130f964] Received event network-vif-plugged-b0775e0d-bee0-4b6d-a85e-7668c873b3cc {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:28:58 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-37ec49ca-294a-4e2a-aa4d-012e2ae4f127 req-0c55b0a1-cfaf-40b0-9892-328ba650af1c service nova] Acquiring lock "c052c2b2-e823-4929-912b-40968130f964-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:28:58 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-37ec49ca-294a-4e2a-aa4d-012e2ae4f127 req-0c55b0a1-cfaf-40b0-9892-328ba650af1c service nova] Lock "c052c2b2-e823-4929-912b-40968130f964-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:28:58 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-37ec49ca-294a-4e2a-aa4d-012e2ae4f127 req-0c55b0a1-cfaf-40b0-9892-328ba650af1c service nova] Lock "c052c2b2-e823-4929-912b-40968130f964-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:28:58 user nova-compute[72418]: DEBUG nova.compute.manager [req-37ec49ca-294a-4e2a-aa4d-012e2ae4f127 req-0c55b0a1-cfaf-40b0-9892-328ba650af1c service nova] [instance: c052c2b2-e823-4929-912b-40968130f964] No waiting events found dispatching network-vif-plugged-b0775e0d-bee0-4b6d-a85e-7668c873b3cc {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:28:58 user nova-compute[72418]: WARNING nova.compute.manager [req-37ec49ca-294a-4e2a-aa4d-012e2ae4f127 req-0c55b0a1-cfaf-40b0-9892-328ba650af1c service nova] [instance: c052c2b2-e823-4929-912b-40968130f964] Received unexpected event network-vif-plugged-b0775e0d-bee0-4b6d-a85e-7668c873b3cc for instance with vm_state deleted and task_state None.
Aug 09 18:28:59 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:28:59 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Starting heal instance info cache {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 18:28:59 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Rebuilding the list of instances to heal {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 18:28:59 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "refresh_cache-6af7918a-ce90-45ab-93d8-684e1489e891" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:28:59 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquired lock "refresh_cache-6af7918a-ce90-45ab-93d8-684e1489e891" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:28:59 user nova-compute[72418]: DEBUG nova.network.neutron [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Forcefully refreshing network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 18:28:59 user nova-compute[72418]: DEBUG nova.objects.instance [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lazy-loading 'info_cache' on Instance uuid 6af7918a-ce90-45ab-93d8-684e1489e891 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:29:00 user nova-compute[72418]: DEBUG nova.network.neutron [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Updating instance_info_cache with network_info: [{"id": "2b44ecc4-13c5-43ba-8425-5f42d86bc716", "address": "fa:16:3e:8d:41:82", "network": {"id": "15a49d9b-3c0d-449b-9473-29f219960e2c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c68622cd79472ba6ad14a6876aeaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b44ecc4-13", "ovs_interfaceid": "2b44ecc4-13c5-43ba-8425-5f42d86bc716", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:29:00 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Releasing lock "refresh_cache-6af7918a-ce90-45ab-93d8-684e1489e891" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:29:00 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Updated the network info_cache for instance {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 18:29:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:02 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:03 user nova-compute[72418]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691605728.7232764, 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c => Stopped> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:29:03 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] VM Stopped (Lifecycle Event)
Aug 09 18:29:03 user nova-compute[72418]: DEBUG nova.compute.manager [None req-003afd12-f196-4395-a547-ef1d9209a453 None None] [instance: 8abe9dfb-2bc7-41f3-adba-7ba00f3af83c] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:29:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:06 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:07 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:08 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:11 user nova-compute[72418]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691605736.3067565, c052c2b2-e823-4929-912b-40968130f964 => Stopped> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:29:11 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: c052c2b2-e823-4929-912b-40968130f964] VM Stopped (Lifecycle Event)
Aug 09 18:29:11 user nova-compute[72418]: DEBUG nova.compute.manager [None req-23cf1f44-14ed-46f8-8c65-cffae8ebcff9 None None] [instance: c052c2b2-e823-4929-912b-40968130f964] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:29:11 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:11 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:13 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:15 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:16 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:17 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:19 user nova-compute[72418]: DEBUG nova.objects.instance [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lazy-loading 'flavor' on Instance uuid e07beace-59d8-4c02-844b-1db1a6e81198 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:29:19 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Acquiring lock "refresh_cache-e07beace-59d8-4c02-844b-1db1a6e81198" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:29:19 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Acquired lock "refresh_cache-e07beace-59d8-4c02-844b-1db1a6e81198" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:29:19 user nova-compute[72418]: DEBUG nova.network.neutron [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:29:19 user nova-compute[72418]: DEBUG nova.objects.instance [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lazy-loading 'info_cache' on Instance uuid e07beace-59d8-4c02-844b-1db1a6e81198 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:29:19 user nova-compute[72418]: DEBUG nova.network.neutron [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Updating instance_info_cache with network_info: [{"id": "301d9f8c-022d-4c02-90dd-374ead3daa23", "address": "fa:16:3e:a6:38:d9", "network": {"id": "7621f03d-76ac-49da-89a8-0753bb11e329", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596253708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5242fb37f9664dbf9a8b50449f8dd129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap301d9f8c-02", "ovs_interfaceid": "301d9f8c-022d-4c02-90dd-374ead3daa23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:29:19 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Releasing lock "refresh_cache-e07beace-59d8-4c02-844b-1db1a6e81198" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:29:19 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Instance destroyed successfully.
Aug 09 18:29:19 user nova-compute[72418]: DEBUG nova.objects.instance [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lazy-loading 'resources' on Instance uuid e07beace-59d8-4c02-844b-1db1a6e81198 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:29:19 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:25:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-115156542',display_name='tempest-AttachVolumeTestJSON-server-115156542',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-115156542',id=16,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKIZ6czeitZd68FtX30D3PEurZKgjyFnUFrxFwHkysLhaffrzQKQu80qXZZAnkUayD+bRR0naGJJ9tbYqVXNcVqacPFRuWh7mU4dCbsXBHxDBemAgqD4XDp+3Jf6xUihXw==',key_name='tempest-keypair-957533556',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:25:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5242fb37f9664dbf9a8b50449f8dd129',ramdisk_id='',reservation_id='r-8u61z3zg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1480837700',owner_user_name='tempest-AttachVolumeTestJSON-1480837700-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:27:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='236307357ebf43bc8150f86f832260ba',uuid=e07beace-59d8-4c02-844b-1db1a6e81198,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "301d9f8c-022d-4c02-90dd-374ead3daa23", "address": "fa:16:3e:a6:38:d9", "network": {"id": "7621f03d-76ac-49da-89a8-0753bb11e329", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596253708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5242fb37f9664dbf9a8b50449f8dd129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap301d9f8c-02", "ovs_interfaceid": "301d9f8c-022d-4c02-90dd-374ead3daa23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 18:29:19 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Converting VIF {"id": "301d9f8c-022d-4c02-90dd-374ead3daa23", "address": "fa:16:3e:a6:38:d9", "network": {"id": "7621f03d-76ac-49da-89a8-0753bb11e329", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596253708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5242fb37f9664dbf9a8b50449f8dd129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap301d9f8c-02", "ovs_interfaceid": "301d9f8c-022d-4c02-90dd-374ead3daa23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:29:19 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:38:d9,bridge_name='br-int',has_traffic_filtering=True,id=301d9f8c-022d-4c02-90dd-374ead3daa23,network=Network(7621f03d-76ac-49da-89a8-0753bb11e329),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap301d9f8c-02') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:29:19 user nova-compute[72418]: DEBUG os_vif [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:38:d9,bridge_name='br-int',has_traffic_filtering=True,id=301d9f8c-022d-4c02-90dd-374ead3daa23,network=Network(7621f03d-76ac-49da-89a8-0753bb11e329),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap301d9f8c-02') {{(pid=72418) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 18:29:19 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:19 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap301d9f8c-02, bridge=br-int, if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:29:19 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:19 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:29:19 user nova-compute[72418]: INFO os_vif [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:38:d9,bridge_name='br-int',has_traffic_filtering=True,id=301d9f8c-022d-4c02-90dd-374ead3daa23,network=Network(7621f03d-76ac-49da-89a8-0753bb11e329),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap301d9f8c-02')
Aug 09 18:29:19 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] calling os-brick to detach iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 18:29:19 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, {'target_iqns': ['iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'idOFSGrK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:29:19 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:29:19 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:29:19 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:29:19 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f', 0)] {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 18:29:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:19 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae74d14c-fb1e-4869-b2e2-668060170a1b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:29:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:19 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf5427f-fb3e-4307-afe0-4a2f78faebf6]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:29:19 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:29:19 user nova-compute[72418]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f (non-flash)
Aug 09 18:29:19 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:29:19 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:29:19 user nova-compute[72418]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f (non-flash)
Aug 09 18:29:19 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:29:19 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f42d4725900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f'): ({'sdc'}, set())}) {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 18:29:19 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Removing single pathed devices sdc {{(pid=72418) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 18:29:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:19 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf57ae5-3786-4418-a40a-4204e4d4dc5b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:29:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:19 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee265efd-66da-4815-8af0-ab5443b37875]: (4, ('ok\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:29:19 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Flushing IO for device /dev/sdc {{(pid=72418) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 18:29:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:19 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9049e06-4e11-4d7a-a6c0-41412fdb7f14]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:29:19 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72418) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 18:29:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e90f081-418a-4d30-b710-fefdce3b4623]: (4, ('1', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] SCSI volumes sdc have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f')] {{(pid=72418) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15cebf9-6a71-4bf8-9b82-9d92687ee4d9]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f -p 172.16.0.220:3260 --logout {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[9473653f-ca48-4e7a-a9de-67405181a182]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f, portal: 172.16.0.220,3260]
Aug 09 18:29:20 user nova-compute[72418]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f, portal: 172.16.0.220,3260] successful.
Aug 09 18:29:20 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f -p 172.16.0.220:3260 --op delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7006e7b-b117-4a48-a566-ab4cd09f818d]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] <== disconnect_volume: return (289ms) None {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Disconnected iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Start _get_guest_xml network_info=[{"id": "301d9f8c-022d-4c02-90dd-374ead3daa23", "address": "fa:16:3e:a6:38:d9", "network": {"id": "7621f03d-76ac-49da-89a8-0753bb11e329", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596253708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5242fb37f9664dbf9a8b50449f8dd129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap301d9f8c-02", "ovs_interfaceid": "301d9f8c-022d-4c02-90dd-374ead3daa23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'attachment_id': 'bb0bb93f-e8a7-445c-a16d-89f33f880875', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'idOFSGrK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'e07beace-59d8-4c02-844b-1db1a6e81198', 'attached_at': '', 'detached_at': '', 'volume_id': '3fca4401-afce-4779-b7f0-3c2a0a64757f', 'serial': '3fca4401-afce-4779-b7f0-3c2a0a64757f'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'volume_type': None} {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG nova.objects.instance [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lazy-loading 'numa_topology' on Instance uuid e07beace-59d8-4c02-844b-1db1a6e81198 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:29:20 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:29:20 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:29:20 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] CPU controller missing on host. {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] CPU controller found on host. {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72418) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T18:17:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Flavor limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Image limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Flavor pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Image pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Got 1 possible topologies {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG nova.objects.instance [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lazy-loading 'vcpu_model' on Instance uuid e07beace-59d8-4c02-844b-1db1a6e81198 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Calling os-brick to attach iSCSI Volume {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'idOFSGrK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:29:20 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:29:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:29:20 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:29:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:29:20 user nova-compute[72418]: INFO os_brick.initiator.connectors.iscsi [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 18:29:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f -p 172.16.0.220:3260 {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b16722a-0710-4585-ac7d-56027c6b8ee3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 18:29:20 user nova-compute[72418]:  {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f -p 172.16.0.220:3260 --interface default --op new {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8a445e-8a36-4df1-8a66-95cb08c7cf47]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f] added\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f] added
Aug 09 18:29:20 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b7ef83-46be-46dc-bcd3-cfeef49ec974]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f85069e-7c2d-4c4b-919b-db567482980c]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v idOFSGrK {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v idOFSGrK" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b936e6-23cc-49b6-bd53-f47efe093813]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'idOFSGrK'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[de366ffd-ecb8-4184-b664-9f4da2e3f436]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[54401245-c60c-415a-b6ad-b8d7b265b2b7]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:29:20 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:29:20 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f -p 172.16.0.220:3260 --login {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e61b43d-7e50-4534-bbc4-b539e12b0d05]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f, portal: 172.16.0.220,3260]
Aug 09 18:29:20 user nova-compute[72418]: Login to [iface: default, target: iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f, portal: 172.16.0.220,3260] successful.
Aug 09 18:29:20 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e68dfc-4c90-4164-abc0-b7a18cff8431]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf5441a-4554-4f3a-970a-dd664be5f46f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:29:20 user nova-compute[72418]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f (non-flash)
Aug 09 18:29:20 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:29:20 user nova-compute[72418]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f (non-flash)
Aug 09 18:29:20 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Connected to 172.16.0.220:3260 {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=72418) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72418) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[930ff1dc-0037-4830-bdc2-5a15d8ca54f8]: (4, ('- - 0', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72418) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 18:29:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'idOFSGrK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 18:29:21 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:29:21 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '26536343362656339', 'path': '/dev/sdc'} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:29:21 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536343362656339', 'path': '/dev/sdc'} {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 18:29:21 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:25:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-115156542',display_name='tempest-AttachVolumeTestJSON-server-115156542',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-115156542',id=16,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKIZ6czeitZd68FtX30D3PEurZKgjyFnUFrxFwHkysLhaffrzQKQu80qXZZAnkUayD+bRR0naGJJ9tbYqVXNcVqacPFRuWh7mU4dCbsXBHxDBemAgqD4XDp+3Jf6xUihXw==',key_name='tempest-keypair-957533556',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:25:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5242fb37f9664dbf9a8b50449f8dd129',ramdisk_id='',reservation_id='r-8u61z3zg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1480837700',owner_user_name='tempest-AttachVolumeTestJSON-1480837700-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:27:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='236307357ebf43bc8150f86f832260ba',uuid=e07beace-59d8-4c02-844b-1db1a6e81198,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "301d9f8c-022d-4c02-90dd-374ead3daa23", "address": "fa:16:3e:a6:38:d9", "network": {"id": "7621f03d-76ac-49da-89a8-0753bb11e329", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596253708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5242fb37f9664dbf9a8b50449f8dd129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap301d9f8c-02", "ovs_interfaceid": "301d9f8c-022d-4c02-90dd-374ead3daa23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:29:21 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Converting VIF {"id": "301d9f8c-022d-4c02-90dd-374ead3daa23", "address": "fa:16:3e:a6:38:d9", "network": {"id": "7621f03d-76ac-49da-89a8-0753bb11e329", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596253708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5242fb37f9664dbf9a8b50449f8dd129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap301d9f8c-02", "ovs_interfaceid": "301d9f8c-022d-4c02-90dd-374ead3daa23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:29:21 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:38:d9,bridge_name='br-int',has_traffic_filtering=True,id=301d9f8c-022d-4c02-90dd-374ead3daa23,network=Network(7621f03d-76ac-49da-89a8-0753bb11e329),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap301d9f8c-02') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:29:21 user nova-compute[72418]: DEBUG nova.objects.instance [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lazy-loading 'pci_devices' on Instance uuid e07beace-59d8-4c02-844b-1db1a6e81198 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:29:21 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] End _get_guest_xml xml=<domain type="kvm">
Aug 09 18:29:21 user nova-compute[72418]:   <uuid>e07beace-59d8-4c02-844b-1db1a6e81198</uuid>
Aug 09 18:29:21 user nova-compute[72418]:   <name>instance-00000010</name>
Aug 09 18:29:21 user nova-compute[72418]:   <memory>524288</memory>
Aug 09 18:29:21 user nova-compute[72418]:   <vcpu>1</vcpu>
Aug 09 18:29:21 user nova-compute[72418]:   <metadata>
Aug 09 18:29:21 user nova-compute[72418]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:29:21 user nova-compute[72418]:       <nova:package version="0.0.0"/>
Aug 09 18:29:21 user nova-compute[72418]:       <nova:name>tempest-AttachVolumeTestJSON-server-115156542</nova:name>
Aug 09 18:29:21 user nova-compute[72418]:       <nova:creationTime>2023-08-09 18:29:20</nova:creationTime>
Aug 09 18:29:21 user nova-compute[72418]:       <nova:flavor name="m1.tiny">
Aug 09 18:29:21 user nova-compute[72418]:         <nova:memory>512</nova:memory>
Aug 09 18:29:21 user nova-compute[72418]:         <nova:disk>1</nova:disk>
Aug 09 18:29:21 user nova-compute[72418]:         <nova:swap>0</nova:swap>
Aug 09 18:29:21 user nova-compute[72418]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:29:21 user nova-compute[72418]:         <nova:vcpus>1</nova:vcpus>
Aug 09 18:29:21 user nova-compute[72418]:       </nova:flavor>
Aug 09 18:29:21 user nova-compute[72418]:       <nova:owner>
Aug 09 18:29:21 user nova-compute[72418]:         <nova:user uuid="236307357ebf43bc8150f86f832260ba">tempest-AttachVolumeTestJSON-1480837700-project-member</nova:user>
Aug 09 18:29:21 user nova-compute[72418]:         <nova:project uuid="5242fb37f9664dbf9a8b50449f8dd129">tempest-AttachVolumeTestJSON-1480837700</nova:project>
Aug 09 18:29:21 user nova-compute[72418]:       </nova:owner>
Aug 09 18:29:21 user nova-compute[72418]:       <nova:root type="image" uuid="8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e"/>
Aug 09 18:29:21 user nova-compute[72418]:       <nova:ports>
Aug 09 18:29:21 user nova-compute[72418]:         <nova:port uuid="301d9f8c-022d-4c02-90dd-374ead3daa23">
Aug 09 18:29:21 user nova-compute[72418]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 09 18:29:21 user nova-compute[72418]:         </nova:port>
Aug 09 18:29:21 user nova-compute[72418]:       </nova:ports>
Aug 09 18:29:21 user nova-compute[72418]:     </nova:instance>
Aug 09 18:29:21 user nova-compute[72418]:   </metadata>
Aug 09 18:29:21 user nova-compute[72418]:   <sysinfo type="smbios">
Aug 09 18:29:21 user nova-compute[72418]:     <system>
Aug 09 18:29:21 user nova-compute[72418]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 18:29:21 user nova-compute[72418]:       <entry name="product">OpenStack Nova</entry>
Aug 09 18:29:21 user nova-compute[72418]:       <entry name="version">0.0.0</entry>
Aug 09 18:29:21 user nova-compute[72418]:       <entry name="serial">e07beace-59d8-4c02-844b-1db1a6e81198</entry>
Aug 09 18:29:21 user nova-compute[72418]:       <entry name="uuid">e07beace-59d8-4c02-844b-1db1a6e81198</entry>
Aug 09 18:29:21 user nova-compute[72418]:       <entry name="family">Virtual Machine</entry>
Aug 09 18:29:21 user nova-compute[72418]:     </system>
Aug 09 18:29:21 user nova-compute[72418]:   </sysinfo>
Aug 09 18:29:21 user nova-compute[72418]:   <os>
Aug 09 18:29:21 user nova-compute[72418]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 18:29:21 user nova-compute[72418]:     <boot dev="hd"/>
Aug 09 18:29:21 user nova-compute[72418]:     <smbios mode="sysinfo"/>
Aug 09 18:29:21 user nova-compute[72418]:   </os>
Aug 09 18:29:21 user nova-compute[72418]:   <features>
Aug 09 18:29:21 user nova-compute[72418]:     <acpi/>
Aug 09 18:29:21 user nova-compute[72418]:     <apic/>
Aug 09 18:29:21 user nova-compute[72418]:     <vmcoreinfo/>
Aug 09 18:29:21 user nova-compute[72418]:   </features>
Aug 09 18:29:21 user nova-compute[72418]:   <clock offset="utc">
Aug 09 18:29:21 user nova-compute[72418]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 18:29:21 user nova-compute[72418]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 18:29:21 user nova-compute[72418]:     <timer name="hpet" present="no"/>
Aug 09 18:29:21 user nova-compute[72418]:   </clock>
Aug 09 18:29:21 user nova-compute[72418]:   <cpu mode="custom" match="exact">
Aug 09 18:29:21 user nova-compute[72418]:     <model>Nehalem</model>
Aug 09 18:29:21 user nova-compute[72418]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 18:29:21 user nova-compute[72418]:   </cpu>
Aug 09 18:29:21 user nova-compute[72418]:   <devices>
Aug 09 18:29:21 user nova-compute[72418]:     <disk type="file" device="disk">
Aug 09 18:29:21 user nova-compute[72418]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 18:29:21 user nova-compute[72418]:       <source file="/opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk"/>
Aug 09 18:29:21 user nova-compute[72418]:       <target dev="vda" bus="virtio"/>
Aug 09 18:29:21 user nova-compute[72418]:     </disk>
Aug 09 18:29:21 user nova-compute[72418]:     <disk type="block" device="disk">
Aug 09 18:29:21 user nova-compute[72418]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:29:21 user nova-compute[72418]:       <source dev="/dev/sdc"/>
Aug 09 18:29:21 user nova-compute[72418]:       <target dev="vdb" bus="virtio"/>
Aug 09 18:29:21 user nova-compute[72418]:       <serial>3fca4401-afce-4779-b7f0-3c2a0a64757f</serial>
Aug 09 18:29:21 user nova-compute[72418]:     </disk>
Aug 09 18:29:21 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:29:21 user nova-compute[72418]:       <mac address="fa:16:3e:a6:38:d9"/>
Aug 09 18:29:21 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:29:21 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:29:21 user nova-compute[72418]:       <target dev="tap301d9f8c-02"/>
Aug 09 18:29:21 user nova-compute[72418]:     </interface>
Aug 09 18:29:21 user nova-compute[72418]:     <serial type="pty">
Aug 09 18:29:21 user nova-compute[72418]:       <log file="/opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/console.log" append="off"/>
Aug 09 18:29:21 user nova-compute[72418]:     </serial>
Aug 09 18:29:21 user nova-compute[72418]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 18:29:21 user nova-compute[72418]:     <video>
Aug 09 18:29:21 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:29:21 user nova-compute[72418]:     </video>
Aug 09 18:29:21 user nova-compute[72418]:     <rng model="virtio">
Aug 09 18:29:21 user nova-compute[72418]:       <backend model="random">/dev/urandom</backend>
Aug 09 18:29:21 user nova-compute[72418]:     </rng>
Aug 09 18:29:21 user nova-compute[72418]:     <controller type="usb" index="0" model="none"/>
Aug 09 18:29:21 user nova-compute[72418]:     <memballoon model="virtio">
Aug 09 18:29:21 user nova-compute[72418]:       <stats period="10"/>
Aug 09 18:29:21 user nova-compute[72418]:     </memballoon>
Aug 09 18:29:21 user nova-compute[72418]:   </devices>
Aug 09 18:29:21 user nova-compute[72418]: </domain>
Aug 09 18:29:21 user nova-compute[72418]:  {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 18:29:21 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:21 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:21 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:21 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:21 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:29:21 user nova-compute[72418]: DEBUG nova.objects.instance [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lazy-loading 'trusted_certs' on Instance uuid e07beace-59d8-4c02-844b-1db1a6e81198 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:29:21 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:22 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.135s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:22 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk. size=1073741824 {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 18:29:22 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:22 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:22 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Cannot resize image /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk to a smaller size. {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 18:29:22 user nova-compute[72418]: DEBUG nova.objects.instance [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lazy-loading 'migration_context' on Instance uuid e07beace-59d8-4c02-844b-1db1a6e81198 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:29:22 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:25:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-115156542',display_name='tempest-AttachVolumeTestJSON-server-115156542',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-115156542',id=16,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKIZ6czeitZd68FtX30D3PEurZKgjyFnUFrxFwHkysLhaffrzQKQu80qXZZAnkUayD+bRR0naGJJ9tbYqVXNcVqacPFRuWh7mU4dCbsXBHxDBemAgqD4XDp+3Jf6xUihXw==',key_name='tempest-keypair-957533556',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:25:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='5242fb37f9664dbf9a8b50449f8dd129',ramdisk_id='',reservation_id='r-8u61z3zg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1480837700',owner_user_name='tempest-AttachVolumeTestJSON-1480837700-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:27:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='236307357ebf43bc8150f86f832260ba',uuid=e07beace-59d8-4c02-844b-1db1a6e81198,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "301d9f8c-022d-4c02-90dd-374ead3daa23", "address": "fa:16:3e:a6:38:d9", "network": {"id": "7621f03d-76ac-49da-89a8-0753bb11e329", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596253708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5242fb37f9664dbf9a8b50449f8dd129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap301d9f8c-02", "ovs_interfaceid": "301d9f8c-022d-4c02-90dd-374ead3daa23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:29:22 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Converting VIF {"id": "301d9f8c-022d-4c02-90dd-374ead3daa23", "address": "fa:16:3e:a6:38:d9", "network": {"id": "7621f03d-76ac-49da-89a8-0753bb11e329", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596253708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5242fb37f9664dbf9a8b50449f8dd129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap301d9f8c-02", "ovs_interfaceid": "301d9f8c-022d-4c02-90dd-374ead3daa23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:29:22 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:38:d9,bridge_name='br-int',has_traffic_filtering=True,id=301d9f8c-022d-4c02-90dd-374ead3daa23,network=Network(7621f03d-76ac-49da-89a8-0753bb11e329),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap301d9f8c-02') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:29:22 user nova-compute[72418]: DEBUG os_vif [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:38:d9,bridge_name='br-int',has_traffic_filtering=True,id=301d9f8c-022d-4c02-90dd-374ead3daa23,network=Network(7621f03d-76ac-49da-89a8-0753bb11e329),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap301d9f8c-02') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:29:22 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:22 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:29:22 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:29:22 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:22 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap301d9f8c-02, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:29:22 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap301d9f8c-02, col_values=(('external_ids', {'iface-id': '301d9f8c-022d-4c02-90dd-374ead3daa23', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:38:d9', 'vm-uuid': 'e07beace-59d8-4c02-844b-1db1a6e81198'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:29:22 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:22 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:29:22 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:22 user nova-compute[72418]: INFO os_vif [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:38:d9,bridge_name='br-int',has_traffic_filtering=True,id=301d9f8c-022d-4c02-90dd-374ead3daa23,network=Network(7621f03d-76ac-49da-89a8-0753bb11e329),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap301d9f8c-02')
Aug 09 18:29:22 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:23 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:23 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:23 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:23 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:23 user nova-compute[72418]: DEBUG nova.compute.manager [req-e457c6f7-fd68-46fd-9584-4c47f3d1bfb5 req-87eecae9-dad5-49e1-a5ca-0a897212dea6 service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Received event network-vif-plugged-301d9f8c-022d-4c02-90dd-374ead3daa23 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:29:23 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-e457c6f7-fd68-46fd-9584-4c47f3d1bfb5 req-87eecae9-dad5-49e1-a5ca-0a897212dea6 service nova] Acquiring lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:29:23 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-e457c6f7-fd68-46fd-9584-4c47f3d1bfb5 req-87eecae9-dad5-49e1-a5ca-0a897212dea6 service nova] Lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:29:23 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-e457c6f7-fd68-46fd-9584-4c47f3d1bfb5 req-87eecae9-dad5-49e1-a5ca-0a897212dea6 service nova] Lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:29:23 user nova-compute[72418]: DEBUG nova.compute.manager [req-e457c6f7-fd68-46fd-9584-4c47f3d1bfb5 req-87eecae9-dad5-49e1-a5ca-0a897212dea6 service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] No waiting events found dispatching network-vif-plugged-301d9f8c-022d-4c02-90dd-374ead3daa23 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:29:23 user nova-compute[72418]: WARNING nova.compute.manager [req-e457c6f7-fd68-46fd-9584-4c47f3d1bfb5 req-87eecae9-dad5-49e1-a5ca-0a897212dea6 service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Received unexpected event network-vif-plugged-301d9f8c-022d-4c02-90dd-374ead3daa23 for instance with vm_state stopped and task_state powering-on.
Aug 09 18:29:24 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:24 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:25 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605765.799754, e07beace-59d8-4c02-844b-1db1a6e81198 => Resumed> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:29:25 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] VM Resumed (Lifecycle Event)
Aug 09 18:29:25 user nova-compute[72418]: DEBUG nova.compute.manager [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Instance event wait completed in 0 seconds for  {{(pid=72418) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 18:29:25 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Instance rebooted successfully.
Aug 09 18:29:25 user nova-compute[72418]: DEBUG nova.compute.manager [None req-399a74d6-5a04-4271-a89b-29567accceb1 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:29:25 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:29:25 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:29:25 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 09 18:29:25 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605765.8008976, e07beace-59d8-4c02-844b-1db1a6e81198 => Started> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:29:25 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] VM Started (Lifecycle Event)
Aug 09 18:29:25 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:29:25 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:29:25 user nova-compute[72418]: DEBUG nova.compute.manager [req-45f08d1b-5f3a-434d-8033-d7c471e77cf3 req-43206844-cac6-4549-8839-b426b8123c92 service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Received event network-vif-plugged-301d9f8c-022d-4c02-90dd-374ead3daa23 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:29:25 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-45f08d1b-5f3a-434d-8033-d7c471e77cf3 req-43206844-cac6-4549-8839-b426b8123c92 service nova] Acquiring lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:29:25 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-45f08d1b-5f3a-434d-8033-d7c471e77cf3 req-43206844-cac6-4549-8839-b426b8123c92 service nova] Lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:29:25 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-45f08d1b-5f3a-434d-8033-d7c471e77cf3 req-43206844-cac6-4549-8839-b426b8123c92 service nova] Lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:29:25 user nova-compute[72418]: DEBUG nova.compute.manager [req-45f08d1b-5f3a-434d-8033-d7c471e77cf3 req-43206844-cac6-4549-8839-b426b8123c92 service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] No waiting events found dispatching network-vif-plugged-301d9f8c-022d-4c02-90dd-374ead3daa23 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:29:25 user nova-compute[72418]: WARNING nova.compute.manager [req-45f08d1b-5f3a-434d-8033-d7c471e77cf3 req-43206844-cac6-4549-8839-b426b8123c92 service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Received unexpected event network-vif-plugged-301d9f8c-022d-4c02-90dd-374ead3daa23 for instance with vm_state active and task_state None.
Aug 09 18:29:26 user nova-compute[72418]: DEBUG nova.compute.manager [req-864a1293-cfb2-4c1e-91af-b05e4c078f5c req-5b463ce2-c35a-4bf2-bd5a-74216ddcf15f service nova] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Received event network-changed-b2c3fa50-5615-4a58-8820-54c67c5d65bc {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:29:26 user nova-compute[72418]: DEBUG nova.compute.manager [req-864a1293-cfb2-4c1e-91af-b05e4c078f5c req-5b463ce2-c35a-4bf2-bd5a-74216ddcf15f service nova] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Refreshing instance network info cache due to event network-changed-b2c3fa50-5615-4a58-8820-54c67c5d65bc. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:29:26 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-864a1293-cfb2-4c1e-91af-b05e4c078f5c req-5b463ce2-c35a-4bf2-bd5a-74216ddcf15f service nova] Acquiring lock "refresh_cache-688f50af-0e41-4467-b2db-04ac22f62963" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:29:26 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-864a1293-cfb2-4c1e-91af-b05e4c078f5c req-5b463ce2-c35a-4bf2-bd5a-74216ddcf15f service nova] Acquired lock "refresh_cache-688f50af-0e41-4467-b2db-04ac22f62963" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:29:26 user nova-compute[72418]: DEBUG nova.network.neutron [req-864a1293-cfb2-4c1e-91af-b05e4c078f5c req-5b463ce2-c35a-4bf2-bd5a-74216ddcf15f service nova] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Refreshing network info cache for port b2c3fa50-5615-4a58-8820-54c67c5d65bc {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:29:26 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-67936593-9a3b-46a2-b2dc-84716f01d2c3 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Acquiring lock "interface-688f50af-0e41-4467-b2db-04ac22f62963-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:29:26 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-67936593-9a3b-46a2-b2dc-84716f01d2c3 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Lock "interface-688f50af-0e41-4467-b2db-04ac22f62963-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:29:26 user nova-compute[72418]: DEBUG nova.objects.instance [None req-67936593-9a3b-46a2-b2dc-84716f01d2c3 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Lazy-loading 'flavor' on Instance uuid 688f50af-0e41-4467-b2db-04ac22f62963 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:29:26 user nova-compute[72418]: DEBUG nova.network.neutron [req-864a1293-cfb2-4c1e-91af-b05e4c078f5c req-5b463ce2-c35a-4bf2-bd5a-74216ddcf15f service nova] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Updated VIF entry in instance network info cache for port b2c3fa50-5615-4a58-8820-54c67c5d65bc. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:29:26 user nova-compute[72418]: DEBUG nova.network.neutron [req-864a1293-cfb2-4c1e-91af-b05e4c078f5c req-5b463ce2-c35a-4bf2-bd5a-74216ddcf15f service nova] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Updating instance_info_cache with network_info: [{"id": "b2c3fa50-5615-4a58-8820-54c67c5d65bc", "address": "fa:16:3e:0a:9c:69", "network": {"id": "e24f7df5-d3a9-477d-997c-c145a2613ec8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1802267495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86896e6544164fda93f7bea95a751707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c3fa50-56", "ovs_interfaceid": "b2c3fa50-5615-4a58-8820-54c67c5d65bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:29:26 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-864a1293-cfb2-4c1e-91af-b05e4c078f5c req-5b463ce2-c35a-4bf2-bd5a-74216ddcf15f service nova] Releasing lock "refresh_cache-688f50af-0e41-4467-b2db-04ac22f62963" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:29:26 user nova-compute[72418]: DEBUG nova.objects.instance [None req-67936593-9a3b-46a2-b2dc-84716f01d2c3 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Lazy-loading 'pci_requests' on Instance uuid 688f50af-0e41-4467-b2db-04ac22f62963 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:29:26 user nova-compute[72418]: DEBUG nova.network.neutron [None req-67936593-9a3b-46a2-b2dc-84716f01d2c3 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] allocate_for_instance() {{(pid=72418) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 18:29:26 user nova-compute[72418]: DEBUG nova.policy [None req-67936593-9a3b-46a2-b2dc-84716f01d2c3 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'df6cd3ad06524ae59968b133efceaa4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86896e6544164fda93f7bea95a751707', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72418) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 18:29:27 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:27 user nova-compute[72418]: DEBUG nova.network.neutron [None req-67936593-9a3b-46a2-b2dc-84716f01d2c3 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Successfully created port: 2fe18f2b-8036-42df-94d0-42e747c60d1a {{(pid=72418) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 18:29:27 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:28 user nova-compute[72418]: DEBUG nova.network.neutron [None req-67936593-9a3b-46a2-b2dc-84716f01d2c3 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Successfully updated port: 2fe18f2b-8036-42df-94d0-42e747c60d1a {{(pid=72418) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 18:29:28 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-67936593-9a3b-46a2-b2dc-84716f01d2c3 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Acquiring lock "refresh_cache-688f50af-0e41-4467-b2db-04ac22f62963" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:29:28 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-67936593-9a3b-46a2-b2dc-84716f01d2c3 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Acquired lock "refresh_cache-688f50af-0e41-4467-b2db-04ac22f62963" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:29:28 user nova-compute[72418]: DEBUG nova.network.neutron [None req-67936593-9a3b-46a2-b2dc-84716f01d2c3 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:29:29 user nova-compute[72418]: DEBUG nova.compute.manager [req-8a818c6f-9504-48d6-9fa8-d0a58fc0b534 req-433707e0-64e3-4120-996a-8fd6e0861fc9 service nova] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Received event network-changed-2fe18f2b-8036-42df-94d0-42e747c60d1a {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:29:29 user nova-compute[72418]: DEBUG nova.compute.manager [req-8a818c6f-9504-48d6-9fa8-d0a58fc0b534 req-433707e0-64e3-4120-996a-8fd6e0861fc9 service nova] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Refreshing instance network info cache due to event network-changed-2fe18f2b-8036-42df-94d0-42e747c60d1a. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:29:29 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-8a818c6f-9504-48d6-9fa8-d0a58fc0b534 req-433707e0-64e3-4120-996a-8fd6e0861fc9 service nova] Acquiring lock "refresh_cache-688f50af-0e41-4467-b2db-04ac22f62963" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:29:29 user nova-compute[72418]: DEBUG nova.network.neutron [None req-67936593-9a3b-46a2-b2dc-84716f01d2c3 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Updating instance_info_cache with network_info: [{"id": "b2c3fa50-5615-4a58-8820-54c67c5d65bc", "address": "fa:16:3e:0a:9c:69", "network": {"id": "e24f7df5-d3a9-477d-997c-c145a2613ec8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1802267495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86896e6544164fda93f7bea95a751707", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c3fa50-56", "ovs_interfaceid": "b2c3fa50-5615-4a58-8820-54c67c5d65bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2fe18f2b-8036-42df-94d0-42e747c60d1a", "address": "fa:16:3e:15:c3:cd", "network": {"id": "77cad7ee-baee-4e0e-b735-9ac6302d9c3b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1355806010", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "86896e6544164fda93f7bea95a751707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fe18f2b-80", "ovs_interfaceid": "2fe18f2b-8036-42df-94d0-42e747c60d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:29:29 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-67936593-9a3b-46a2-b2dc-84716f01d2c3 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Releasing lock "refresh_cache-688f50af-0e41-4467-b2db-04ac22f62963" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:29:29 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-8a818c6f-9504-48d6-9fa8-d0a58fc0b534 req-433707e0-64e3-4120-996a-8fd6e0861fc9 service nova] Acquired lock "refresh_cache-688f50af-0e41-4467-b2db-04ac22f62963" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:29:29 user nova-compute[72418]: DEBUG nova.network.neutron [req-8a818c6f-9504-48d6-9fa8-d0a58fc0b534 req-433707e0-64e3-4120-996a-8fd6e0861fc9 service nova] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Refreshing network info cache for port 2fe18f2b-8036-42df-94d0-42e747c60d1a {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:29:29 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-67936593-9a3b-46a2-b2dc-84716f01d2c3 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T18:27:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-630623237',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-630623237',id=20,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJchtztQL/UH2D7W5ks5SFjnLeiOZKRpefilUR0gjk7AuwJAWWS/gJOgdgu+Tp4jMu5wIaL/uSL50sh+6WeG1BBlMsFAUgEPx6/v6KmgLX0CBGzXIbAnMWDK0rX8sqetTQ==',key_name='tempest-keypair-267340570',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:27:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='86896e6544164fda93f7bea95a751707',ramdisk_id='',reservation_id='r-fo0cn966',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1428601923',owner_user_name='tempest-TaggedAttachmentsTest-1428601923-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:27:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df6cd3ad06524ae59968b133efceaa4c',uuid=688f50af-0e41-4467-b2db-04ac22f62963,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2fe18f2b-8036-42df-94d0-42e747c60d1a", "address": "fa:16:3e:15:c3:cd", "network": {"id": "77cad7ee-baee-4e0e-b735-9ac6302d9c3b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1355806010", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "86896e6544164fda93f7bea95a751707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fe18f2b-80", "ovs_interfaceid": "2fe18f2b-8036-42df-94d0-42e747c60d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:29:29 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-67936593-9a3b-46a2-b2dc-84716f01d2c3 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Converting VIF {"id": "2fe18f2b-8036-42df-94d0-42e747c60d1a", "address": "fa:16:3e:15:c3:cd", "network": {"id": "77cad7ee-baee-4e0e-b735-9ac6302d9c3b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1355806010", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "86896e6544164fda93f7bea95a751707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fe18f2b-80", "ovs_interfaceid": "2fe18f2b-8036-42df-94d0-42e747c60d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:29:29 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-67936593-9a3b-46a2-b2dc-84716f01d2c3 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:c3:cd,bridge_name='br-int',has_traffic_filtering=True,id=2fe18f2b-8036-42df-94d0-42e747c60d1a,network=Network(77cad7ee-baee-4e0e-b735-9ac6302d9c3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fe18f2b-80') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:29:29 user nova-compute[72418]: DEBUG os_vif [None req-67936593-9a3b-46a2-b2dc-84716f01d2c3 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:c3:cd,bridge_name='br-int',has_traffic_filtering=True,id=2fe18f2b-8036-42df-94d0-42e747c60d1a,network=Network(77cad7ee-baee-4e0e-b735-9ac6302d9c3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fe18f2b-80') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:29:29 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:29 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:29:29 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:29:29 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:29 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2fe18f2b-80, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:29:29 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2fe18f2b-80, col_values=(('external_ids', {'iface-id': '2fe18f2b-8036-42df-94d0-42e747c60d1a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:c3:cd', 'vm-uuid': '688f50af-0e41-4467-b2db-04ac22f62963'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:29:29 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:29 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:29:29 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:29 user nova-compute[72418]: INFO os_vif [None req-67936593-9a3b-46a2-b2dc-84716f01d2c3 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:c3:cd,bridge_name='br-int',has_traffic_filtering=True,id=2fe18f2b-8036-42df-94d0-42e747c60d1a,network=Network(77cad7ee-baee-4e0e-b735-9ac6302d9c3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fe18f2b-80')
Aug 09 18:29:29 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-67936593-9a3b-46a2-b2dc-84716f01d2c3 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T18:27:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-630623237',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-630623237',id=20,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJchtztQL/UH2D7W5ks5SFjnLeiOZKRpefilUR0gjk7AuwJAWWS/gJOgdgu+Tp4jMu5wIaL/uSL50sh+6WeG1BBlMsFAUgEPx6/v6KmgLX0CBGzXIbAnMWDK0rX8sqetTQ==',key_name='tempest-keypair-267340570',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:27:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='86896e6544164fda93f7bea95a751707',ramdisk_id='',reservation_id='r-fo0cn966',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1428601923',owner_user_name='tempest-TaggedAttachmentsTest-1428601923-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:27:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df6cd3ad06524ae59968b133efceaa4c',uuid=688f50af-0e41-4467-b2db-04ac22f62963,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2fe18f2b-8036-42df-94d0-42e747c60d1a", "address": "fa:16:3e:15:c3:cd", "network": {"id": "77cad7ee-baee-4e0e-b735-9ac6302d9c3b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1355806010", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "86896e6544164fda93f7bea95a751707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fe18f2b-80", "ovs_interfaceid": "2fe18f2b-8036-42df-94d0-42e747c60d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:29:29 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-67936593-9a3b-46a2-b2dc-84716f01d2c3 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Converting VIF {"id": "2fe18f2b-8036-42df-94d0-42e747c60d1a", "address": "fa:16:3e:15:c3:cd", "network": {"id": "77cad7ee-baee-4e0e-b735-9ac6302d9c3b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1355806010", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "86896e6544164fda93f7bea95a751707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fe18f2b-80", "ovs_interfaceid": "2fe18f2b-8036-42df-94d0-42e747c60d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:29:29 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-67936593-9a3b-46a2-b2dc-84716f01d2c3 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:c3:cd,bridge_name='br-int',has_traffic_filtering=True,id=2fe18f2b-8036-42df-94d0-42e747c60d1a,network=Network(77cad7ee-baee-4e0e-b735-9ac6302d9c3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fe18f2b-80') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:29:29 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-67936593-9a3b-46a2-b2dc-84716f01d2c3 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] attach device xml: <interface type="ethernet">
Aug 09 18:29:29 user nova-compute[72418]:   <mac address="fa:16:3e:15:c3:cd"/>
Aug 09 18:29:29 user nova-compute[72418]:   <model type="virtio"/>
Aug 09 18:29:29 user nova-compute[72418]:   <mtu size="1442"/>
Aug 09 18:29:29 user nova-compute[72418]:   <target dev="tap2fe18f2b-80"/>
Aug 09 18:29:29 user nova-compute[72418]: </interface>
Aug 09 18:29:29 user nova-compute[72418]:  {{(pid=72418) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 18:29:29 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:29 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:29 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:30 user nova-compute[72418]: DEBUG nova.network.neutron [req-8a818c6f-9504-48d6-9fa8-d0a58fc0b534 req-433707e0-64e3-4120-996a-8fd6e0861fc9 service nova] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Updated VIF entry in instance network info cache for port 2fe18f2b-8036-42df-94d0-42e747c60d1a. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:29:30 user nova-compute[72418]: DEBUG nova.network.neutron [req-8a818c6f-9504-48d6-9fa8-d0a58fc0b534 req-433707e0-64e3-4120-996a-8fd6e0861fc9 service nova] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Updating instance_info_cache with network_info: [{"id": "b2c3fa50-5615-4a58-8820-54c67c5d65bc", "address": "fa:16:3e:0a:9c:69", "network": {"id": "e24f7df5-d3a9-477d-997c-c145a2613ec8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1802267495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86896e6544164fda93f7bea95a751707", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c3fa50-56", "ovs_interfaceid": "b2c3fa50-5615-4a58-8820-54c67c5d65bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2fe18f2b-8036-42df-94d0-42e747c60d1a", "address": "fa:16:3e:15:c3:cd", "network": {"id": "77cad7ee-baee-4e0e-b735-9ac6302d9c3b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1355806010", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "86896e6544164fda93f7bea95a751707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fe18f2b-80", "ovs_interfaceid": "2fe18f2b-8036-42df-94d0-42e747c60d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:29:30 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-67936593-9a3b-46a2-b2dc-84716f01d2c3 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:29:30 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-67936593-9a3b-46a2-b2dc-84716f01d2c3 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] No BDM found with device name hda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:29:30 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-67936593-9a3b-46a2-b2dc-84716f01d2c3 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] No VIF found with MAC fa:16:3e:0a:9c:69, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:29:30 user nova-compute[72418]: DEBUG nova.compute.manager [req-45a68189-6bb5-4f8d-adf7-905b73509907 req-01c54426-3237-4004-95fb-9da8321b37ce service nova] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Received event network-vif-plugged-2fe18f2b-8036-42df-94d0-42e747c60d1a {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:29:30 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-45a68189-6bb5-4f8d-adf7-905b73509907 req-01c54426-3237-4004-95fb-9da8321b37ce service nova] Acquiring lock "688f50af-0e41-4467-b2db-04ac22f62963-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:29:30 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-45a68189-6bb5-4f8d-adf7-905b73509907 req-01c54426-3237-4004-95fb-9da8321b37ce service nova] Lock "688f50af-0e41-4467-b2db-04ac22f62963-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:29:30 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-45a68189-6bb5-4f8d-adf7-905b73509907 req-01c54426-3237-4004-95fb-9da8321b37ce service nova] Lock "688f50af-0e41-4467-b2db-04ac22f62963-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:29:30 user nova-compute[72418]: DEBUG nova.compute.manager [req-45a68189-6bb5-4f8d-adf7-905b73509907 req-01c54426-3237-4004-95fb-9da8321b37ce service nova] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] No waiting events found dispatching network-vif-plugged-2fe18f2b-8036-42df-94d0-42e747c60d1a {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:29:30 user nova-compute[72418]: WARNING nova.compute.manager [req-45a68189-6bb5-4f8d-adf7-905b73509907 req-01c54426-3237-4004-95fb-9da8321b37ce service nova] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Received unexpected event network-vif-plugged-2fe18f2b-8036-42df-94d0-42e747c60d1a for instance with vm_state active and task_state None.
Aug 09 18:29:30 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-8a818c6f-9504-48d6-9fa8-d0a58fc0b534 req-433707e0-64e3-4120-996a-8fd6e0861fc9 service nova] Releasing lock "refresh_cache-688f50af-0e41-4467-b2db-04ac22f62963" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:29:30 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-67936593-9a3b-46a2-b2dc-84716f01d2c3 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:29:30 user nova-compute[72418]:   <nova:package version="0.0.0"/>
Aug 09 18:29:30 user nova-compute[72418]:   <nova:name>tempest-device-tagging-server-630623237</nova:name>
Aug 09 18:29:30 user nova-compute[72418]:   <nova:creationTime>2023-08-09 18:29:30</nova:creationTime>
Aug 09 18:29:30 user nova-compute[72418]:   <nova:flavor name="m1.tiny">
Aug 09 18:29:30 user nova-compute[72418]:     <nova:memory>512</nova:memory>
Aug 09 18:29:30 user nova-compute[72418]:     <nova:disk>1</nova:disk>
Aug 09 18:29:30 user nova-compute[72418]:     <nova:swap>0</nova:swap>
Aug 09 18:29:30 user nova-compute[72418]:     <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:29:30 user nova-compute[72418]:     <nova:vcpus>1</nova:vcpus>
Aug 09 18:29:30 user nova-compute[72418]:   </nova:flavor>
Aug 09 18:29:30 user nova-compute[72418]:   <nova:owner>
Aug 09 18:29:30 user nova-compute[72418]:     <nova:user uuid="df6cd3ad06524ae59968b133efceaa4c">tempest-TaggedAttachmentsTest-1428601923-project-member</nova:user>
Aug 09 18:29:30 user nova-compute[72418]:     <nova:project uuid="86896e6544164fda93f7bea95a751707">tempest-TaggedAttachmentsTest-1428601923</nova:project>
Aug 09 18:29:30 user nova-compute[72418]:   </nova:owner>
Aug 09 18:29:30 user nova-compute[72418]:   <nova:root type="image" uuid="8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e"/>
Aug 09 18:29:30 user nova-compute[72418]:   <nova:ports>
Aug 09 18:29:30 user nova-compute[72418]:     <nova:port uuid="b2c3fa50-5615-4a58-8820-54c67c5d65bc">
Aug 09 18:29:30 user nova-compute[72418]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 09 18:29:30 user nova-compute[72418]:     </nova:port>
Aug 09 18:29:30 user nova-compute[72418]:     <nova:port uuid="2fe18f2b-8036-42df-94d0-42e747c60d1a">
Aug 09 18:29:30 user nova-compute[72418]:       <nova:ip type="fixed" address="10.10.10.85" ipVersion="4"/>
Aug 09 18:29:30 user nova-compute[72418]:     </nova:port>
Aug 09 18:29:30 user nova-compute[72418]:   </nova:ports>
Aug 09 18:29:30 user nova-compute[72418]: </nova:instance>
Aug 09 18:29:30 user nova-compute[72418]:  {{(pid=72418) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 09 18:29:30 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-67936593-9a3b-46a2-b2dc-84716f01d2c3 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Lock "interface-688f50af-0e41-4467-b2db-04ac22f62963-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.741s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:29:30 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:30 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:30 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:30 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:30 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d08d11c0-b5b1-4063-8916-f43f83f32f96 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Acquiring lock "688f50af-0e41-4467-b2db-04ac22f62963" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:29:30 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d08d11c0-b5b1-4063-8916-f43f83f32f96 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Lock "688f50af-0e41-4467-b2db-04ac22f62963" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:29:30 user nova-compute[72418]: DEBUG nova.objects.instance [None req-d08d11c0-b5b1-4063-8916-f43f83f32f96 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Lazy-loading 'flavor' on Instance uuid 688f50af-0e41-4467-b2db-04ac22f62963 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:29:30 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d08d11c0-b5b1-4063-8916-f43f83f32f96 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Lock "688f50af-0e41-4467-b2db-04ac22f62963" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:29:30 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d08d11c0-b5b1-4063-8916-f43f83f32f96 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Acquiring lock "688f50af-0e41-4467-b2db-04ac22f62963" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:29:30 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d08d11c0-b5b1-4063-8916-f43f83f32f96 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Lock "688f50af-0e41-4467-b2db-04ac22f62963" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:29:30 user nova-compute[72418]: INFO nova.compute.manager [None req-d08d11c0-b5b1-4063-8916-f43f83f32f96 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Attaching volume cd486fb9-c964-42ce-b17e-69f8ac2986a0 to /dev/vdb
Aug 09 18:29:30 user nova-compute[72418]: DEBUG os_brick.utils [None req-d08d11c0-b5b1-4063-8916-f43f83f32f96 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:29:30 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:30 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:30 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e54021-371e-46cd-b317-43805dd9b378]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ad56b243ad71\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:29:30 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:30 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:30 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e51de1-9ce8-45fc-b96d-366c4a444460]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:29:30 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:30 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:30 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10dc1aa-2377-4506-be28-77a2d4249421]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:29:30 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[255eedb5-bb8e-4489-aa30-e65ba738de71]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:29:30 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-d08d11c0-b5b1-4063-8916-f43f83f32f96 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Running cmd (subprocess): nvme version {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-d08d11c0-b5b1-4063-8916-f43f83f32f96 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] 'nvme version' failed. Not Retrying. {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:29:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d08d11c0-b5b1-4063-8916-f43f83f32f96 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] nvme not present on system {{(pid=72418) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 18:29:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:29:31 user nova-compute[72418]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 18:29:31 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e67668-9052-4020-b346-3f626ce29fe2]: (4, '') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:29:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-d08d11c0-b5b1-4063-8916-f43f83f32f96 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72418) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 18:29:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-d08d11c0-b5b1-4063-8916-f43f83f32f96 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 18:29:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-d08d11c0-b5b1-4063-8916-f43f83f32f96 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] LIGHTOS: no hostnqn found. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 18:29:31 user nova-compute[72418]: DEBUG os_brick.utils [None req-d08d11c0-b5b1-4063-8916-f43f83f32f96 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ad56b243ad71', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:29:31 user nova-compute[72418]: DEBUG nova.virt.block_device [None req-d08d11c0-b5b1-4063-8916-f43f83f32f96 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Updating existing volume attachment record: 982a69f1-6307-42d6-a08d-665909086254 {{(pid=72418) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 18:29:31 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Acquiring lock "046617cf-13e5-44cf-9981-c1ae4ffd3851" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:29:31 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "046617cf-13e5-44cf-9981-c1ae4ffd3851" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:29:31 user nova-compute[72418]: DEBUG nova.compute.manager [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Starting instance... {{(pid=72418) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 18:29:31 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:29:31 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:29:31 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72418) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 18:29:31 user nova-compute[72418]: INFO nova.compute.claims [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Claim successful on node user
Aug 09 18:29:31 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:29:31 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:29:31 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.404s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:29:31 user nova-compute[72418]: DEBUG nova.compute.manager [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Start building networks asynchronously for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 18:29:31 user nova-compute[72418]: DEBUG nova.compute.manager [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Allocating IP information in the background. {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 18:29:31 user nova-compute[72418]: DEBUG nova.network.neutron [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] allocate_for_instance() {{(pid=72418) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 18:29:31 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 18:29:31 user nova-compute[72418]: DEBUG nova.compute.manager [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Start building block device mappings for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 18:29:31 user nova-compute[72418]: DEBUG nova.policy [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '93e127bc79ec49fa813408f36b639504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee663228cbc483896e4fd409c4aa135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72418) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 18:29:31 user nova-compute[72418]: DEBUG nova.compute.manager [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Start spawning the instance on the hypervisor. {{(pid=72418) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 18:29:31 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Creating instance directory {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 18:29:31 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Creating image(s)
Aug 09 18:29:31 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Acquiring lock "/opt/stack/data/nova/instances/046617cf-13e5-44cf-9981-c1ae4ffd3851/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:29:31 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "/opt/stack/data/nova/instances/046617cf-13e5-44cf-9981-c1ae4ffd3851/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:29:31 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "/opt/stack/data/nova/instances/046617cf-13e5-44cf-9981-c1ae4ffd3851/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:29:32 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:32 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.143s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:32 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Acquiring lock "458773cfa7230b717e41c60277832e9f83806d71" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:29:32 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:29:32 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:32 user nova-compute[72418]: DEBUG nova.compute.manager [req-f8b45f7c-649b-4774-867a-ca1481b4ccab req-48594e22-2d03-4a0a-9a9a-35ea3516f678 service nova] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Received event network-vif-plugged-2fe18f2b-8036-42df-94d0-42e747c60d1a {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:29:32 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-f8b45f7c-649b-4774-867a-ca1481b4ccab req-48594e22-2d03-4a0a-9a9a-35ea3516f678 service nova] Acquiring lock "688f50af-0e41-4467-b2db-04ac22f62963-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:29:32 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-f8b45f7c-649b-4774-867a-ca1481b4ccab req-48594e22-2d03-4a0a-9a9a-35ea3516f678 service nova] Lock "688f50af-0e41-4467-b2db-04ac22f62963-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:29:32 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-f8b45f7c-649b-4774-867a-ca1481b4ccab req-48594e22-2d03-4a0a-9a9a-35ea3516f678 service nova] Lock "688f50af-0e41-4467-b2db-04ac22f62963-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:29:32 user nova-compute[72418]: DEBUG nova.compute.manager [req-f8b45f7c-649b-4774-867a-ca1481b4ccab req-48594e22-2d03-4a0a-9a9a-35ea3516f678 service nova] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] No waiting events found dispatching network-vif-plugged-2fe18f2b-8036-42df-94d0-42e747c60d1a {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:29:32 user nova-compute[72418]: WARNING nova.compute.manager [req-f8b45f7c-649b-4774-867a-ca1481b4ccab req-48594e22-2d03-4a0a-9a9a-35ea3516f678 service nova] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Received unexpected event network-vif-plugged-2fe18f2b-8036-42df-94d0-42e747c60d1a for instance with vm_state active and task_state None.
Aug 09 18:29:32 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.164s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:32 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/046617cf-13e5-44cf-9981-c1ae4ffd3851/disk 1073741824 {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:32 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/046617cf-13e5-44cf-9981-c1ae4ffd3851/disk 1073741824" returned: 0 in 0.050s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:32 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:29:32 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:32 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.140s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:32 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Checking if we can resize image /opt/stack/data/nova/instances/046617cf-13e5-44cf-9981-c1ae4ffd3851/disk. size=1073741824 {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 18:29:32 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/046617cf-13e5-44cf-9981-c1ae4ffd3851/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:32 user nova-compute[72418]: DEBUG nova.network.neutron [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Successfully created port: 3054c1b9-3a7c-4caa-ab24-f3ed0db15b64 {{(pid=72418) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 18:29:32 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:32 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/046617cf-13e5-44cf-9981-c1ae4ffd3851/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:32 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Cannot resize image /opt/stack/data/nova/instances/046617cf-13e5-44cf-9981-c1ae4ffd3851/disk to a smaller size. {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 18:29:32 user nova-compute[72418]: DEBUG nova.objects.instance [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lazy-loading 'migration_context' on Instance uuid 046617cf-13e5-44cf-9981-c1ae4ffd3851 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:29:32 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Created local disks {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 18:29:32 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Ensure instance console log exists: /opt/stack/data/nova/instances/046617cf-13e5-44cf-9981-c1ae4ffd3851/console.log {{(pid=72418) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 18:29:32 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:29:32 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:29:32 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:29:33 user nova-compute[72418]: DEBUG nova.network.neutron [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Successfully updated port: 3054c1b9-3a7c-4caa-ab24-f3ed0db15b64 {{(pid=72418) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 18:29:33 user nova-compute[72418]: DEBUG nova.compute.manager [req-447fc9df-faa2-4626-ac26-2ed84ae47b70 req-5caa4d0a-d612-4b81-862a-188802d52986 service nova] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Received event network-changed-3054c1b9-3a7c-4caa-ab24-f3ed0db15b64 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:29:33 user nova-compute[72418]: DEBUG nova.compute.manager [req-447fc9df-faa2-4626-ac26-2ed84ae47b70 req-5caa4d0a-d612-4b81-862a-188802d52986 service nova] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Refreshing instance network info cache due to event network-changed-3054c1b9-3a7c-4caa-ab24-f3ed0db15b64. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:29:33 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-447fc9df-faa2-4626-ac26-2ed84ae47b70 req-5caa4d0a-d612-4b81-862a-188802d52986 service nova] Acquiring lock "refresh_cache-046617cf-13e5-44cf-9981-c1ae4ffd3851" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:29:33 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-447fc9df-faa2-4626-ac26-2ed84ae47b70 req-5caa4d0a-d612-4b81-862a-188802d52986 service nova] Acquired lock "refresh_cache-046617cf-13e5-44cf-9981-c1ae4ffd3851" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:29:33 user nova-compute[72418]: DEBUG nova.network.neutron [req-447fc9df-faa2-4626-ac26-2ed84ae47b70 req-5caa4d0a-d612-4b81-862a-188802d52986 service nova] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Refreshing network info cache for port 3054c1b9-3a7c-4caa-ab24-f3ed0db15b64 {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:29:33 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Acquiring lock "refresh_cache-046617cf-13e5-44cf-9981-c1ae4ffd3851" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:29:33 user nova-compute[72418]: DEBUG nova.network.neutron [req-447fc9df-faa2-4626-ac26-2ed84ae47b70 req-5caa4d0a-d612-4b81-862a-188802d52986 service nova] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Instance cache missing network info. {{(pid=72418) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 18:29:33 user nova-compute[72418]: DEBUG nova.network.neutron [req-447fc9df-faa2-4626-ac26-2ed84ae47b70 req-5caa4d0a-d612-4b81-862a-188802d52986 service nova] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:29:33 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-447fc9df-faa2-4626-ac26-2ed84ae47b70 req-5caa4d0a-d612-4b81-862a-188802d52986 service nova] Releasing lock "refresh_cache-046617cf-13e5-44cf-9981-c1ae4ffd3851" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:29:33 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Acquired lock "refresh_cache-046617cf-13e5-44cf-9981-c1ae4ffd3851" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:29:33 user nova-compute[72418]: DEBUG nova.network.neutron [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:29:33 user nova-compute[72418]: DEBUG nova.network.neutron [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Instance cache missing network info. {{(pid=72418) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 18:29:33 user nova-compute[72418]: DEBUG nova.network.neutron [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Updating instance_info_cache with network_info: [{"id": "3054c1b9-3a7c-4caa-ab24-f3ed0db15b64", "address": "fa:16:3e:ef:ad:af", "network": {"id": "34f771ea-9846-4f27-94a0-c00494d053ab", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-973491744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eee663228cbc483896e4fd409c4aa135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3054c1b9-3a", "ovs_interfaceid": "3054c1b9-3a7c-4caa-ab24-f3ed0db15b64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:29:34 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Releasing lock "refresh_cache-046617cf-13e5-44cf-9981-c1ae4ffd3851" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:29:34 user nova-compute[72418]: DEBUG nova.compute.manager [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Instance network_info: |[{"id": "3054c1b9-3a7c-4caa-ab24-f3ed0db15b64", "address": "fa:16:3e:ef:ad:af", "network": {"id": "34f771ea-9846-4f27-94a0-c00494d053ab", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-973491744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eee663228cbc483896e4fd409c4aa135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3054c1b9-3a", "ovs_interfaceid": "3054c1b9-3a7c-4caa-ab24-f3ed0db15b64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 18:29:34 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Start _get_guest_xml network_info=[{"id": "3054c1b9-3a7c-4caa-ab24-f3ed0db15b64", "address": "fa:16:3e:ef:ad:af", "network": {"id": "34f771ea-9846-4f27-94a0-c00494d053ab", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-973491744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eee663228cbc483896e4fd409c4aa135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3054c1b9-3a", "ovs_interfaceid": "3054c1b9-3a7c-4caa-ab24-f3ed0db15b64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 18:29:34 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:29:34 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:29:34 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 18:29:34 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] CPU controller missing on host. {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 18:29:34 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 18:29:34 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] CPU controller found on host. {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 18:29:34 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72418) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 18:29:34 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T18:17:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 18:29:34 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Flavor limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 18:29:34 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Image limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 18:29:34 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Flavor pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 18:29:34 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Image pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 18:29:34 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 18:29:34 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 18:29:34 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 18:29:34 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Got 1 possible topologies {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 18:29:34 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 18:29:34 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 18:29:34 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:29:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-588253466',display_name='tempest-VolumesSnapshotTestJSON-instance-588253466',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-588253466',id=21,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMgDmybcWdT0fCyai+hta3TKdXHlkQSTuMms0ZJ6zrHtMj680vz4R0kkxkFjGAMm6CMUfnYqzor+36YijmElTc834NJPwrA6CS8uc+SGiYZsVZui+dGFZTPvBwXdVdYnBA==',key_name='tempest-keypair-543096935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eee663228cbc483896e4fd409c4aa135',ramdisk_id='',reservation_id='r-r1t7ifog',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1926046841',owner_user_name='tempest-VolumesSnapshotTestJSON-1926046841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:29:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93e127bc79ec49fa813408f36b639504',uuid=046617cf-13e5-44cf-9981-c1ae4ffd3851,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3054c1b9-3a7c-4caa-ab24-f3ed0db15b64", "address": "fa:16:3e:ef:ad:af", "network": {"id": "34f771ea-9846-4f27-94a0-c00494d053ab", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-973491744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eee663228cbc483896e4fd409c4aa135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3054c1b9-3a", "ovs_interfaceid": "3054c1b9-3a7c-4caa-ab24-f3ed0db15b64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:29:34 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Converting VIF {"id": "3054c1b9-3a7c-4caa-ab24-f3ed0db15b64", "address": "fa:16:3e:ef:ad:af", "network": {"id": "34f771ea-9846-4f27-94a0-c00494d053ab", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-973491744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eee663228cbc483896e4fd409c4aa135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3054c1b9-3a", "ovs_interfaceid": "3054c1b9-3a7c-4caa-ab24-f3ed0db15b64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:29:34 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:ad:af,bridge_name='br-int',has_traffic_filtering=True,id=3054c1b9-3a7c-4caa-ab24-f3ed0db15b64,network=Network(34f771ea-9846-4f27-94a0-c00494d053ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3054c1b9-3a') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:29:34 user nova-compute[72418]: DEBUG nova.objects.instance [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lazy-loading 'pci_devices' on Instance uuid 046617cf-13e5-44cf-9981-c1ae4ffd3851 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:29:34 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] End _get_guest_xml xml=<domain type="kvm">
Aug 09 18:29:34 user nova-compute[72418]:   <uuid>046617cf-13e5-44cf-9981-c1ae4ffd3851</uuid>
Aug 09 18:29:34 user nova-compute[72418]:   <name>instance-00000015</name>
Aug 09 18:29:34 user nova-compute[72418]:   <memory>524288</memory>
Aug 09 18:29:34 user nova-compute[72418]:   <vcpu>1</vcpu>
Aug 09 18:29:34 user nova-compute[72418]:   <metadata>
Aug 09 18:29:34 user nova-compute[72418]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:29:34 user nova-compute[72418]:       <nova:package version="0.0.0"/>
Aug 09 18:29:34 user nova-compute[72418]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-588253466</nova:name>
Aug 09 18:29:34 user nova-compute[72418]:       <nova:creationTime>2023-08-09 18:29:34</nova:creationTime>
Aug 09 18:29:34 user nova-compute[72418]:       <nova:flavor name="m1.tiny">
Aug 09 18:29:34 user nova-compute[72418]:         <nova:memory>512</nova:memory>
Aug 09 18:29:34 user nova-compute[72418]:         <nova:disk>1</nova:disk>
Aug 09 18:29:34 user nova-compute[72418]:         <nova:swap>0</nova:swap>
Aug 09 18:29:34 user nova-compute[72418]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:29:34 user nova-compute[72418]:         <nova:vcpus>1</nova:vcpus>
Aug 09 18:29:34 user nova-compute[72418]:       </nova:flavor>
Aug 09 18:29:34 user nova-compute[72418]:       <nova:owner>
Aug 09 18:29:34 user nova-compute[72418]:         <nova:user uuid="93e127bc79ec49fa813408f36b639504">tempest-VolumesSnapshotTestJSON-1926046841-project-member</nova:user>
Aug 09 18:29:34 user nova-compute[72418]:         <nova:project uuid="eee663228cbc483896e4fd409c4aa135">tempest-VolumesSnapshotTestJSON-1926046841</nova:project>
Aug 09 18:29:34 user nova-compute[72418]:       </nova:owner>
Aug 09 18:29:34 user nova-compute[72418]:       <nova:root type="image" uuid="8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e"/>
Aug 09 18:29:34 user nova-compute[72418]:       <nova:ports>
Aug 09 18:29:34 user nova-compute[72418]:         <nova:port uuid="3054c1b9-3a7c-4caa-ab24-f3ed0db15b64">
Aug 09 18:29:34 user nova-compute[72418]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 09 18:29:34 user nova-compute[72418]:         </nova:port>
Aug 09 18:29:34 user nova-compute[72418]:       </nova:ports>
Aug 09 18:29:34 user nova-compute[72418]:     </nova:instance>
Aug 09 18:29:34 user nova-compute[72418]:   </metadata>
Aug 09 18:29:34 user nova-compute[72418]:   <sysinfo type="smbios">
Aug 09 18:29:34 user nova-compute[72418]:     <system>
Aug 09 18:29:34 user nova-compute[72418]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 18:29:34 user nova-compute[72418]:       <entry name="product">OpenStack Nova</entry>
Aug 09 18:29:34 user nova-compute[72418]:       <entry name="version">0.0.0</entry>
Aug 09 18:29:34 user nova-compute[72418]:       <entry name="serial">046617cf-13e5-44cf-9981-c1ae4ffd3851</entry>
Aug 09 18:29:34 user nova-compute[72418]:       <entry name="uuid">046617cf-13e5-44cf-9981-c1ae4ffd3851</entry>
Aug 09 18:29:34 user nova-compute[72418]:       <entry name="family">Virtual Machine</entry>
Aug 09 18:29:34 user nova-compute[72418]:     </system>
Aug 09 18:29:34 user nova-compute[72418]:   </sysinfo>
Aug 09 18:29:34 user nova-compute[72418]:   <os>
Aug 09 18:29:34 user nova-compute[72418]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 18:29:34 user nova-compute[72418]:     <boot dev="hd"/>
Aug 09 18:29:34 user nova-compute[72418]:     <smbios mode="sysinfo"/>
Aug 09 18:29:34 user nova-compute[72418]:   </os>
Aug 09 18:29:34 user nova-compute[72418]:   <features>
Aug 09 18:29:34 user nova-compute[72418]:     <acpi/>
Aug 09 18:29:34 user nova-compute[72418]:     <apic/>
Aug 09 18:29:34 user nova-compute[72418]:     <vmcoreinfo/>
Aug 09 18:29:34 user nova-compute[72418]:   </features>
Aug 09 18:29:34 user nova-compute[72418]:   <clock offset="utc">
Aug 09 18:29:34 user nova-compute[72418]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 18:29:34 user nova-compute[72418]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 18:29:34 user nova-compute[72418]:     <timer name="hpet" present="no"/>
Aug 09 18:29:34 user nova-compute[72418]:   </clock>
Aug 09 18:29:34 user nova-compute[72418]:   <cpu mode="custom" match="exact">
Aug 09 18:29:34 user nova-compute[72418]:     <model>Nehalem</model>
Aug 09 18:29:34 user nova-compute[72418]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 18:29:34 user nova-compute[72418]:   </cpu>
Aug 09 18:29:34 user nova-compute[72418]:   <devices>
Aug 09 18:29:34 user nova-compute[72418]:     <disk type="file" device="disk">
Aug 09 18:29:34 user nova-compute[72418]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 18:29:34 user nova-compute[72418]:       <source file="/opt/stack/data/nova/instances/046617cf-13e5-44cf-9981-c1ae4ffd3851/disk"/>
Aug 09 18:29:34 user nova-compute[72418]:       <target dev="vda" bus="virtio"/>
Aug 09 18:29:34 user nova-compute[72418]:     </disk>
Aug 09 18:29:34 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:29:34 user nova-compute[72418]:       <mac address="fa:16:3e:ef:ad:af"/>
Aug 09 18:29:34 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:29:34 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:29:34 user nova-compute[72418]:       <target dev="tap3054c1b9-3a"/>
Aug 09 18:29:34 user nova-compute[72418]:     </interface>
Aug 09 18:29:34 user nova-compute[72418]:     <serial type="pty">
Aug 09 18:29:34 user nova-compute[72418]:       <log file="/opt/stack/data/nova/instances/046617cf-13e5-44cf-9981-c1ae4ffd3851/console.log" append="off"/>
Aug 09 18:29:34 user nova-compute[72418]:     </serial>
Aug 09 18:29:34 user nova-compute[72418]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 18:29:34 user nova-compute[72418]:     <video>
Aug 09 18:29:34 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:29:34 user nova-compute[72418]:     </video>
Aug 09 18:29:34 user nova-compute[72418]:     <rng model="virtio">
Aug 09 18:29:34 user nova-compute[72418]:       <backend model="random">/dev/urandom</backend>
Aug 09 18:29:34 user nova-compute[72418]:     </rng>
Aug 09 18:29:34 user nova-compute[72418]:     <controller type="usb" index="0" model="none"/>
Aug 09 18:29:34 user nova-compute[72418]:     <memballoon model="virtio">
Aug 09 18:29:34 user nova-compute[72418]:       <stats period="10"/>
Aug 09 18:29:34 user nova-compute[72418]:     </memballoon>
Aug 09 18:29:34 user nova-compute[72418]:   </devices>
Aug 09 18:29:34 user nova-compute[72418]: </domain>
Aug 09 18:29:34 user nova-compute[72418]:  {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 18:29:34 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:29:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-588253466',display_name='tempest-VolumesSnapshotTestJSON-instance-588253466',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-588253466',id=21,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMgDmybcWdT0fCyai+hta3TKdXHlkQSTuMms0ZJ6zrHtMj680vz4R0kkxkFjGAMm6CMUfnYqzor+36YijmElTc834NJPwrA6CS8uc+SGiYZsVZui+dGFZTPvBwXdVdYnBA==',key_name='tempest-keypair-543096935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eee663228cbc483896e4fd409c4aa135',ramdisk_id='',reservation_id='r-r1t7ifog',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1926046841',owner_user_name='tempest-VolumesSnapshotTestJSON-1926046841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:29:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93e127bc79ec49fa813408f36b639504',uuid=046617cf-13e5-44cf-9981-c1ae4ffd3851,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3054c1b9-3a7c-4caa-ab24-f3ed0db15b64", "address": "fa:16:3e:ef:ad:af", "network": {"id": "34f771ea-9846-4f27-94a0-c00494d053ab", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-973491744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eee663228cbc483896e4fd409c4aa135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3054c1b9-3a", "ovs_interfaceid": "3054c1b9-3a7c-4caa-ab24-f3ed0db15b64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:29:34 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Converting VIF {"id": "3054c1b9-3a7c-4caa-ab24-f3ed0db15b64", "address": "fa:16:3e:ef:ad:af", "network": {"id": "34f771ea-9846-4f27-94a0-c00494d053ab", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-973491744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eee663228cbc483896e4fd409c4aa135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3054c1b9-3a", "ovs_interfaceid": "3054c1b9-3a7c-4caa-ab24-f3ed0db15b64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:29:34 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:ad:af,bridge_name='br-int',has_traffic_filtering=True,id=3054c1b9-3a7c-4caa-ab24-f3ed0db15b64,network=Network(34f771ea-9846-4f27-94a0-c00494d053ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3054c1b9-3a') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:29:34 user nova-compute[72418]: DEBUG os_vif [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:ad:af,bridge_name='br-int',has_traffic_filtering=True,id=3054c1b9-3a7c-4caa-ab24-f3ed0db15b64,network=Network(34f771ea-9846-4f27-94a0-c00494d053ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3054c1b9-3a') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:29:34 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:34 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:29:34 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:29:34 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:34 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3054c1b9-3a, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:29:34 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3054c1b9-3a, col_values=(('external_ids', {'iface-id': '3054c1b9-3a7c-4caa-ab24-f3ed0db15b64', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:ad:af', 'vm-uuid': '046617cf-13e5-44cf-9981-c1ae4ffd3851'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:29:34 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:34 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:29:34 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:34 user nova-compute[72418]: INFO os_vif [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:ad:af,bridge_name='br-int',has_traffic_filtering=True,id=3054c1b9-3a7c-4caa-ab24-f3ed0db15b64,network=Network(34f771ea-9846-4f27-94a0-c00494d053ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3054c1b9-3a')
Aug 09 18:29:34 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:29:34 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] No VIF found with MAC fa:16:3e:ef:ad:af, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:29:35 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:35 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:35 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:36 user nova-compute[72418]: DEBUG nova.compute.manager [req-4cc9501c-f68f-4ce2-a7ab-5256c6c49b71 req-8116552f-fb8d-4e5d-99c2-40b4ba9e069a service nova] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Received event network-vif-plugged-3054c1b9-3a7c-4caa-ab24-f3ed0db15b64 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:29:36 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-4cc9501c-f68f-4ce2-a7ab-5256c6c49b71 req-8116552f-fb8d-4e5d-99c2-40b4ba9e069a service nova] Acquiring lock "046617cf-13e5-44cf-9981-c1ae4ffd3851-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:29:36 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-4cc9501c-f68f-4ce2-a7ab-5256c6c49b71 req-8116552f-fb8d-4e5d-99c2-40b4ba9e069a service nova] Lock "046617cf-13e5-44cf-9981-c1ae4ffd3851-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:29:36 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-4cc9501c-f68f-4ce2-a7ab-5256c6c49b71 req-8116552f-fb8d-4e5d-99c2-40b4ba9e069a service nova] Lock "046617cf-13e5-44cf-9981-c1ae4ffd3851-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:29:36 user nova-compute[72418]: DEBUG nova.compute.manager [req-4cc9501c-f68f-4ce2-a7ab-5256c6c49b71 req-8116552f-fb8d-4e5d-99c2-40b4ba9e069a service nova] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] No waiting events found dispatching network-vif-plugged-3054c1b9-3a7c-4caa-ab24-f3ed0db15b64 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:29:36 user nova-compute[72418]: WARNING nova.compute.manager [req-4cc9501c-f68f-4ce2-a7ab-5256c6c49b71 req-8116552f-fb8d-4e5d-99c2-40b4ba9e069a service nova] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Received unexpected event network-vif-plugged-3054c1b9-3a7c-4caa-ab24-f3ed0db15b64 for instance with vm_state building and task_state spawning.
Aug 09 18:29:36 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:36 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:36 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:37 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:37 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605777.957095, 046617cf-13e5-44cf-9981-c1ae4ffd3851 => Resumed> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:29:37 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] VM Resumed (Lifecycle Event)
Aug 09 18:29:37 user nova-compute[72418]: DEBUG nova.compute.manager [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Instance event wait completed in 0 seconds for  {{(pid=72418) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 18:29:37 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Guest created on hypervisor {{(pid=72418) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 18:29:37 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Instance spawned successfully.
Aug 09 18:29:37 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 18:29:37 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:29:37 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Found default for hw_cdrom_bus of ide {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:29:37 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Found default for hw_disk_bus of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:29:37 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Found default for hw_input_bus of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:29:37 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Found default for hw_pointer_model of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:29:37 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Found default for hw_video_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:29:37 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Found default for hw_vif_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:29:38 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:29:38 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:29:38 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605777.958478, 046617cf-13e5-44cf-9981-c1ae4ffd3851 => Started> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:29:38 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] VM Started (Lifecycle Event)
Aug 09 18:29:38 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:29:38 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:29:38 user nova-compute[72418]: INFO nova.compute.manager [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Took 6.07 seconds to spawn the instance on the hypervisor.
Aug 09 18:29:38 user nova-compute[72418]: DEBUG nova.compute.manager [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:29:38 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:29:38 user nova-compute[72418]: INFO nova.compute.manager [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Took 6.86 seconds to build instance.
Aug 09 18:29:38 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-296725f8-64d3-4607-973a-da2cd7e3e074 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "046617cf-13e5-44cf-9981-c1ae4ffd3851" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.965s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:29:38 user nova-compute[72418]: DEBUG nova.compute.manager [req-1f5d4490-0275-4ea9-b848-bf104db936bf req-4cf48ced-e7c4-4f8e-acf9-9b8c24e16a58 service nova] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Received event network-vif-plugged-3054c1b9-3a7c-4caa-ab24-f3ed0db15b64 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:29:38 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-1f5d4490-0275-4ea9-b848-bf104db936bf req-4cf48ced-e7c4-4f8e-acf9-9b8c24e16a58 service nova] Acquiring lock "046617cf-13e5-44cf-9981-c1ae4ffd3851-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:29:38 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-1f5d4490-0275-4ea9-b848-bf104db936bf req-4cf48ced-e7c4-4f8e-acf9-9b8c24e16a58 service nova] Lock "046617cf-13e5-44cf-9981-c1ae4ffd3851-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:29:38 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-1f5d4490-0275-4ea9-b848-bf104db936bf req-4cf48ced-e7c4-4f8e-acf9-9b8c24e16a58 service nova] Lock "046617cf-13e5-44cf-9981-c1ae4ffd3851-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:29:38 user nova-compute[72418]: DEBUG nova.compute.manager [req-1f5d4490-0275-4ea9-b848-bf104db936bf req-4cf48ced-e7c4-4f8e-acf9-9b8c24e16a58 service nova] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] No waiting events found dispatching network-vif-plugged-3054c1b9-3a7c-4caa-ab24-f3ed0db15b64 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:29:38 user nova-compute[72418]: WARNING nova.compute.manager [req-1f5d4490-0275-4ea9-b848-bf104db936bf req-4cf48ced-e7c4-4f8e-acf9-9b8c24e16a58 service nova] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Received unexpected event network-vif-plugged-3054c1b9-3a7c-4caa-ab24-f3ed0db15b64 for instance with vm_state active and task_state None.
Aug 09 18:29:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:40 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d08d11c0-b5b1-4063-8916-f43f83f32f96 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Calling os-brick to attach iSCSI Volume {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 18:29:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08d11c0-b5b1-4063-8916-f43f83f32f96 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cd486fb9-c964-42ce-b17e-69f8ac2986a0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zxLBDbfN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:29:40 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-d08d11c0-b5b1-4063-8916-f43f83f32f96 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:29:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-d08d11c0-b5b1-4063-8916-f43f83f32f96 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:29:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-d08d11c0-b5b1-4063-8916-f43f83f32f96 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:29:40 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-d08d11c0-b5b1-4063-8916-f43f83f32f96 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:29:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-d08d11c0-b5b1-4063-8916-f43f83f32f96 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd486fb9-c964-42ce-b17e-69f8ac2986a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:29:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-d08d11c0-b5b1-4063-8916-f43f83f32f96 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd486fb9-c964-42ce-b17e-69f8ac2986a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:29:40 user nova-compute[72418]: INFO os_brick.initiator.connectors.iscsi [None req-d08d11c0-b5b1-4063-8916-f43f83f32f96 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 18:29:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd486fb9-c964-42ce-b17e-69f8ac2986a0 -p 172.16.0.220:3260 {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd486fb9-c964-42ce-b17e-69f8ac2986a0 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:40 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b2fc40-3716-4671-93a3-9237c6ca5fc8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:29:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08d11c0-b5b1-4063-8916-f43f83f32f96 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 18:29:40 user nova-compute[72418]:  {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:29:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd486fb9-c964-42ce-b17e-69f8ac2986a0 -p 172.16.0.220:3260 --interface default --op new {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd486fb9-c964-42ce-b17e-69f8ac2986a0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:40 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[df11255c-0cbc-4335-a5d3-bcf5ad52b7f8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd486fb9-c964-42ce-b17e-69f8ac2986a0] added\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:29:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08d11c0-b5b1-4063-8916-f43f83f32f96 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd486fb9-c964-42ce-b17e-69f8ac2986a0] added
Aug 09 18:29:40 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:29:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd486fb9-c964-42ce-b17e-69f8ac2986a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd486fb9-c964-42ce-b17e-69f8ac2986a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:40 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a4d5d5-d917-4ca0-857d-f4141ec22cb5]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:29:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08d11c0-b5b1-4063-8916-f43f83f32f96 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:29:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd486fb9-c964-42ce-b17e-69f8ac2986a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd486fb9-c964-42ce-b17e-69f8ac2986a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:40 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[173dc8d9-dfec-49b2-86db-0d2e9b7a76b3]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:29:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08d11c0-b5b1-4063-8916-f43f83f32f96 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:29:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd486fb9-c964-42ce-b17e-69f8ac2986a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zxLBDbfN {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd486fb9-c964-42ce-b17e-69f8ac2986a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zxLBDbfN" returned: 0 in 0.025s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:40 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[0429b913-f417-4b30-bc14-7a51b7ea3710]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:29:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08d11c0-b5b1-4063-8916-f43f83f32f96 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zxLBDbfN'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:29:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd486fb9-c964-42ce-b17e-69f8ac2986a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd486fb9-c964-42ce-b17e-69f8ac2986a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:40 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e0df02-6c45-48fb-9c34-ca831d020ee6]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:29:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08d11c0-b5b1-4063-8916-f43f83f32f96 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:29:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:40 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb4e13f-dcee-45e3-844c-665ef5cbf11c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:29:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08d11c0-b5b1-4063-8916-f43f83f32f96 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:29:40 user nova-compute[72418]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f (non-flash)
Aug 09 18:29:40 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:29:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08d11c0-b5b1-4063-8916-f43f83f32f96 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:29:40 user nova-compute[72418]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f (non-flash)
Aug 09 18:29:40 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:29:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd486fb9-c964-42ce-b17e-69f8ac2986a0 -p 172.16.0.220:3260 --login {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd486fb9-c964-42ce-b17e-69f8ac2986a0 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:40 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8fc7b7d-f477-49d9-82a6-5c86362ee3bd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd486fb9-c964-42ce-b17e-69f8ac2986a0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cd486fb9-c964-42ce-b17e-69f8ac2986a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:29:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08d11c0-b5b1-4063-8916-f43f83f32f96 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd486fb9-c964-42ce-b17e-69f8ac2986a0, portal: 172.16.0.220,3260]
Aug 09 18:29:40 user nova-compute[72418]: Login to [iface: default, target: iqn.2010-10.org.openstack:cd486fb9-c964-42ce-b17e-69f8ac2986a0, portal: 172.16.0.220,3260] successful.
Aug 09 18:29:40 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:29:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd486fb9-c964-42ce-b17e-69f8ac2986a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd486fb9-c964-42ce-b17e-69f8ac2986a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:40 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[20710708-f929-4afa-85ef-d86f401fa775]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:29:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08d11c0-b5b1-4063-8916-f43f83f32f96 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:29:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:40 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff547720-5f92-4385-99c1-ec0002e20b28]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd486fb9-c964-42ce-b17e-69f8ac2986a0 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:29:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08d11c0-b5b1-4063-8916-f43f83f32f96 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:29:40 user nova-compute[72418]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f (non-flash)
Aug 09 18:29:40 user nova-compute[72418]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd486fb9-c964-42ce-b17e-69f8ac2986a0 (non-flash)
Aug 09 18:29:40 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:29:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08d11c0-b5b1-4063-8916-f43f83f32f96 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:29:40 user nova-compute[72418]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f (non-flash)
Aug 09 18:29:40 user nova-compute[72418]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd486fb9-c964-42ce-b17e-69f8ac2986a0 (non-flash)
Aug 09 18:29:40 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:29:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-d08d11c0-b5b1-4063-8916-f43f83f32f96 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd486fb9-c964-42ce-b17e-69f8ac2986a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.381s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:29:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08d11c0-b5b1-4063-8916-f43f83f32f96 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Connected to 172.16.0.220:3260 {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 18:29:40 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-d08d11c0-b5b1-4063-8916-f43f83f32f96 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] HCTL ('35', '-', '-', 0) found on session 19 with lun 0 {{(pid=72418) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 18:29:40 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-d08d11c0-b5b1-4063-8916-f43f83f32f96 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72418) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 18:29:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:40 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b88a53e-413e-4ffd-b77f-caba52e9a8e0]: (4, ('- - 0', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:29:40 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-d08d11c0-b5b1-4063-8916-f43f83f32f96 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: None {{(pid=72418) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 18:29:41 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-d08d11c0-b5b1-4063-8916-f43f83f32f96 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72418) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 18:29:41 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08d11c0-b5b1-4063-8916-f43f83f32f96 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zxLBDbfN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 18:29:41 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-d08d11c0-b5b1-4063-8916-f43f83f32f96 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.419s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:29:41 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-d08d11c0-b5b1-4063-8916-f43f83f32f96 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] <== connect_volume: return (1421ms) {'type': 'block', 'scsi_wwn': '23736656664313065', 'path': '/dev/sdd'} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:29:41 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d08d11c0-b5b1-4063-8916-f43f83f32f96 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736656664313065', 'path': '/dev/sdd'} {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 18:29:41 user nova-compute[72418]: DEBUG nova.objects.instance [None req-d08d11c0-b5b1-4063-8916-f43f83f32f96 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Lazy-loading 'flavor' on Instance uuid 688f50af-0e41-4467-b2db-04ac22f62963 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:29:41 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-d08d11c0-b5b1-4063-8916-f43f83f32f96 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 18:29:41 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:29:41 user nova-compute[72418]:   <source dev="/dev/sdd"/>
Aug 09 18:29:41 user nova-compute[72418]:   <target dev="vdb" bus="virtio"/>
Aug 09 18:29:41 user nova-compute[72418]:   <serial>cd486fb9-c964-42ce-b17e-69f8ac2986a0</serial>
Aug 09 18:29:41 user nova-compute[72418]: </disk>
Aug 09 18:29:41 user nova-compute[72418]:  {{(pid=72418) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 18:29:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-d08d11c0-b5b1-4063-8916-f43f83f32f96 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:29:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-d08d11c0-b5b1-4063-8916-f43f83f32f96 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] No BDM found with device name hda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:29:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-d08d11c0-b5b1-4063-8916-f43f83f32f96 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] No VIF found with MAC fa:16:3e:0a:9c:69, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:29:42 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d08d11c0-b5b1-4063-8916-f43f83f32f96 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Lock "688f50af-0e41-4467-b2db-04ac22f62963" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.329s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:29:42 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:43 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-952b4526-d8cc-464c-ab11-0b9400838b80 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Acquiring lock "688f50af-0e41-4467-b2db-04ac22f62963" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:29:43 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-952b4526-d8cc-464c-ab11-0b9400838b80 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Lock "688f50af-0e41-4467-b2db-04ac22f62963" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:29:43 user nova-compute[72418]: INFO nova.compute.manager [None req-952b4526-d8cc-464c-ab11-0b9400838b80 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Detaching volume cd486fb9-c964-42ce-b17e-69f8ac2986a0
Aug 09 18:29:43 user nova-compute[72418]: INFO nova.virt.block_device [None req-952b4526-d8cc-464c-ab11-0b9400838b80 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Attempting to driver detach volume cd486fb9-c964-42ce-b17e-69f8ac2986a0 from mountpoint /dev/vdb
Aug 09 18:29:43 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-952b4526-d8cc-464c-ab11-0b9400838b80 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Attempting to detach device vdb from instance 688f50af-0e41-4467-b2db-04ac22f62963 from the persistent domain config. {{(pid=72418) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 18:29:43 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-952b4526-d8cc-464c-ab11-0b9400838b80 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 18:29:43 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:29:43 user nova-compute[72418]:   <source dev="/dev/sdd"/>
Aug 09 18:29:43 user nova-compute[72418]:   <target dev="vdb" bus="virtio"/>
Aug 09 18:29:43 user nova-compute[72418]:   <serial>cd486fb9-c964-42ce-b17e-69f8ac2986a0</serial>
Aug 09 18:29:43 user nova-compute[72418]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 09 18:29:43 user nova-compute[72418]: </disk>
Aug 09 18:29:43 user nova-compute[72418]:  {{(pid=72418) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 18:29:43 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-952b4526-d8cc-464c-ab11-0b9400838b80 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Successfully detached device vdb from instance 688f50af-0e41-4467-b2db-04ac22f62963 from the persistent domain config.
Aug 09 18:29:43 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-952b4526-d8cc-464c-ab11-0b9400838b80 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 688f50af-0e41-4467-b2db-04ac22f62963 from the live domain config. {{(pid=72418) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 18:29:43 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-952b4526-d8cc-464c-ab11-0b9400838b80 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 18:29:43 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:29:43 user nova-compute[72418]:   <source dev="/dev/sdd"/>
Aug 09 18:29:43 user nova-compute[72418]:   <target dev="vdb" bus="virtio"/>
Aug 09 18:29:43 user nova-compute[72418]:   <serial>cd486fb9-c964-42ce-b17e-69f8ac2986a0</serial>
Aug 09 18:29:43 user nova-compute[72418]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 09 18:29:43 user nova-compute[72418]: </disk>
Aug 09 18:29:43 user nova-compute[72418]:  {{(pid=72418) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 18:29:44 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Received event <DeviceRemovedEvent: 1691605784.0887682, 688f50af-0e41-4467-b2db-04ac22f62963 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72418) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 18:29:44 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-952b4526-d8cc-464c-ab11-0b9400838b80 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 688f50af-0e41-4467-b2db-04ac22f62963 {{(pid=72418) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 18:29:44 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-952b4526-d8cc-464c-ab11-0b9400838b80 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Successfully detached device vdb from instance 688f50af-0e41-4467-b2db-04ac22f62963 from the live domain config.
Aug 09 18:29:44 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-952b4526-d8cc-464c-ab11-0b9400838b80 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] calling os-brick to detach iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 18:29:44 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-952b4526-d8cc-464c-ab11-0b9400838b80 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, {'target_iqns': ['iqn.2010-10.org.openstack:cd486fb9-c964-42ce-b17e-69f8ac2986a0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zxLBDbfN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:29:44 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-952b4526-d8cc-464c-ab11-0b9400838b80 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:29:44 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-952b4526-d8cc-464c-ab11-0b9400838b80 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:29:44 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-952b4526-d8cc-464c-ab11-0b9400838b80 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:29:44 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-952b4526-d8cc-464c-ab11-0b9400838b80 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd486fb9-c964-42ce-b17e-69f8ac2986a0', 0)] {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 18:29:44 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:44 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:44 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[b020d1cd-3cc0-44bc-9f90-6766fb80ba79]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd486fb9-c964-42ce-b17e-69f8ac2986a0\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:29:44 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:44 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:44 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[4776732f-abf9-45a9-9cf6-a05cbbba398d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd486fb9-c964-42ce-b17e-69f8ac2986a0 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:29:44 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-952b4526-d8cc-464c-ab11-0b9400838b80 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:29:44 user nova-compute[72418]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f (non-flash)
Aug 09 18:29:44 user nova-compute[72418]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd486fb9-c964-42ce-b17e-69f8ac2986a0 (non-flash)
Aug 09 18:29:44 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:29:44 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-952b4526-d8cc-464c-ab11-0b9400838b80 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:29:44 user nova-compute[72418]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f (non-flash)
Aug 09 18:29:44 user nova-compute[72418]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd486fb9-c964-42ce-b17e-69f8ac2986a0 (non-flash)
Aug 09 18:29:44 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:29:44 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-952b4526-d8cc-464c-ab11-0b9400838b80 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f42d4704b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd486fb9-c964-42ce-b17e-69f8ac2986a0'): ({'sdd'}, set())}) {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 18:29:44 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-952b4526-d8cc-464c-ab11-0b9400838b80 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Removing single pathed devices sdd {{(pid=72418) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 18:29:44 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:44 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:44 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:44 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d62ca6-6539-4447-9d28-39b1fe4925fd]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:29:44 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:44 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:44 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[10be1f97-1701-47dc-abbf-5fa306ac3b2f]: (4, ('ok\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:29:44 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-952b4526-d8cc-464c-ab11-0b9400838b80 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Flushing IO for device /dev/sdd {{(pid=72418) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 18:29:44 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:44 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:44 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b236713-f982-4ad1-92d0-f9791c557dc4]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:29:44 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-952b4526-d8cc-464c-ab11-0b9400838b80 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72418) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 18:29:44 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:44 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:44 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f399a6-3416-49b6-a780-02228ab329fa]: (4, ('1', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:29:44 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-952b4526-d8cc-464c-ab11-0b9400838b80 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 18:29:44 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-952b4526-d8cc-464c-ab11-0b9400838b80 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] SCSI volumes sdd have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 18:29:44 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-952b4526-d8cc-464c-ab11-0b9400838b80 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd486fb9-c964-42ce-b17e-69f8ac2986a0')] {{(pid=72418) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 18:29:44 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd486fb9-c964-42ce-b17e-69f8ac2986a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:44 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd486fb9-c964-42ce-b17e-69f8ac2986a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:44 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[71859c8a-6c25-4010-9a34-bb084ca8d7d0]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:29:44 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-952b4526-d8cc-464c-ab11-0b9400838b80 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:29:44 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd486fb9-c964-42ce-b17e-69f8ac2986a0 -p 172.16.0.220:3260 --logout {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:44 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd486fb9-c964-42ce-b17e-69f8ac2986a0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:44 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f3e14e-58d3-4e41-8024-579dd37e73ee]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:cd486fb9-c964-42ce-b17e-69f8ac2986a0, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:cd486fb9-c964-42ce-b17e-69f8ac2986a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:29:44 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-952b4526-d8cc-464c-ab11-0b9400838b80 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:cd486fb9-c964-42ce-b17e-69f8ac2986a0, portal: 172.16.0.220,3260]
Aug 09 18:29:44 user nova-compute[72418]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:cd486fb9-c964-42ce-b17e-69f8ac2986a0, portal: 172.16.0.220,3260] successful.
Aug 09 18:29:44 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:29:44 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd486fb9-c964-42ce-b17e-69f8ac2986a0 -p 172.16.0.220:3260 --op delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:44 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd486fb9-c964-42ce-b17e-69f8ac2986a0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:44 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b52ea0-dac4-41c2-9904-ac79ef5c6b9f]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:29:44 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-952b4526-d8cc-464c-ab11-0b9400838b80 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:29:44 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-952b4526-d8cc-464c-ab11-0b9400838b80 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:29:44 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-952b4526-d8cc-464c-ab11-0b9400838b80 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] <== disconnect_volume: return (283ms) None {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:29:44 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-952b4526-d8cc-464c-ab11-0b9400838b80 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Disconnected iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 18:29:45 user nova-compute[72418]: DEBUG nova.objects.instance [None req-952b4526-d8cc-464c-ab11-0b9400838b80 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Lazy-loading 'flavor' on Instance uuid 688f50af-0e41-4467-b2db-04ac22f62963 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:29:45 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-952b4526-d8cc-464c-ab11-0b9400838b80 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Lock "688f50af-0e41-4467-b2db-04ac22f62963" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.680s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:29:45 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ff90820d-6cb1-4c3d-a01a-79e4334b95ed tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Acquiring lock "interface-688f50af-0e41-4467-b2db-04ac22f62963-2fe18f2b-8036-42df-94d0-42e747c60d1a" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:29:45 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ff90820d-6cb1-4c3d-a01a-79e4334b95ed tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Lock "interface-688f50af-0e41-4467-b2db-04ac22f62963-2fe18f2b-8036-42df-94d0-42e747c60d1a" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:29:45 user nova-compute[72418]: DEBUG nova.objects.instance [None req-ff90820d-6cb1-4c3d-a01a-79e4334b95ed tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Lazy-loading 'flavor' on Instance uuid 688f50af-0e41-4467-b2db-04ac22f62963 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:29:45 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-ff90820d-6cb1-4c3d-a01a-79e4334b95ed tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T18:27:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-630623237',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-630623237',id=20,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJchtztQL/UH2D7W5ks5SFjnLeiOZKRpefilUR0gjk7AuwJAWWS/gJOgdgu+Tp4jMu5wIaL/uSL50sh+6WeG1BBlMsFAUgEPx6/v6KmgLX0CBGzXIbAnMWDK0rX8sqetTQ==',key_name='tempest-keypair-267340570',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:27:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='86896e6544164fda93f7bea95a751707',ramdisk_id='',reservation_id='r-fo0cn966',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1428601923',owner_user_name='tempest-TaggedAttachmentsTest-1428601923-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:27:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df6cd3ad06524ae59968b133efceaa4c',uuid=688f50af-0e41-4467-b2db-04ac22f62963,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2fe18f2b-8036-42df-94d0-42e747c60d1a", "address": "fa:16:3e:15:c3:cd", "network": {"id": "77cad7ee-baee-4e0e-b735-9ac6302d9c3b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1355806010", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "86896e6544164fda93f7bea95a751707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fe18f2b-80", "ovs_interfaceid": "2fe18f2b-8036-42df-94d0-42e747c60d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:29:45 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-ff90820d-6cb1-4c3d-a01a-79e4334b95ed tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Converting VIF {"id": "2fe18f2b-8036-42df-94d0-42e747c60d1a", "address": "fa:16:3e:15:c3:cd", "network": {"id": "77cad7ee-baee-4e0e-b735-9ac6302d9c3b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1355806010", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "86896e6544164fda93f7bea95a751707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fe18f2b-80", "ovs_interfaceid": "2fe18f2b-8036-42df-94d0-42e747c60d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:29:45 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-ff90820d-6cb1-4c3d-a01a-79e4334b95ed tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:c3:cd,bridge_name='br-int',has_traffic_filtering=True,id=2fe18f2b-8036-42df-94d0-42e747c60d1a,network=Network(77cad7ee-baee-4e0e-b735-9ac6302d9c3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fe18f2b-80') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:29:45 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-ff90820d-6cb1-4c3d-a01a-79e4334b95ed tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:15:c3:cd"/><model type="virtio"/><mtu size="1442"/><target dev="tap2fe18f2b-80"/></interface> {{(pid=72418) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 09 18:29:45 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-ff90820d-6cb1-4c3d-a01a-79e4334b95ed tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:15:c3:cd"/><model type="virtio"/><mtu size="1442"/><target dev="tap2fe18f2b-80"/></interface> {{(pid=72418) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 09 18:29:45 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-ff90820d-6cb1-4c3d-a01a-79e4334b95ed tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Attempting to detach device tap2fe18f2b-80 from instance 688f50af-0e41-4467-b2db-04ac22f62963 from the persistent domain config. {{(pid=72418) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 18:29:45 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-ff90820d-6cb1-4c3d-a01a-79e4334b95ed tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] detach device xml: <interface type="ethernet">
Aug 09 18:29:45 user nova-compute[72418]:   <mac address="fa:16:3e:15:c3:cd"/>
Aug 09 18:29:45 user nova-compute[72418]:   <model type="virtio"/>
Aug 09 18:29:45 user nova-compute[72418]:   <mtu size="1442"/>
Aug 09 18:29:45 user nova-compute[72418]:   <target dev="tap2fe18f2b-80"/>
Aug 09 18:29:45 user nova-compute[72418]: </interface>
Aug 09 18:29:45 user nova-compute[72418]:  {{(pid=72418) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 18:29:45 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-ff90820d-6cb1-4c3d-a01a-79e4334b95ed tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:15:c3:cd"/><model type="virtio"/><mtu size="1442"/><target dev="tap2fe18f2b-80"/></interface> {{(pid=72418) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 09 18:29:45 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-ff90820d-6cb1-4c3d-a01a-79e4334b95ed tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:15:c3:cd"/><model type="virtio"/><mtu size="1442"/><target dev="tap2fe18f2b-80"/></interface>not found in domain: <domain type='kvm' id='24'>
Aug 09 18:29:45 user nova-compute[72418]:   <name>instance-00000014</name>
Aug 09 18:29:45 user nova-compute[72418]:   <uuid>688f50af-0e41-4467-b2db-04ac22f62963</uuid>
Aug 09 18:29:45 user nova-compute[72418]:   <metadata>
Aug 09 18:29:45 user nova-compute[72418]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:29:45 user nova-compute[72418]:   <nova:package version="0.0.0"/>
Aug 09 18:29:45 user nova-compute[72418]:   <nova:name>tempest-device-tagging-server-630623237</nova:name>
Aug 09 18:29:45 user nova-compute[72418]:   <nova:creationTime>2023-08-09 18:29:30</nova:creationTime>
Aug 09 18:29:45 user nova-compute[72418]:   <nova:flavor name="m1.tiny">
Aug 09 18:29:45 user nova-compute[72418]:     <nova:memory>512</nova:memory>
Aug 09 18:29:45 user nova-compute[72418]:     <nova:disk>1</nova:disk>
Aug 09 18:29:45 user nova-compute[72418]:     <nova:swap>0</nova:swap>
Aug 09 18:29:45 user nova-compute[72418]:     <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:29:45 user nova-compute[72418]:     <nova:vcpus>1</nova:vcpus>
Aug 09 18:29:45 user nova-compute[72418]:   </nova:flavor>
Aug 09 18:29:45 user nova-compute[72418]:   <nova:owner>
Aug 09 18:29:45 user nova-compute[72418]:     <nova:user uuid="df6cd3ad06524ae59968b133efceaa4c">tempest-TaggedAttachmentsTest-1428601923-project-member</nova:user>
Aug 09 18:29:45 user nova-compute[72418]:     <nova:project uuid="86896e6544164fda93f7bea95a751707">tempest-TaggedAttachmentsTest-1428601923</nova:project>
Aug 09 18:29:45 user nova-compute[72418]:   </nova:owner>
Aug 09 18:29:45 user nova-compute[72418]:   <nova:root type="image" uuid="8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e"/>
Aug 09 18:29:45 user nova-compute[72418]:   <nova:ports>
Aug 09 18:29:45 user nova-compute[72418]:     <nova:port uuid="b2c3fa50-5615-4a58-8820-54c67c5d65bc">
Aug 09 18:29:45 user nova-compute[72418]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 09 18:29:45 user nova-compute[72418]:     </nova:port>
Aug 09 18:29:45 user nova-compute[72418]:     <nova:port uuid="2fe18f2b-8036-42df-94d0-42e747c60d1a">
Aug 09 18:29:45 user nova-compute[72418]:       <nova:ip type="fixed" address="10.10.10.85" ipVersion="4"/>
Aug 09 18:29:45 user nova-compute[72418]:     </nova:port>
Aug 09 18:29:45 user nova-compute[72418]:   </nova:ports>
Aug 09 18:29:45 user nova-compute[72418]: </nova:instance>
Aug 09 18:29:45 user nova-compute[72418]:   </metadata>
Aug 09 18:29:45 user nova-compute[72418]:   <memory unit='KiB'>524288</memory>
Aug 09 18:29:45 user nova-compute[72418]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 09 18:29:45 user nova-compute[72418]:   <vcpu placement='static'>1</vcpu>
Aug 09 18:29:45 user nova-compute[72418]:   <resource>
Aug 09 18:29:45 user nova-compute[72418]:     <partition>/machine</partition>
Aug 09 18:29:45 user nova-compute[72418]:   </resource>
Aug 09 18:29:45 user nova-compute[72418]:   <sysinfo type='smbios'>
Aug 09 18:29:45 user nova-compute[72418]:     <system>
Aug 09 18:29:45 user nova-compute[72418]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 09 18:29:45 user nova-compute[72418]:       <entry name='product'>OpenStack Nova</entry>
Aug 09 18:29:45 user nova-compute[72418]:       <entry name='version'>0.0.0</entry>
Aug 09 18:29:45 user nova-compute[72418]:       <entry name='serial'>688f50af-0e41-4467-b2db-04ac22f62963</entry>
Aug 09 18:29:45 user nova-compute[72418]:       <entry name='uuid'>688f50af-0e41-4467-b2db-04ac22f62963</entry>
Aug 09 18:29:45 user nova-compute[72418]:       <entry name='family'>Virtual Machine</entry>
Aug 09 18:29:45 user nova-compute[72418]:     </system>
Aug 09 18:29:45 user nova-compute[72418]:   </sysinfo>
Aug 09 18:29:45 user nova-compute[72418]:   <os>
Aug 09 18:29:45 user nova-compute[72418]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 09 18:29:45 user nova-compute[72418]:     <boot dev='hd'/>
Aug 09 18:29:45 user nova-compute[72418]:     <smbios mode='sysinfo'/>
Aug 09 18:29:45 user nova-compute[72418]:   </os>
Aug 09 18:29:45 user nova-compute[72418]:   <features>
Aug 09 18:29:45 user nova-compute[72418]:     <acpi/>
Aug 09 18:29:45 user nova-compute[72418]:     <apic/>
Aug 09 18:29:45 user nova-compute[72418]:     <vmcoreinfo state='on'/>
Aug 09 18:29:45 user nova-compute[72418]:   </features>
Aug 09 18:29:45 user nova-compute[72418]:   <cpu mode='custom' match='exact' check='full'>
Aug 09 18:29:45 user nova-compute[72418]:     <model fallback='forbid'>Nehalem</model>
Aug 09 18:29:45 user nova-compute[72418]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 09 18:29:45 user nova-compute[72418]:     <feature policy='require' name='vme'/>
Aug 09 18:29:45 user nova-compute[72418]:     <feature policy='require' name='x2apic'/>
Aug 09 18:29:45 user nova-compute[72418]:     <feature policy='require' name='hypervisor'/>
Aug 09 18:29:45 user nova-compute[72418]:   </cpu>
Aug 09 18:29:45 user nova-compute[72418]:   <clock offset='utc'>
Aug 09 18:29:45 user nova-compute[72418]:     <timer name='pit' tickpolicy='delay'/>
Aug 09 18:29:45 user nova-compute[72418]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 09 18:29:45 user nova-compute[72418]:     <timer name='hpet' present='no'/>
Aug 09 18:29:45 user nova-compute[72418]:   </clock>
Aug 09 18:29:45 user nova-compute[72418]:   <on_poweroff>destroy</on_poweroff>
Aug 09 18:29:45 user nova-compute[72418]:   <on_reboot>restart</on_reboot>
Aug 09 18:29:45 user nova-compute[72418]:   <on_crash>destroy</on_crash>
Aug 09 18:29:45 user nova-compute[72418]:   <devices>
Aug 09 18:29:45 user nova-compute[72418]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 09 18:29:45 user nova-compute[72418]:     <disk type='file' device='disk'>
Aug 09 18:29:45 user nova-compute[72418]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 09 18:29:45 user nova-compute[72418]:       <source file='/opt/stack/data/nova/instances/688f50af-0e41-4467-b2db-04ac22f62963/disk' index='2'/>
Aug 09 18:29:45 user nova-compute[72418]:       <backingStore type='file' index='3'>
Aug 09 18:29:45 user nova-compute[72418]:         <format type='raw'/>
Aug 09 18:29:45 user nova-compute[72418]:         <source file='/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71'/>
Aug 09 18:29:45 user nova-compute[72418]:         <backingStore/>
Aug 09 18:29:45 user nova-compute[72418]:       </backingStore>
Aug 09 18:29:45 user nova-compute[72418]:       <target dev='vda' bus='virtio'/>
Aug 09 18:29:45 user nova-compute[72418]:       <alias name='virtio-disk0'/>
Aug 09 18:29:45 user nova-compute[72418]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 09 18:29:45 user nova-compute[72418]:     </disk>
Aug 09 18:29:45 user nova-compute[72418]:     <disk type='file' device='cdrom'>
Aug 09 18:29:45 user nova-compute[72418]:       <driver name='qemu' type='raw' cache='none'/>
Aug 09 18:29:45 user nova-compute[72418]:       <source file='/opt/stack/data/nova/instances/688f50af-0e41-4467-b2db-04ac22f62963/disk.config' index='1'/>
Aug 09 18:29:45 user nova-compute[72418]:       <backingStore/>
Aug 09 18:29:45 user nova-compute[72418]:       <target dev='hda' bus='ide'/>
Aug 09 18:29:45 user nova-compute[72418]:       <readonly/>
Aug 09 18:29:45 user nova-compute[72418]:       <alias name='ide0-0-0'/>
Aug 09 18:29:45 user nova-compute[72418]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 09 18:29:45 user nova-compute[72418]:     </disk>
Aug 09 18:29:45 user nova-compute[72418]:     <controller type='usb' index='0' model='none'>
Aug 09 18:29:45 user nova-compute[72418]:       <alias name='usb'/>
Aug 09 18:29:45 user nova-compute[72418]:     </controller>
Aug 09 18:29:45 user nova-compute[72418]:     <controller type='pci' index='0' model='pci-root'>
Aug 09 18:29:45 user nova-compute[72418]:       <alias name='pci.0'/>
Aug 09 18:29:45 user nova-compute[72418]:     </controller>
Aug 09 18:29:45 user nova-compute[72418]:     <controller type='ide' index='0'>
Aug 09 18:29:45 user nova-compute[72418]:       <alias name='ide'/>
Aug 09 18:29:45 user nova-compute[72418]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 09 18:29:45 user nova-compute[72418]:     </controller>
Aug 09 18:29:45 user nova-compute[72418]:     <interface type='ethernet'>
Aug 09 18:29:45 user nova-compute[72418]:       <mac address='fa:16:3e:0a:9c:69'/>
Aug 09 18:29:45 user nova-compute[72418]:       <target dev='tapb2c3fa50-56'/>
Aug 09 18:29:45 user nova-compute[72418]:       <model type='virtio'/>
Aug 09 18:29:45 user nova-compute[72418]:       <mtu size='1442'/>
Aug 09 18:29:45 user nova-compute[72418]:       <alias name='net0'/>
Aug 09 18:29:45 user nova-compute[72418]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 09 18:29:45 user nova-compute[72418]:     </interface>
Aug 09 18:29:45 user nova-compute[72418]:     <interface type='ethernet'>
Aug 09 18:29:45 user nova-compute[72418]:       <mac address='fa:16:3e:15:c3:cd'/>
Aug 09 18:29:45 user nova-compute[72418]:       <target dev='tap2fe18f2b-80'/>
Aug 09 18:29:45 user nova-compute[72418]:       <model type='virtio'/>
Aug 09 18:29:45 user nova-compute[72418]:       <mtu size='1442'/>
Aug 09 18:29:45 user nova-compute[72418]:       <alias name='net1'/>
Aug 09 18:29:45 user nova-compute[72418]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 09 18:29:45 user nova-compute[72418]:     </interface>
Aug 09 18:29:45 user nova-compute[72418]:     <serial type='pty'>
Aug 09 18:29:45 user nova-compute[72418]:       <source path='/dev/pts/5'/>
Aug 09 18:29:45 user nova-compute[72418]:       <log file='/opt/stack/data/nova/instances/688f50af-0e41-4467-b2db-04ac22f62963/console.log' append='off'/>
Aug 09 18:29:45 user nova-compute[72418]:       <target type='isa-serial' port='0'>
Aug 09 18:29:45 user nova-compute[72418]:         <model name='isa-serial'/>
Aug 09 18:29:45 user nova-compute[72418]:       </target>
Aug 09 18:29:45 user nova-compute[72418]:       <alias name='serial0'/>
Aug 09 18:29:45 user nova-compute[72418]:     </serial>
Aug 09 18:29:45 user nova-compute[72418]:     <console type='pty' tty='/dev/pts/5'>
Aug 09 18:29:45 user nova-compute[72418]:       <source path='/dev/pts/5'/>
Aug 09 18:29:45 user nova-compute[72418]:       <log file='/opt/stack/data/nova/instances/688f50af-0e41-4467-b2db-04ac22f62963/console.log' append='off'/>
Aug 09 18:29:45 user nova-compute[72418]:       <target type='serial' port='0'/>
Aug 09 18:29:45 user nova-compute[72418]:       <alias name='serial0'/>
Aug 09 18:29:45 user nova-compute[72418]:     </console>
Aug 09 18:29:45 user nova-compute[72418]:     <input type='mouse' bus='ps2'>
Aug 09 18:29:45 user nova-compute[72418]:       <alias name='input0'/>
Aug 09 18:29:45 user nova-compute[72418]:     </input>
Aug 09 18:29:45 user nova-compute[72418]:     <input type='keyboard' bus='ps2'>
Aug 09 18:29:45 user nova-compute[72418]:       <alias name='input1'/>
Aug 09 18:29:45 user nova-compute[72418]:     </input>
Aug 09 18:29:45 user nova-compute[72418]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Aug 09 18:29:45 user nova-compute[72418]:       <listen type='address' address='0.0.0.0'/>
Aug 09 18:29:45 user nova-compute[72418]:     </graphics>
Aug 09 18:29:45 user nova-compute[72418]:     <audio id='1' type='none'/>
Aug 09 18:29:45 user nova-compute[72418]:     <video>
Aug 09 18:29:45 user nova-compute[72418]:       <model type='virtio' heads='1' primary='yes'/>
Aug 09 18:29:45 user nova-compute[72418]:       <alias name='video0'/>
Aug 09 18:29:45 user nova-compute[72418]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 09 18:29:45 user nova-compute[72418]:     </video>
Aug 09 18:29:45 user nova-compute[72418]:     <memballoon model='virtio'>
Aug 09 18:29:45 user nova-compute[72418]:       <stats period='10'/>
Aug 09 18:29:45 user nova-compute[72418]:       <alias name='balloon0'/>
Aug 09 18:29:45 user nova-compute[72418]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 09 18:29:45 user nova-compute[72418]:     </memballoon>
Aug 09 18:29:45 user nova-compute[72418]:     <rng model='virtio'>
Aug 09 18:29:45 user nova-compute[72418]:       <backend model='random'>/dev/urandom</backend>
Aug 09 18:29:45 user nova-compute[72418]:       <alias name='rng0'/>
Aug 09 18:29:45 user nova-compute[72418]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 09 18:29:45 user nova-compute[72418]:     </rng>
Aug 09 18:29:45 user nova-compute[72418]:   </devices>
Aug 09 18:29:45 user nova-compute[72418]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 09 18:29:45 user nova-compute[72418]:     <label>libvirt-688f50af-0e41-4467-b2db-04ac22f62963</label>
Aug 09 18:29:45 user nova-compute[72418]:     <imagelabel>libvirt-688f50af-0e41-4467-b2db-04ac22f62963</imagelabel>
Aug 09 18:29:45 user nova-compute[72418]:   </seclabel>
Aug 09 18:29:45 user nova-compute[72418]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 09 18:29:45 user nova-compute[72418]:     <label>+64055:+108</label>
Aug 09 18:29:45 user nova-compute[72418]:     <imagelabel>+64055:+108</imagelabel>
Aug 09 18:29:45 user nova-compute[72418]:   </seclabel>
Aug 09 18:29:45 user nova-compute[72418]: </domain>
Aug 09 18:29:45 user nova-compute[72418]:  {{(pid=72418) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 09 18:29:45 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-ff90820d-6cb1-4c3d-a01a-79e4334b95ed tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Successfully detached device tap2fe18f2b-80 from instance 688f50af-0e41-4467-b2db-04ac22f62963 from the persistent domain config.
Aug 09 18:29:45 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-ff90820d-6cb1-4c3d-a01a-79e4334b95ed tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] (1/8): Attempting to detach device tap2fe18f2b-80 with device alias net1 from instance 688f50af-0e41-4467-b2db-04ac22f62963 from the live domain config. {{(pid=72418) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 18:29:45 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-ff90820d-6cb1-4c3d-a01a-79e4334b95ed tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] detach device xml: <interface type="ethernet">
Aug 09 18:29:45 user nova-compute[72418]:   <mac address="fa:16:3e:15:c3:cd"/>
Aug 09 18:29:45 user nova-compute[72418]:   <model type="virtio"/>
Aug 09 18:29:45 user nova-compute[72418]:   <mtu size="1442"/>
Aug 09 18:29:45 user nova-compute[72418]:   <target dev="tap2fe18f2b-80"/>
Aug 09 18:29:45 user nova-compute[72418]: </interface>
Aug 09 18:29:45 user nova-compute[72418]:  {{(pid=72418) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 18:29:45 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:29:46 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:46 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Received event <DeviceRemovedEvent: 1691605786.2566338, 688f50af-0e41-4467-b2db-04ac22f62963 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72418) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 18:29:46 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-ff90820d-6cb1-4c3d-a01a-79e4334b95ed tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Start waiting for the detach event from libvirt for device tap2fe18f2b-80 with device alias net1 for instance 688f50af-0e41-4467-b2db-04ac22f62963 {{(pid=72418) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 18:29:46 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-ff90820d-6cb1-4c3d-a01a-79e4334b95ed tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:15:c3:cd"/><model type="virtio"/><mtu size="1442"/><target dev="tap2fe18f2b-80"/></interface> {{(pid=72418) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 09 18:29:46 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:46 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-ff90820d-6cb1-4c3d-a01a-79e4334b95ed tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:15:c3:cd"/><model type="virtio"/><mtu size="1442"/><target dev="tap2fe18f2b-80"/></interface>not found in domain: <domain type='kvm' id='24'>
Aug 09 18:29:46 user nova-compute[72418]:   <name>instance-00000014</name>
Aug 09 18:29:46 user nova-compute[72418]:   <uuid>688f50af-0e41-4467-b2db-04ac22f62963</uuid>
Aug 09 18:29:46 user nova-compute[72418]:   <metadata>
Aug 09 18:29:46 user nova-compute[72418]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:29:46 user nova-compute[72418]:   <nova:package version="0.0.0"/>
Aug 09 18:29:46 user nova-compute[72418]:   <nova:name>tempest-device-tagging-server-630623237</nova:name>
Aug 09 18:29:46 user nova-compute[72418]:   <nova:creationTime>2023-08-09 18:29:30</nova:creationTime>
Aug 09 18:29:46 user nova-compute[72418]:   <nova:flavor name="m1.tiny">
Aug 09 18:29:46 user nova-compute[72418]:     <nova:memory>512</nova:memory>
Aug 09 18:29:46 user nova-compute[72418]:     <nova:disk>1</nova:disk>
Aug 09 18:29:46 user nova-compute[72418]:     <nova:swap>0</nova:swap>
Aug 09 18:29:46 user nova-compute[72418]:     <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:29:46 user nova-compute[72418]:     <nova:vcpus>1</nova:vcpus>
Aug 09 18:29:46 user nova-compute[72418]:   </nova:flavor>
Aug 09 18:29:46 user nova-compute[72418]:   <nova:owner>
Aug 09 18:29:46 user nova-compute[72418]:     <nova:user uuid="df6cd3ad06524ae59968b133efceaa4c">tempest-TaggedAttachmentsTest-1428601923-project-member</nova:user>
Aug 09 18:29:46 user nova-compute[72418]:     <nova:project uuid="86896e6544164fda93f7bea95a751707">tempest-TaggedAttachmentsTest-1428601923</nova:project>
Aug 09 18:29:46 user nova-compute[72418]:   </nova:owner>
Aug 09 18:29:46 user nova-compute[72418]:   <nova:root type="image" uuid="8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e"/>
Aug 09 18:29:46 user nova-compute[72418]:   <nova:ports>
Aug 09 18:29:46 user nova-compute[72418]:     <nova:port uuid="b2c3fa50-5615-4a58-8820-54c67c5d65bc">
Aug 09 18:29:46 user nova-compute[72418]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 09 18:29:46 user nova-compute[72418]:     </nova:port>
Aug 09 18:29:46 user nova-compute[72418]:     <nova:port uuid="2fe18f2b-8036-42df-94d0-42e747c60d1a">
Aug 09 18:29:46 user nova-compute[72418]:       <nova:ip type="fixed" address="10.10.10.85" ipVersion="4"/>
Aug 09 18:29:46 user nova-compute[72418]:     </nova:port>
Aug 09 18:29:46 user nova-compute[72418]:   </nova:ports>
Aug 09 18:29:46 user nova-compute[72418]: </nova:instance>
Aug 09 18:29:46 user nova-compute[72418]:   </metadata>
Aug 09 18:29:46 user nova-compute[72418]:   <memory unit='KiB'>524288</memory>
Aug 09 18:29:46 user nova-compute[72418]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 09 18:29:46 user nova-compute[72418]:   <vcpu placement='static'>1</vcpu>
Aug 09 18:29:46 user nova-compute[72418]:   <resource>
Aug 09 18:29:46 user nova-compute[72418]:     <partition>/machine</partition>
Aug 09 18:29:46 user nova-compute[72418]:   </resource>
Aug 09 18:29:46 user nova-compute[72418]:   <sysinfo type='smbios'>
Aug 09 18:29:46 user nova-compute[72418]:     <system>
Aug 09 18:29:46 user nova-compute[72418]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 09 18:29:46 user nova-compute[72418]:       <entry name='product'>OpenStack Nova</entry>
Aug 09 18:29:46 user nova-compute[72418]:       <entry name='version'>0.0.0</entry>
Aug 09 18:29:46 user nova-compute[72418]:       <entry name='serial'>688f50af-0e41-4467-b2db-04ac22f62963</entry>
Aug 09 18:29:46 user nova-compute[72418]:       <entry name='uuid'>688f50af-0e41-4467-b2db-04ac22f62963</entry>
Aug 09 18:29:46 user nova-compute[72418]:       <entry name='family'>Virtual Machine</entry>
Aug 09 18:29:46 user nova-compute[72418]:     </system>
Aug 09 18:29:46 user nova-compute[72418]:   </sysinfo>
Aug 09 18:29:46 user nova-compute[72418]:   <os>
Aug 09 18:29:46 user nova-compute[72418]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 09 18:29:46 user nova-compute[72418]:     <boot dev='hd'/>
Aug 09 18:29:46 user nova-compute[72418]:     <smbios mode='sysinfo'/>
Aug 09 18:29:46 user nova-compute[72418]:   </os>
Aug 09 18:29:46 user nova-compute[72418]:   <features>
Aug 09 18:29:46 user nova-compute[72418]:     <acpi/>
Aug 09 18:29:46 user nova-compute[72418]:     <apic/>
Aug 09 18:29:46 user nova-compute[72418]:     <vmcoreinfo state='on'/>
Aug 09 18:29:46 user nova-compute[72418]:   </features>
Aug 09 18:29:46 user nova-compute[72418]:   <cpu mode='custom' match='exact' check='full'>
Aug 09 18:29:46 user nova-compute[72418]:     <model fallback='forbid'>Nehalem</model>
Aug 09 18:29:46 user nova-compute[72418]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 09 18:29:46 user nova-compute[72418]:     <feature policy='require' name='vme'/>
Aug 09 18:29:46 user nova-compute[72418]:     <feature policy='require' name='x2apic'/>
Aug 09 18:29:46 user nova-compute[72418]:     <feature policy='require' name='hypervisor'/>
Aug 09 18:29:46 user nova-compute[72418]:   </cpu>
Aug 09 18:29:46 user nova-compute[72418]:   <clock offset='utc'>
Aug 09 18:29:46 user nova-compute[72418]:     <timer name='pit' tickpolicy='delay'/>
Aug 09 18:29:46 user nova-compute[72418]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 09 18:29:46 user nova-compute[72418]:     <timer name='hpet' present='no'/>
Aug 09 18:29:46 user nova-compute[72418]:   </clock>
Aug 09 18:29:46 user nova-compute[72418]:   <on_poweroff>destroy</on_poweroff>
Aug 09 18:29:46 user nova-compute[72418]:   <on_reboot>restart</on_reboot>
Aug 09 18:29:46 user nova-compute[72418]:   <on_crash>destroy</on_crash>
Aug 09 18:29:46 user nova-compute[72418]:   <devices>
Aug 09 18:29:46 user nova-compute[72418]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 09 18:29:46 user nova-compute[72418]:     <disk type='file' device='disk'>
Aug 09 18:29:46 user nova-compute[72418]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 09 18:29:46 user nova-compute[72418]:       <source file='/opt/stack/data/nova/instances/688f50af-0e41-4467-b2db-04ac22f62963/disk' index='2'/>
Aug 09 18:29:46 user nova-compute[72418]:       <backingStore type='file' index='3'>
Aug 09 18:29:46 user nova-compute[72418]:         <format type='raw'/>
Aug 09 18:29:46 user nova-compute[72418]:         <source file='/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71'/>
Aug 09 18:29:46 user nova-compute[72418]:         <backingStore/>
Aug 09 18:29:46 user nova-compute[72418]:       </backingStore>
Aug 09 18:29:46 user nova-compute[72418]:       <target dev='vda' bus='virtio'/>
Aug 09 18:29:46 user nova-compute[72418]:       <alias name='virtio-disk0'/>
Aug 09 18:29:46 user nova-compute[72418]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 09 18:29:46 user nova-compute[72418]:     </disk>
Aug 09 18:29:46 user nova-compute[72418]:     <disk type='file' device='cdrom'>
Aug 09 18:29:46 user nova-compute[72418]:       <driver name='qemu' type='raw' cache='none'/>
Aug 09 18:29:46 user nova-compute[72418]:       <source file='/opt/stack/data/nova/instances/688f50af-0e41-4467-b2db-04ac22f62963/disk.config' index='1'/>
Aug 09 18:29:46 user nova-compute[72418]:       <backingStore/>
Aug 09 18:29:46 user nova-compute[72418]:       <target dev='hda' bus='ide'/>
Aug 09 18:29:46 user nova-compute[72418]:       <readonly/>
Aug 09 18:29:46 user nova-compute[72418]:       <alias name='ide0-0-0'/>
Aug 09 18:29:46 user nova-compute[72418]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 09 18:29:46 user nova-compute[72418]:     </disk>
Aug 09 18:29:46 user nova-compute[72418]:     <controller type='usb' index='0' model='none'>
Aug 09 18:29:46 user nova-compute[72418]:       <alias name='usb'/>
Aug 09 18:29:46 user nova-compute[72418]:     </controller>
Aug 09 18:29:46 user nova-compute[72418]:     <controller type='pci' index='0' model='pci-root'>
Aug 09 18:29:46 user nova-compute[72418]:       <alias name='pci.0'/>
Aug 09 18:29:46 user nova-compute[72418]:     </controller>
Aug 09 18:29:46 user nova-compute[72418]:     <controller type='ide' index='0'>
Aug 09 18:29:46 user nova-compute[72418]:       <alias name='ide'/>
Aug 09 18:29:46 user nova-compute[72418]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 09 18:29:46 user nova-compute[72418]:     </controller>
Aug 09 18:29:46 user nova-compute[72418]:     <interface type='ethernet'>
Aug 09 18:29:46 user nova-compute[72418]:       <mac address='fa:16:3e:0a:9c:69'/>
Aug 09 18:29:46 user nova-compute[72418]:       <target dev='tapb2c3fa50-56'/>
Aug 09 18:29:46 user nova-compute[72418]:       <model type='virtio'/>
Aug 09 18:29:46 user nova-compute[72418]:       <mtu size='1442'/>
Aug 09 18:29:46 user nova-compute[72418]:       <alias name='net0'/>
Aug 09 18:29:46 user nova-compute[72418]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 09 18:29:46 user nova-compute[72418]:     </interface>
Aug 09 18:29:46 user nova-compute[72418]:     <serial type='pty'>
Aug 09 18:29:46 user nova-compute[72418]:       <source path='/dev/pts/5'/>
Aug 09 18:29:46 user nova-compute[72418]:       <log file='/opt/stack/data/nova/instances/688f50af-0e41-4467-b2db-04ac22f62963/console.log' append='off'/>
Aug 09 18:29:46 user nova-compute[72418]:       <target type='isa-serial' port='0'>
Aug 09 18:29:46 user nova-compute[72418]:         <model name='isa-serial'/>
Aug 09 18:29:46 user nova-compute[72418]:       </target>
Aug 09 18:29:46 user nova-compute[72418]:       <alias name='serial0'/>
Aug 09 18:29:46 user nova-compute[72418]:     </serial>
Aug 09 18:29:46 user nova-compute[72418]:     <console type='pty' tty='/dev/pts/5'>
Aug 09 18:29:46 user nova-compute[72418]:       <source path='/dev/pts/5'/>
Aug 09 18:29:46 user nova-compute[72418]:       <log file='/opt/stack/data/nova/instances/688f50af-0e41-4467-b2db-04ac22f62963/console.log' append='off'/>
Aug 09 18:29:46 user nova-compute[72418]:       <target type='serial' port='0'/>
Aug 09 18:29:46 user nova-compute[72418]:       <alias name='serial0'/>
Aug 09 18:29:46 user nova-compute[72418]:     </console>
Aug 09 18:29:46 user nova-compute[72418]:     <input type='mouse' bus='ps2'>
Aug 09 18:29:46 user nova-compute[72418]:       <alias name='input0'/>
Aug 09 18:29:46 user nova-compute[72418]:     </input>
Aug 09 18:29:46 user nova-compute[72418]:     <input type='keyboard' bus='ps2'>
Aug 09 18:29:46 user nova-compute[72418]:       <alias name='input1'/>
Aug 09 18:29:46 user nova-compute[72418]:     </input>
Aug 09 18:29:46 user nova-compute[72418]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Aug 09 18:29:46 user nova-compute[72418]:       <listen type='address' address='0.0.0.0'/>
Aug 09 18:29:46 user nova-compute[72418]:     </graphics>
Aug 09 18:29:46 user nova-compute[72418]:     <audio id='1' type='none'/>
Aug 09 18:29:46 user nova-compute[72418]:     <video>
Aug 09 18:29:46 user nova-compute[72418]:       <model type='virtio' heads='1' primary='yes'/>
Aug 09 18:29:46 user nova-compute[72418]:       <alias name='video0'/>
Aug 09 18:29:46 user nova-compute[72418]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 09 18:29:46 user nova-compute[72418]:     </video>
Aug 09 18:29:46 user nova-compute[72418]:     <memballoon model='virtio'>
Aug 09 18:29:46 user nova-compute[72418]:       <stats period='10'/>
Aug 09 18:29:46 user nova-compute[72418]:       <alias name='balloon0'/>
Aug 09 18:29:46 user nova-compute[72418]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 09 18:29:46 user nova-compute[72418]:     </memballoon>
Aug 09 18:29:46 user nova-compute[72418]:     <rng model='virtio'>
Aug 09 18:29:46 user nova-compute[72418]:       <backend model='random'>/dev/urandom</backend>
Aug 09 18:29:46 user nova-compute[72418]:       <alias name='rng0'/>
Aug 09 18:29:46 user nova-compute[72418]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 09 18:29:46 user nova-compute[72418]:     </rng>
Aug 09 18:29:46 user nova-compute[72418]:   </devices>
Aug 09 18:29:46 user nova-compute[72418]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 09 18:29:46 user nova-compute[72418]:     <label>libvirt-688f50af-0e41-4467-b2db-04ac22f62963</label>
Aug 09 18:29:46 user nova-compute[72418]:     <imagelabel>libvirt-688f50af-0e41-4467-b2db-04ac22f62963</imagelabel>
Aug 09 18:29:46 user nova-compute[72418]:   </seclabel>
Aug 09 18:29:46 user nova-compute[72418]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 09 18:29:46 user nova-compute[72418]:     <label>+64055:+108</label>
Aug 09 18:29:46 user nova-compute[72418]:     <imagelabel>+64055:+108</imagelabel>
Aug 09 18:29:46 user nova-compute[72418]:   </seclabel>
Aug 09 18:29:46 user nova-compute[72418]: </domain>
Aug 09 18:29:46 user nova-compute[72418]:  {{(pid=72418) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 09 18:29:46 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-ff90820d-6cb1-4c3d-a01a-79e4334b95ed tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Successfully detached device tap2fe18f2b-80 from instance 688f50af-0e41-4467-b2db-04ac22f62963 from the live domain config.
Aug 09 18:29:46 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-ff90820d-6cb1-4c3d-a01a-79e4334b95ed tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T18:27:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-630623237',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-630623237',id=20,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJchtztQL/UH2D7W5ks5SFjnLeiOZKRpefilUR0gjk7AuwJAWWS/gJOgdgu+Tp4jMu5wIaL/uSL50sh+6WeG1BBlMsFAUgEPx6/v6KmgLX0CBGzXIbAnMWDK0rX8sqetTQ==',key_name='tempest-keypair-267340570',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:27:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='86896e6544164fda93f7bea95a751707',ramdisk_id='',reservation_id='r-fo0cn966',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1428601923',owner_user_name='tempest-TaggedAttachmentsTest-1428601923-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:27:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df6cd3ad06524ae59968b133efceaa4c',uuid=688f50af-0e41-4467-b2db-04ac22f62963,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2fe18f2b-8036-42df-94d0-42e747c60d1a", "address": "fa:16:3e:15:c3:cd", "network": {"id": "77cad7ee-baee-4e0e-b735-9ac6302d9c3b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1355806010", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "86896e6544164fda93f7bea95a751707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fe18f2b-80", "ovs_interfaceid": "2fe18f2b-8036-42df-94d0-42e747c60d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 18:29:46 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-ff90820d-6cb1-4c3d-a01a-79e4334b95ed tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Converting VIF {"id": "2fe18f2b-8036-42df-94d0-42e747c60d1a", "address": "fa:16:3e:15:c3:cd", "network": {"id": "77cad7ee-baee-4e0e-b735-9ac6302d9c3b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1355806010", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "86896e6544164fda93f7bea95a751707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fe18f2b-80", "ovs_interfaceid": "2fe18f2b-8036-42df-94d0-42e747c60d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:29:46 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-ff90820d-6cb1-4c3d-a01a-79e4334b95ed tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:c3:cd,bridge_name='br-int',has_traffic_filtering=True,id=2fe18f2b-8036-42df-94d0-42e747c60d1a,network=Network(77cad7ee-baee-4e0e-b735-9ac6302d9c3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fe18f2b-80') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:29:46 user nova-compute[72418]: DEBUG os_vif [None req-ff90820d-6cb1-4c3d-a01a-79e4334b95ed tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:c3:cd,bridge_name='br-int',has_traffic_filtering=True,id=2fe18f2b-8036-42df-94d0-42e747c60d1a,network=Network(77cad7ee-baee-4e0e-b735-9ac6302d9c3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fe18f2b-80') {{(pid=72418) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 18:29:46 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:46 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:46 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2fe18f2b-80, bridge=br-int, if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:29:46 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:46 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:29:46 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:46 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:46 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:46 user nova-compute[72418]: INFO os_vif [None req-ff90820d-6cb1-4c3d-a01a-79e4334b95ed tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:c3:cd,bridge_name='br-int',has_traffic_filtering=True,id=2fe18f2b-8036-42df-94d0-42e747c60d1a,network=Network(77cad7ee-baee-4e0e-b735-9ac6302d9c3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fe18f2b-80')
Aug 09 18:29:46 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-ff90820d-6cb1-4c3d-a01a-79e4334b95ed tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:29:46 user nova-compute[72418]:   <nova:package version="0.0.0"/>
Aug 09 18:29:46 user nova-compute[72418]:   <nova:name>tempest-device-tagging-server-630623237</nova:name>
Aug 09 18:29:46 user nova-compute[72418]:   <nova:creationTime>2023-08-09 18:29:46</nova:creationTime>
Aug 09 18:29:46 user nova-compute[72418]:   <nova:flavor name="m1.tiny">
Aug 09 18:29:46 user nova-compute[72418]:     <nova:memory>512</nova:memory>
Aug 09 18:29:46 user nova-compute[72418]:     <nova:disk>1</nova:disk>
Aug 09 18:29:46 user nova-compute[72418]:     <nova:swap>0</nova:swap>
Aug 09 18:29:46 user nova-compute[72418]:     <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:29:46 user nova-compute[72418]:     <nova:vcpus>1</nova:vcpus>
Aug 09 18:29:46 user nova-compute[72418]:   </nova:flavor>
Aug 09 18:29:46 user nova-compute[72418]:   <nova:owner>
Aug 09 18:29:46 user nova-compute[72418]:     <nova:user uuid="df6cd3ad06524ae59968b133efceaa4c">tempest-TaggedAttachmentsTest-1428601923-project-member</nova:user>
Aug 09 18:29:46 user nova-compute[72418]:     <nova:project uuid="86896e6544164fda93f7bea95a751707">tempest-TaggedAttachmentsTest-1428601923</nova:project>
Aug 09 18:29:46 user nova-compute[72418]:   </nova:owner>
Aug 09 18:29:46 user nova-compute[72418]:   <nova:root type="image" uuid="8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e"/>
Aug 09 18:29:46 user nova-compute[72418]:   <nova:ports>
Aug 09 18:29:46 user nova-compute[72418]:     <nova:port uuid="b2c3fa50-5615-4a58-8820-54c67c5d65bc">
Aug 09 18:29:46 user nova-compute[72418]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 09 18:29:46 user nova-compute[72418]:     </nova:port>
Aug 09 18:29:46 user nova-compute[72418]:   </nova:ports>
Aug 09 18:29:46 user nova-compute[72418]: </nova:instance>
Aug 09 18:29:46 user nova-compute[72418]:  {{(pid=72418) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 09 18:29:46 user nova-compute[72418]: DEBUG nova.compute.manager [req-87ab6903-23fe-4bdb-ab20-db92e27b9cc1 req-bf1ae7d8-a4d0-42b9-9f6c-2e3b76237fc2 service nova] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Received event network-vif-unplugged-2fe18f2b-8036-42df-94d0-42e747c60d1a {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:29:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-87ab6903-23fe-4bdb-ab20-db92e27b9cc1 req-bf1ae7d8-a4d0-42b9-9f6c-2e3b76237fc2 service nova] Acquiring lock "688f50af-0e41-4467-b2db-04ac22f62963-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:29:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-87ab6903-23fe-4bdb-ab20-db92e27b9cc1 req-bf1ae7d8-a4d0-42b9-9f6c-2e3b76237fc2 service nova] Lock "688f50af-0e41-4467-b2db-04ac22f62963-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:29:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-87ab6903-23fe-4bdb-ab20-db92e27b9cc1 req-bf1ae7d8-a4d0-42b9-9f6c-2e3b76237fc2 service nova] Lock "688f50af-0e41-4467-b2db-04ac22f62963-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:29:46 user nova-compute[72418]: DEBUG nova.compute.manager [req-87ab6903-23fe-4bdb-ab20-db92e27b9cc1 req-bf1ae7d8-a4d0-42b9-9f6c-2e3b76237fc2 service nova] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] No waiting events found dispatching network-vif-unplugged-2fe18f2b-8036-42df-94d0-42e747c60d1a {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:29:46 user nova-compute[72418]: WARNING nova.compute.manager [req-87ab6903-23fe-4bdb-ab20-db92e27b9cc1 req-bf1ae7d8-a4d0-42b9-9f6c-2e3b76237fc2 service nova] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Received unexpected event network-vif-unplugged-2fe18f2b-8036-42df-94d0-42e747c60d1a for instance with vm_state active and task_state None.
Aug 09 18:29:47 user nova-compute[72418]: DEBUG nova.compute.manager [req-fb659ab5-f8f7-4abb-91ea-eaf15ff2472d req-a642fecf-3bf8-4a36-ba3b-a4cb28970fe3 service nova] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Received event network-vif-deleted-2fe18f2b-8036-42df-94d0-42e747c60d1a {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:29:47 user nova-compute[72418]: INFO nova.compute.manager [req-fb659ab5-f8f7-4abb-91ea-eaf15ff2472d req-a642fecf-3bf8-4a36-ba3b-a4cb28970fe3 service nova] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Neutron deleted interface 2fe18f2b-8036-42df-94d0-42e747c60d1a; detaching it from the instance and deleting it from the info cache
Aug 09 18:29:47 user nova-compute[72418]: DEBUG nova.network.neutron [req-fb659ab5-f8f7-4abb-91ea-eaf15ff2472d req-a642fecf-3bf8-4a36-ba3b-a4cb28970fe3 service nova] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Updating instance_info_cache with network_info: [{"id": "b2c3fa50-5615-4a58-8820-54c67c5d65bc", "address": "fa:16:3e:0a:9c:69", "network": {"id": "e24f7df5-d3a9-477d-997c-c145a2613ec8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1802267495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86896e6544164fda93f7bea95a751707", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c3fa50-56", "ovs_interfaceid": "b2c3fa50-5615-4a58-8820-54c67c5d65bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:29:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ff90820d-6cb1-4c3d-a01a-79e4334b95ed tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Acquiring lock "refresh_cache-688f50af-0e41-4467-b2db-04ac22f62963" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:29:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ff90820d-6cb1-4c3d-a01a-79e4334b95ed tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Acquired lock "refresh_cache-688f50af-0e41-4467-b2db-04ac22f62963" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:29:47 user nova-compute[72418]: DEBUG nova.network.neutron [None req-ff90820d-6cb1-4c3d-a01a-79e4334b95ed tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:29:47 user nova-compute[72418]: DEBUG nova.objects.instance [req-fb659ab5-f8f7-4abb-91ea-eaf15ff2472d req-a642fecf-3bf8-4a36-ba3b-a4cb28970fe3 service nova] Lazy-loading 'system_metadata' on Instance uuid 688f50af-0e41-4467-b2db-04ac22f62963 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:29:47 user nova-compute[72418]: DEBUG nova.objects.instance [req-fb659ab5-f8f7-4abb-91ea-eaf15ff2472d req-a642fecf-3bf8-4a36-ba3b-a4cb28970fe3 service nova] Lazy-loading 'flavor' on Instance uuid 688f50af-0e41-4467-b2db-04ac22f62963 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:29:47 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [req-fb659ab5-f8f7-4abb-91ea-eaf15ff2472d req-a642fecf-3bf8-4a36-ba3b-a4cb28970fe3 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T18:27:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-630623237',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-630623237',id=20,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJchtztQL/UH2D7W5ks5SFjnLeiOZKRpefilUR0gjk7AuwJAWWS/gJOgdgu+Tp4jMu5wIaL/uSL50sh+6WeG1BBlMsFAUgEPx6/v6KmgLX0CBGzXIbAnMWDK0rX8sqetTQ==',key_name='tempest-keypair-267340570',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:27:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='86896e6544164fda93f7bea95a751707',ramdisk_id='',reservation_id='r-fo0cn966',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1428601923',owner_user_name='tempest-TaggedAttachmentsTest-1428601923-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:27:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df6cd3ad06524ae59968b133efceaa4c',uuid=688f50af-0e41-4467-b2db-04ac22f62963,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2fe18f2b-8036-42df-94d0-42e747c60d1a", "address": "fa:16:3e:15:c3:cd", "network": {"id": "77cad7ee-baee-4e0e-b735-9ac6302d9c3b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1355806010", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "86896e6544164fda93f7bea95a751707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fe18f2b-80", "ovs_interfaceid": "2fe18f2b-8036-42df-94d0-42e747c60d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:29:47 user nova-compute[72418]: DEBUG nova.network.os_vif_util [req-fb659ab5-f8f7-4abb-91ea-eaf15ff2472d req-a642fecf-3bf8-4a36-ba3b-a4cb28970fe3 service nova] Converting VIF {"id": "2fe18f2b-8036-42df-94d0-42e747c60d1a", "address": "fa:16:3e:15:c3:cd", "network": {"id": "77cad7ee-baee-4e0e-b735-9ac6302d9c3b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1355806010", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "86896e6544164fda93f7bea95a751707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fe18f2b-80", "ovs_interfaceid": "2fe18f2b-8036-42df-94d0-42e747c60d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:29:47 user nova-compute[72418]: DEBUG nova.network.os_vif_util [req-fb659ab5-f8f7-4abb-91ea-eaf15ff2472d req-a642fecf-3bf8-4a36-ba3b-a4cb28970fe3 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:c3:cd,bridge_name='br-int',has_traffic_filtering=True,id=2fe18f2b-8036-42df-94d0-42e747c60d1a,network=Network(77cad7ee-baee-4e0e-b735-9ac6302d9c3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fe18f2b-80') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:29:47 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [req-fb659ab5-f8f7-4abb-91ea-eaf15ff2472d req-a642fecf-3bf8-4a36-ba3b-a4cb28970fe3 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:15:c3:cd"/><model type="virtio"/><mtu size="1442"/><target dev="tap2fe18f2b-80"/></interface> {{(pid=72418) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 09 18:29:47 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [req-fb659ab5-f8f7-4abb-91ea-eaf15ff2472d req-a642fecf-3bf8-4a36-ba3b-a4cb28970fe3 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:15:c3:cd"/><model type="virtio"/><mtu size="1442"/><target dev="tap2fe18f2b-80"/></interface>not found in domain: <domain type='kvm' id='24'>
Aug 09 18:29:47 user nova-compute[72418]:   <name>instance-00000014</name>
Aug 09 18:29:47 user nova-compute[72418]:   <uuid>688f50af-0e41-4467-b2db-04ac22f62963</uuid>
Aug 09 18:29:47 user nova-compute[72418]:   <metadata>
Aug 09 18:29:47 user nova-compute[72418]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:29:47 user nova-compute[72418]:   <nova:package version="0.0.0"/>
Aug 09 18:29:47 user nova-compute[72418]:   <nova:name>tempest-device-tagging-server-630623237</nova:name>
Aug 09 18:29:47 user nova-compute[72418]:   <nova:creationTime>2023-08-09 18:29:46</nova:creationTime>
Aug 09 18:29:47 user nova-compute[72418]:   <nova:flavor name="m1.tiny">
Aug 09 18:29:47 user nova-compute[72418]:     <nova:memory>512</nova:memory>
Aug 09 18:29:47 user nova-compute[72418]:     <nova:disk>1</nova:disk>
Aug 09 18:29:47 user nova-compute[72418]:     <nova:swap>0</nova:swap>
Aug 09 18:29:47 user nova-compute[72418]:     <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:29:47 user nova-compute[72418]:     <nova:vcpus>1</nova:vcpus>
Aug 09 18:29:47 user nova-compute[72418]:   </nova:flavor>
Aug 09 18:29:47 user nova-compute[72418]:   <nova:owner>
Aug 09 18:29:47 user nova-compute[72418]:     <nova:user uuid="df6cd3ad06524ae59968b133efceaa4c">tempest-TaggedAttachmentsTest-1428601923-project-member</nova:user>
Aug 09 18:29:47 user nova-compute[72418]:     <nova:project uuid="86896e6544164fda93f7bea95a751707">tempest-TaggedAttachmentsTest-1428601923</nova:project>
Aug 09 18:29:47 user nova-compute[72418]:   </nova:owner>
Aug 09 18:29:47 user nova-compute[72418]:   <nova:root type="image" uuid="8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e"/>
Aug 09 18:29:47 user nova-compute[72418]:   <nova:ports>
Aug 09 18:29:47 user nova-compute[72418]:     <nova:port uuid="b2c3fa50-5615-4a58-8820-54c67c5d65bc">
Aug 09 18:29:47 user nova-compute[72418]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 09 18:29:47 user nova-compute[72418]:     </nova:port>
Aug 09 18:29:47 user nova-compute[72418]:   </nova:ports>
Aug 09 18:29:47 user nova-compute[72418]: </nova:instance>
Aug 09 18:29:47 user nova-compute[72418]:   </metadata>
Aug 09 18:29:47 user nova-compute[72418]:   <memory unit='KiB'>524288</memory>
Aug 09 18:29:47 user nova-compute[72418]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 09 18:29:47 user nova-compute[72418]:   <vcpu placement='static'>1</vcpu>
Aug 09 18:29:47 user nova-compute[72418]:   <resource>
Aug 09 18:29:47 user nova-compute[72418]:     <partition>/machine</partition>
Aug 09 18:29:47 user nova-compute[72418]:   </resource>
Aug 09 18:29:47 user nova-compute[72418]:   <sysinfo type='smbios'>
Aug 09 18:29:47 user nova-compute[72418]:     <system>
Aug 09 18:29:47 user nova-compute[72418]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 09 18:29:47 user nova-compute[72418]:       <entry name='product'>OpenStack Nova</entry>
Aug 09 18:29:47 user nova-compute[72418]:       <entry name='version'>0.0.0</entry>
Aug 09 18:29:47 user nova-compute[72418]:       <entry name='serial'>688f50af-0e41-4467-b2db-04ac22f62963</entry>
Aug 09 18:29:47 user nova-compute[72418]:       <entry name='uuid'>688f50af-0e41-4467-b2db-04ac22f62963</entry>
Aug 09 18:29:47 user nova-compute[72418]:       <entry name='family'>Virtual Machine</entry>
Aug 09 18:29:47 user nova-compute[72418]:     </system>
Aug 09 18:29:47 user nova-compute[72418]:   </sysinfo>
Aug 09 18:29:47 user nova-compute[72418]:   <os>
Aug 09 18:29:47 user nova-compute[72418]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 09 18:29:47 user nova-compute[72418]:     <boot dev='hd'/>
Aug 09 18:29:47 user nova-compute[72418]:     <smbios mode='sysinfo'/>
Aug 09 18:29:47 user nova-compute[72418]:   </os>
Aug 09 18:29:47 user nova-compute[72418]:   <features>
Aug 09 18:29:47 user nova-compute[72418]:     <acpi/>
Aug 09 18:29:47 user nova-compute[72418]:     <apic/>
Aug 09 18:29:47 user nova-compute[72418]:     <vmcoreinfo state='on'/>
Aug 09 18:29:47 user nova-compute[72418]:   </features>
Aug 09 18:29:47 user nova-compute[72418]:   <cpu mode='custom' match='exact' check='full'>
Aug 09 18:29:47 user nova-compute[72418]:     <model fallback='forbid'>Nehalem</model>
Aug 09 18:29:47 user nova-compute[72418]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 09 18:29:47 user nova-compute[72418]:     <feature policy='require' name='vme'/>
Aug 09 18:29:47 user nova-compute[72418]:     <feature policy='require' name='x2apic'/>
Aug 09 18:29:47 user nova-compute[72418]:     <feature policy='require' name='hypervisor'/>
Aug 09 18:29:47 user nova-compute[72418]:   </cpu>
Aug 09 18:29:47 user nova-compute[72418]:   <clock offset='utc'>
Aug 09 18:29:47 user nova-compute[72418]:     <timer name='pit' tickpolicy='delay'/>
Aug 09 18:29:47 user nova-compute[72418]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 09 18:29:47 user nova-compute[72418]:     <timer name='hpet' present='no'/>
Aug 09 18:29:47 user nova-compute[72418]:   </clock>
Aug 09 18:29:47 user nova-compute[72418]:   <on_poweroff>destroy</on_poweroff>
Aug 09 18:29:47 user nova-compute[72418]:   <on_reboot>restart</on_reboot>
Aug 09 18:29:47 user nova-compute[72418]:   <on_crash>destroy</on_crash>
Aug 09 18:29:47 user nova-compute[72418]:   <devices>
Aug 09 18:29:47 user nova-compute[72418]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 09 18:29:47 user nova-compute[72418]:     <disk type='file' device='disk'>
Aug 09 18:29:47 user nova-compute[72418]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 09 18:29:47 user nova-compute[72418]:       <source file='/opt/stack/data/nova/instances/688f50af-0e41-4467-b2db-04ac22f62963/disk' index='2'/>
Aug 09 18:29:47 user nova-compute[72418]:       <backingStore type='file' index='3'>
Aug 09 18:29:47 user nova-compute[72418]:         <format type='raw'/>
Aug 09 18:29:47 user nova-compute[72418]:         <source file='/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71'/>
Aug 09 18:29:47 user nova-compute[72418]:         <backingStore/>
Aug 09 18:29:47 user nova-compute[72418]:       </backingStore>
Aug 09 18:29:47 user nova-compute[72418]:       <target dev='vda' bus='virtio'/>
Aug 09 18:29:47 user nova-compute[72418]:       <alias name='virtio-disk0'/>
Aug 09 18:29:47 user nova-compute[72418]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 09 18:29:47 user nova-compute[72418]:     </disk>
Aug 09 18:29:47 user nova-compute[72418]:     <disk type='file' device='cdrom'>
Aug 09 18:29:47 user nova-compute[72418]:       <driver name='qemu' type='raw' cache='none'/>
Aug 09 18:29:47 user nova-compute[72418]:       <source file='/opt/stack/data/nova/instances/688f50af-0e41-4467-b2db-04ac22f62963/disk.config' index='1'/>
Aug 09 18:29:47 user nova-compute[72418]:       <backingStore/>
Aug 09 18:29:47 user nova-compute[72418]:       <target dev='hda' bus='ide'/>
Aug 09 18:29:47 user nova-compute[72418]:       <readonly/>
Aug 09 18:29:47 user nova-compute[72418]:       <alias name='ide0-0-0'/>
Aug 09 18:29:47 user nova-compute[72418]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 09 18:29:47 user nova-compute[72418]:     </disk>
Aug 09 18:29:47 user nova-compute[72418]:     <controller type='usb' index='0' model='none'>
Aug 09 18:29:47 user nova-compute[72418]:       <alias name='usb'/>
Aug 09 18:29:47 user nova-compute[72418]:     </controller>
Aug 09 18:29:47 user nova-compute[72418]:     <controller type='pci' index='0' model='pci-root'>
Aug 09 18:29:47 user nova-compute[72418]:       <alias name='pci.0'/>
Aug 09 18:29:47 user nova-compute[72418]:     </controller>
Aug 09 18:29:47 user nova-compute[72418]:     <controller type='ide' index='0'>
Aug 09 18:29:47 user nova-compute[72418]:       <alias name='ide'/>
Aug 09 18:29:47 user nova-compute[72418]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 09 18:29:47 user nova-compute[72418]:     </controller>
Aug 09 18:29:47 user nova-compute[72418]:     <interface type='ethernet'>
Aug 09 18:29:47 user nova-compute[72418]:       <mac address='fa:16:3e:0a:9c:69'/>
Aug 09 18:29:47 user nova-compute[72418]:       <target dev='tapb2c3fa50-56'/>
Aug 09 18:29:47 user nova-compute[72418]:       <model type='virtio'/>
Aug 09 18:29:47 user nova-compute[72418]:       <mtu size='1442'/>
Aug 09 18:29:47 user nova-compute[72418]:       <alias name='net0'/>
Aug 09 18:29:47 user nova-compute[72418]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 09 18:29:47 user nova-compute[72418]:     </interface>
Aug 09 18:29:47 user nova-compute[72418]:     <serial type='pty'>
Aug 09 18:29:47 user nova-compute[72418]:       <source path='/dev/pts/5'/>
Aug 09 18:29:47 user nova-compute[72418]:       <log file='/opt/stack/data/nova/instances/688f50af-0e41-4467-b2db-04ac22f62963/console.log' append='off'/>
Aug 09 18:29:47 user nova-compute[72418]:       <target type='isa-serial' port='0'>
Aug 09 18:29:47 user nova-compute[72418]:         <model name='isa-serial'/>
Aug 09 18:29:47 user nova-compute[72418]:       </target>
Aug 09 18:29:47 user nova-compute[72418]:       <alias name='serial0'/>
Aug 09 18:29:47 user nova-compute[72418]:     </serial>
Aug 09 18:29:47 user nova-compute[72418]:     <console type='pty' tty='/dev/pts/5'>
Aug 09 18:29:47 user nova-compute[72418]:       <source path='/dev/pts/5'/>
Aug 09 18:29:47 user nova-compute[72418]:       <log file='/opt/stack/data/nova/instances/688f50af-0e41-4467-b2db-04ac22f62963/console.log' append='off'/>
Aug 09 18:29:47 user nova-compute[72418]:       <target type='serial' port='0'/>
Aug 09 18:29:47 user nova-compute[72418]:       <alias name='serial0'/>
Aug 09 18:29:47 user nova-compute[72418]:     </console>
Aug 09 18:29:47 user nova-compute[72418]:     <input type='mouse' bus='ps2'>
Aug 09 18:29:47 user nova-compute[72418]:       <alias name='input0'/>
Aug 09 18:29:47 user nova-compute[72418]:     </input>
Aug 09 18:29:47 user nova-compute[72418]:     <input type='keyboard' bus='ps2'>
Aug 09 18:29:47 user nova-compute[72418]:       <alias name='input1'/>
Aug 09 18:29:47 user nova-compute[72418]:     </input>
Aug 09 18:29:47 user nova-compute[72418]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Aug 09 18:29:47 user nova-compute[72418]:       <listen type='address' address='0.0.0.0'/>
Aug 09 18:29:47 user nova-compute[72418]:     </graphics>
Aug 09 18:29:47 user nova-compute[72418]:     <audio id='1' type='none'/>
Aug 09 18:29:47 user nova-compute[72418]:     <video>
Aug 09 18:29:47 user nova-compute[72418]:       <model type='virtio' heads='1' primary='yes'/>
Aug 09 18:29:47 user nova-compute[72418]:       <alias name='video0'/>
Aug 09 18:29:47 user nova-compute[72418]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 09 18:29:47 user nova-compute[72418]:     </video>
Aug 09 18:29:47 user nova-compute[72418]:     <memballoon model='virtio'>
Aug 09 18:29:47 user nova-compute[72418]:       <stats period='10'/>
Aug 09 18:29:47 user nova-compute[72418]:       <alias name='balloon0'/>
Aug 09 18:29:47 user nova-compute[72418]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 09 18:29:47 user nova-compute[72418]:     </memballoon>
Aug 09 18:29:47 user nova-compute[72418]:     <rng model='virtio'>
Aug 09 18:29:47 user nova-compute[72418]:       <backend model='random'>/dev/urandom</backend>
Aug 09 18:29:47 user nova-compute[72418]:       <alias name='rng0'/>
Aug 09 18:29:47 user nova-compute[72418]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 09 18:29:47 user nova-compute[72418]:     </rng>
Aug 09 18:29:47 user nova-compute[72418]:   </devices>
Aug 09 18:29:47 user nova-compute[72418]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 09 18:29:47 user nova-compute[72418]:     <label>libvirt-688f50af-0e41-4467-b2db-04ac22f62963</label>
Aug 09 18:29:47 user nova-compute[72418]:     <imagelabel>libvirt-688f50af-0e41-4467-b2db-04ac22f62963</imagelabel>
Aug 09 18:29:47 user nova-compute[72418]:   </seclabel>
Aug 09 18:29:47 user nova-compute[72418]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 09 18:29:47 user nova-compute[72418]:     <label>+64055:+108</label>
Aug 09 18:29:47 user nova-compute[72418]:     <imagelabel>+64055:+108</imagelabel>
Aug 09 18:29:47 user nova-compute[72418]:   </seclabel>
Aug 09 18:29:47 user nova-compute[72418]: </domain>
Aug 09 18:29:47 user nova-compute[72418]:  {{(pid=72418) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 09 18:29:47 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [req-fb659ab5-f8f7-4abb-91ea-eaf15ff2472d req-a642fecf-3bf8-4a36-ba3b-a4cb28970fe3 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:15:c3:cd"/><model type="virtio"/><mtu size="1442"/><target dev="tap2fe18f2b-80"/></interface> {{(pid=72418) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 09 18:29:47 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [req-fb659ab5-f8f7-4abb-91ea-eaf15ff2472d req-a642fecf-3bf8-4a36-ba3b-a4cb28970fe3 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:15:c3:cd"/><model type="virtio"/><mtu size="1442"/><target dev="tap2fe18f2b-80"/></interface>not found in domain: <domain type='kvm' id='24'>
Aug 09 18:29:47 user nova-compute[72418]:   <name>instance-00000014</name>
Aug 09 18:29:47 user nova-compute[72418]:   <uuid>688f50af-0e41-4467-b2db-04ac22f62963</uuid>
Aug 09 18:29:47 user nova-compute[72418]:   <metadata>
Aug 09 18:29:47 user nova-compute[72418]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:29:47 user nova-compute[72418]:   <nova:package version="0.0.0"/>
Aug 09 18:29:47 user nova-compute[72418]:   <nova:name>tempest-device-tagging-server-630623237</nova:name>
Aug 09 18:29:47 user nova-compute[72418]:   <nova:creationTime>2023-08-09 18:29:46</nova:creationTime>
Aug 09 18:29:47 user nova-compute[72418]:   <nova:flavor name="m1.tiny">
Aug 09 18:29:47 user nova-compute[72418]:     <nova:memory>512</nova:memory>
Aug 09 18:29:47 user nova-compute[72418]:     <nova:disk>1</nova:disk>
Aug 09 18:29:47 user nova-compute[72418]:     <nova:swap>0</nova:swap>
Aug 09 18:29:47 user nova-compute[72418]:     <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:29:47 user nova-compute[72418]:     <nova:vcpus>1</nova:vcpus>
Aug 09 18:29:47 user nova-compute[72418]:   </nova:flavor>
Aug 09 18:29:47 user nova-compute[72418]:   <nova:owner>
Aug 09 18:29:47 user nova-compute[72418]:     <nova:user uuid="df6cd3ad06524ae59968b133efceaa4c">tempest-TaggedAttachmentsTest-1428601923-project-member</nova:user>
Aug 09 18:29:47 user nova-compute[72418]:     <nova:project uuid="86896e6544164fda93f7bea95a751707">tempest-TaggedAttachmentsTest-1428601923</nova:project>
Aug 09 18:29:47 user nova-compute[72418]:   </nova:owner>
Aug 09 18:29:47 user nova-compute[72418]:   <nova:root type="image" uuid="8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e"/>
Aug 09 18:29:47 user nova-compute[72418]:   <nova:ports>
Aug 09 18:29:47 user nova-compute[72418]:     <nova:port uuid="b2c3fa50-5615-4a58-8820-54c67c5d65bc">
Aug 09 18:29:47 user nova-compute[72418]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 09 18:29:47 user nova-compute[72418]:     </nova:port>
Aug 09 18:29:47 user nova-compute[72418]:   </nova:ports>
Aug 09 18:29:47 user nova-compute[72418]: </nova:instance>
Aug 09 18:29:47 user nova-compute[72418]:   </metadata>
Aug 09 18:29:47 user nova-compute[72418]:   <memory unit='KiB'>524288</memory>
Aug 09 18:29:47 user nova-compute[72418]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 09 18:29:47 user nova-compute[72418]:   <vcpu placement='static'>1</vcpu>
Aug 09 18:29:47 user nova-compute[72418]:   <resource>
Aug 09 18:29:47 user nova-compute[72418]:     <partition>/machine</partition>
Aug 09 18:29:47 user nova-compute[72418]:   </resource>
Aug 09 18:29:47 user nova-compute[72418]:   <sysinfo type='smbios'>
Aug 09 18:29:47 user nova-compute[72418]:     <system>
Aug 09 18:29:47 user nova-compute[72418]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 09 18:29:47 user nova-compute[72418]:       <entry name='product'>OpenStack Nova</entry>
Aug 09 18:29:47 user nova-compute[72418]:       <entry name='version'>0.0.0</entry>
Aug 09 18:29:47 user nova-compute[72418]:       <entry name='serial'>688f50af-0e41-4467-b2db-04ac22f62963</entry>
Aug 09 18:29:47 user nova-compute[72418]:       <entry name='uuid'>688f50af-0e41-4467-b2db-04ac22f62963</entry>
Aug 09 18:29:47 user nova-compute[72418]:       <entry name='family'>Virtual Machine</entry>
Aug 09 18:29:47 user nova-compute[72418]:     </system>
Aug 09 18:29:47 user nova-compute[72418]:   </sysinfo>
Aug 09 18:29:47 user nova-compute[72418]:   <os>
Aug 09 18:29:47 user nova-compute[72418]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 09 18:29:47 user nova-compute[72418]:     <boot dev='hd'/>
Aug 09 18:29:47 user nova-compute[72418]:     <smbios mode='sysinfo'/>
Aug 09 18:29:47 user nova-compute[72418]:   </os>
Aug 09 18:29:47 user nova-compute[72418]:   <features>
Aug 09 18:29:47 user nova-compute[72418]:     <acpi/>
Aug 09 18:29:47 user nova-compute[72418]:     <apic/>
Aug 09 18:29:47 user nova-compute[72418]:     <vmcoreinfo state='on'/>
Aug 09 18:29:47 user nova-compute[72418]:   </features>
Aug 09 18:29:47 user nova-compute[72418]:   <cpu mode='custom' match='exact' check='full'>
Aug 09 18:29:47 user nova-compute[72418]:     <model fallback='forbid'>Nehalem</model>
Aug 09 18:29:47 user nova-compute[72418]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 09 18:29:47 user nova-compute[72418]:     <feature policy='require' name='vme'/>
Aug 09 18:29:47 user nova-compute[72418]:     <feature policy='require' name='x2apic'/>
Aug 09 18:29:47 user nova-compute[72418]:     <feature policy='require' name='hypervisor'/>
Aug 09 18:29:47 user nova-compute[72418]:   </cpu>
Aug 09 18:29:47 user nova-compute[72418]:   <clock offset='utc'>
Aug 09 18:29:47 user nova-compute[72418]:     <timer name='pit' tickpolicy='delay'/>
Aug 09 18:29:47 user nova-compute[72418]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 09 18:29:47 user nova-compute[72418]:     <timer name='hpet' present='no'/>
Aug 09 18:29:47 user nova-compute[72418]:   </clock>
Aug 09 18:29:47 user nova-compute[72418]:   <on_poweroff>destroy</on_poweroff>
Aug 09 18:29:47 user nova-compute[72418]:   <on_reboot>restart</on_reboot>
Aug 09 18:29:47 user nova-compute[72418]:   <on_crash>destroy</on_crash>
Aug 09 18:29:47 user nova-compute[72418]:   <devices>
Aug 09 18:29:47 user nova-compute[72418]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 09 18:29:47 user nova-compute[72418]:     <disk type='file' device='disk'>
Aug 09 18:29:47 user nova-compute[72418]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 09 18:29:47 user nova-compute[72418]:       <source file='/opt/stack/data/nova/instances/688f50af-0e41-4467-b2db-04ac22f62963/disk' index='2'/>
Aug 09 18:29:47 user nova-compute[72418]:       <backingStore type='file' index='3'>
Aug 09 18:29:47 user nova-compute[72418]:         <format type='raw'/>
Aug 09 18:29:47 user nova-compute[72418]:         <source file='/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71'/>
Aug 09 18:29:47 user nova-compute[72418]:         <backingStore/>
Aug 09 18:29:47 user nova-compute[72418]:       </backingStore>
Aug 09 18:29:47 user nova-compute[72418]:       <target dev='vda' bus='virtio'/>
Aug 09 18:29:47 user nova-compute[72418]:       <alias name='virtio-disk0'/>
Aug 09 18:29:47 user nova-compute[72418]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 09 18:29:47 user nova-compute[72418]:     </disk>
Aug 09 18:29:47 user nova-compute[72418]:     <disk type='file' device='cdrom'>
Aug 09 18:29:47 user nova-compute[72418]:       <driver name='qemu' type='raw' cache='none'/>
Aug 09 18:29:47 user nova-compute[72418]:       <source file='/opt/stack/data/nova/instances/688f50af-0e41-4467-b2db-04ac22f62963/disk.config' index='1'/>
Aug 09 18:29:47 user nova-compute[72418]:       <backingStore/>
Aug 09 18:29:47 user nova-compute[72418]:       <target dev='hda' bus='ide'/>
Aug 09 18:29:47 user nova-compute[72418]:       <readonly/>
Aug 09 18:29:47 user nova-compute[72418]:       <alias name='ide0-0-0'/>
Aug 09 18:29:47 user nova-compute[72418]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 09 18:29:47 user nova-compute[72418]:     </disk>
Aug 09 18:29:47 user nova-compute[72418]:     <controller type='usb' index='0' model='none'>
Aug 09 18:29:47 user nova-compute[72418]:       <alias name='usb'/>
Aug 09 18:29:47 user nova-compute[72418]:     </controller>
Aug 09 18:29:47 user nova-compute[72418]:     <controller type='pci' index='0' model='pci-root'>
Aug 09 18:29:47 user nova-compute[72418]:       <alias name='pci.0'/>
Aug 09 18:29:47 user nova-compute[72418]:     </controller>
Aug 09 18:29:47 user nova-compute[72418]:     <controller type='ide' index='0'>
Aug 09 18:29:47 user nova-compute[72418]:       <alias name='ide'/>
Aug 09 18:29:47 user nova-compute[72418]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 09 18:29:47 user nova-compute[72418]:     </controller>
Aug 09 18:29:47 user nova-compute[72418]:     <interface type='ethernet'>
Aug 09 18:29:47 user nova-compute[72418]:       <mac address='fa:16:3e:0a:9c:69'/>
Aug 09 18:29:47 user nova-compute[72418]:       <target dev='tapb2c3fa50-56'/>
Aug 09 18:29:47 user nova-compute[72418]:       <model type='virtio'/>
Aug 09 18:29:47 user nova-compute[72418]:       <mtu size='1442'/>
Aug 09 18:29:47 user nova-compute[72418]:       <alias name='net0'/>
Aug 09 18:29:47 user nova-compute[72418]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 09 18:29:47 user nova-compute[72418]:     </interface>
Aug 09 18:29:47 user nova-compute[72418]:     <serial type='pty'>
Aug 09 18:29:47 user nova-compute[72418]:       <source path='/dev/pts/5'/>
Aug 09 18:29:47 user nova-compute[72418]:       <log file='/opt/stack/data/nova/instances/688f50af-0e41-4467-b2db-04ac22f62963/console.log' append='off'/>
Aug 09 18:29:47 user nova-compute[72418]:       <target type='isa-serial' port='0'>
Aug 09 18:29:47 user nova-compute[72418]:         <model name='isa-serial'/>
Aug 09 18:29:47 user nova-compute[72418]:       </target>
Aug 09 18:29:47 user nova-compute[72418]:       <alias name='serial0'/>
Aug 09 18:29:47 user nova-compute[72418]:     </serial>
Aug 09 18:29:47 user nova-compute[72418]:     <console type='pty' tty='/dev/pts/5'>
Aug 09 18:29:47 user nova-compute[72418]:       <source path='/dev/pts/5'/>
Aug 09 18:29:47 user nova-compute[72418]:       <log file='/opt/stack/data/nova/instances/688f50af-0e41-4467-b2db-04ac22f62963/console.log' append='off'/>
Aug 09 18:29:47 user nova-compute[72418]:       <target type='serial' port='0'/>
Aug 09 18:29:47 user nova-compute[72418]:       <alias name='serial0'/>
Aug 09 18:29:47 user nova-compute[72418]:     </console>
Aug 09 18:29:47 user nova-compute[72418]:     <input type='mouse' bus='ps2'>
Aug 09 18:29:47 user nova-compute[72418]:       <alias name='input0'/>
Aug 09 18:29:47 user nova-compute[72418]:     </input>
Aug 09 18:29:47 user nova-compute[72418]:     <input type='keyboard' bus='ps2'>
Aug 09 18:29:47 user nova-compute[72418]:       <alias name='input1'/>
Aug 09 18:29:47 user nova-compute[72418]:     </input>
Aug 09 18:29:47 user nova-compute[72418]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Aug 09 18:29:47 user nova-compute[72418]:       <listen type='address' address='0.0.0.0'/>
Aug 09 18:29:47 user nova-compute[72418]:     </graphics>
Aug 09 18:29:47 user nova-compute[72418]:     <audio id='1' type='none'/>
Aug 09 18:29:47 user nova-compute[72418]:     <video>
Aug 09 18:29:47 user nova-compute[72418]:       <model type='virtio' heads='1' primary='yes'/>
Aug 09 18:29:47 user nova-compute[72418]:       <alias name='video0'/>
Aug 09 18:29:47 user nova-compute[72418]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 09 18:29:47 user nova-compute[72418]:     </video>
Aug 09 18:29:47 user nova-compute[72418]:     <memballoon model='virtio'>
Aug 09 18:29:47 user nova-compute[72418]:       <stats period='10'/>
Aug 09 18:29:47 user nova-compute[72418]:       <alias name='balloon0'/>
Aug 09 18:29:47 user nova-compute[72418]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 09 18:29:47 user nova-compute[72418]:     </memballoon>
Aug 09 18:29:47 user nova-compute[72418]:     <rng model='virtio'>
Aug 09 18:29:47 user nova-compute[72418]:       <backend model='random'>/dev/urandom</backend>
Aug 09 18:29:47 user nova-compute[72418]:       <alias name='rng0'/>
Aug 09 18:29:47 user nova-compute[72418]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 09 18:29:47 user nova-compute[72418]:     </rng>
Aug 09 18:29:47 user nova-compute[72418]:   </devices>
Aug 09 18:29:47 user nova-compute[72418]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 09 18:29:47 user nova-compute[72418]:     <label>libvirt-688f50af-0e41-4467-b2db-04ac22f62963</label>
Aug 09 18:29:47 user nova-compute[72418]:     <imagelabel>libvirt-688f50af-0e41-4467-b2db-04ac22f62963</imagelabel>
Aug 09 18:29:47 user nova-compute[72418]:   </seclabel>
Aug 09 18:29:47 user nova-compute[72418]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 09 18:29:47 user nova-compute[72418]:     <label>+64055:+108</label>
Aug 09 18:29:47 user nova-compute[72418]:     <imagelabel>+64055:+108</imagelabel>
Aug 09 18:29:47 user nova-compute[72418]:   </seclabel>
Aug 09 18:29:47 user nova-compute[72418]: </domain>
Aug 09 18:29:47 user nova-compute[72418]:  {{(pid=72418) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 09 18:29:47 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [req-fb659ab5-f8f7-4abb-91ea-eaf15ff2472d req-a642fecf-3bf8-4a36-ba3b-a4cb28970fe3 service nova] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Detaching interface fa:16:3e:15:c3:cd failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap2fe18f2b-80' not found.
Aug 09 18:29:47 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [req-fb659ab5-f8f7-4abb-91ea-eaf15ff2472d req-a642fecf-3bf8-4a36-ba3b-a4cb28970fe3 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T18:27:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-630623237',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-630623237',id=20,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJchtztQL/UH2D7W5ks5SFjnLeiOZKRpefilUR0gjk7AuwJAWWS/gJOgdgu+Tp4jMu5wIaL/uSL50sh+6WeG1BBlMsFAUgEPx6/v6KmgLX0CBGzXIbAnMWDK0rX8sqetTQ==',key_name='tempest-keypair-267340570',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:27:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='86896e6544164fda93f7bea95a751707',ramdisk_id='',reservation_id='r-fo0cn966',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1428601923',owner_user_name='tempest-TaggedAttachmentsTest-1428601923-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:27:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df6cd3ad06524ae59968b133efceaa4c',uuid=688f50af-0e41-4467-b2db-04ac22f62963,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2fe18f2b-8036-42df-94d0-42e747c60d1a", "address": "fa:16:3e:15:c3:cd", "network": {"id": "77cad7ee-baee-4e0e-b735-9ac6302d9c3b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1355806010", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "86896e6544164fda93f7bea95a751707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fe18f2b-80", "ovs_interfaceid": "2fe18f2b-8036-42df-94d0-42e747c60d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 18:29:47 user nova-compute[72418]: DEBUG nova.network.os_vif_util [req-fb659ab5-f8f7-4abb-91ea-eaf15ff2472d req-a642fecf-3bf8-4a36-ba3b-a4cb28970fe3 service nova] Converting VIF {"id": "2fe18f2b-8036-42df-94d0-42e747c60d1a", "address": "fa:16:3e:15:c3:cd", "network": {"id": "77cad7ee-baee-4e0e-b735-9ac6302d9c3b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1355806010", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "86896e6544164fda93f7bea95a751707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fe18f2b-80", "ovs_interfaceid": "2fe18f2b-8036-42df-94d0-42e747c60d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:29:47 user nova-compute[72418]: DEBUG nova.network.os_vif_util [req-fb659ab5-f8f7-4abb-91ea-eaf15ff2472d req-a642fecf-3bf8-4a36-ba3b-a4cb28970fe3 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:c3:cd,bridge_name='br-int',has_traffic_filtering=True,id=2fe18f2b-8036-42df-94d0-42e747c60d1a,network=Network(77cad7ee-baee-4e0e-b735-9ac6302d9c3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fe18f2b-80') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:29:47 user nova-compute[72418]: DEBUG os_vif [req-fb659ab5-f8f7-4abb-91ea-eaf15ff2472d req-a642fecf-3bf8-4a36-ba3b-a4cb28970fe3 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:c3:cd,bridge_name='br-int',has_traffic_filtering=True,id=2fe18f2b-8036-42df-94d0-42e747c60d1a,network=Network(77cad7ee-baee-4e0e-b735-9ac6302d9c3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fe18f2b-80') {{(pid=72418) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 18:29:47 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:47 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2fe18f2b-80, bridge=br-int, if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:29:47 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:29:47 user nova-compute[72418]: INFO os_vif [req-fb659ab5-f8f7-4abb-91ea-eaf15ff2472d req-a642fecf-3bf8-4a36-ba3b-a4cb28970fe3 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:c3:cd,bridge_name='br-int',has_traffic_filtering=True,id=2fe18f2b-8036-42df-94d0-42e747c60d1a,network=Network(77cad7ee-baee-4e0e-b735-9ac6302d9c3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fe18f2b-80')
Aug 09 18:29:47 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [req-fb659ab5-f8f7-4abb-91ea-eaf15ff2472d req-a642fecf-3bf8-4a36-ba3b-a4cb28970fe3 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:29:47 user nova-compute[72418]:   <nova:package version="0.0.0"/>
Aug 09 18:29:47 user nova-compute[72418]:   <nova:name>tempest-device-tagging-server-630623237</nova:name>
Aug 09 18:29:47 user nova-compute[72418]:   <nova:creationTime>2023-08-09 18:29:47</nova:creationTime>
Aug 09 18:29:47 user nova-compute[72418]:   <nova:flavor name="m1.tiny">
Aug 09 18:29:47 user nova-compute[72418]:     <nova:memory>512</nova:memory>
Aug 09 18:29:47 user nova-compute[72418]:     <nova:disk>1</nova:disk>
Aug 09 18:29:47 user nova-compute[72418]:     <nova:swap>0</nova:swap>
Aug 09 18:29:47 user nova-compute[72418]:     <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:29:47 user nova-compute[72418]:     <nova:vcpus>1</nova:vcpus>
Aug 09 18:29:47 user nova-compute[72418]:   </nova:flavor>
Aug 09 18:29:47 user nova-compute[72418]:   <nova:owner>
Aug 09 18:29:47 user nova-compute[72418]:     <nova:user uuid="df6cd3ad06524ae59968b133efceaa4c">tempest-TaggedAttachmentsTest-1428601923-project-member</nova:user>
Aug 09 18:29:47 user nova-compute[72418]:     <nova:project uuid="86896e6544164fda93f7bea95a751707">tempest-TaggedAttachmentsTest-1428601923</nova:project>
Aug 09 18:29:47 user nova-compute[72418]:   </nova:owner>
Aug 09 18:29:47 user nova-compute[72418]:   <nova:root type="image" uuid="8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e"/>
Aug 09 18:29:47 user nova-compute[72418]:   <nova:ports>
Aug 09 18:29:47 user nova-compute[72418]:     <nova:port uuid="b2c3fa50-5615-4a58-8820-54c67c5d65bc">
Aug 09 18:29:47 user nova-compute[72418]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 09 18:29:47 user nova-compute[72418]:     </nova:port>
Aug 09 18:29:47 user nova-compute[72418]:   </nova:ports>
Aug 09 18:29:47 user nova-compute[72418]: </nova:instance>
Aug 09 18:29:47 user nova-compute[72418]:  {{(pid=72418) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 09 18:29:47 user nova-compute[72418]: DEBUG nova.network.neutron [None req-ff90820d-6cb1-4c3d-a01a-79e4334b95ed tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Updating instance_info_cache with network_info: [{"id": "b2c3fa50-5615-4a58-8820-54c67c5d65bc", "address": "fa:16:3e:0a:9c:69", "network": {"id": "e24f7df5-d3a9-477d-997c-c145a2613ec8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1802267495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86896e6544164fda93f7bea95a751707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c3fa50-56", "ovs_interfaceid": "b2c3fa50-5615-4a58-8820-54c67c5d65bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:29:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ff90820d-6cb1-4c3d-a01a-79e4334b95ed tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Releasing lock "refresh_cache-688f50af-0e41-4467-b2db-04ac22f62963" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:29:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ff90820d-6cb1-4c3d-a01a-79e4334b95ed tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Lock "interface-688f50af-0e41-4467-b2db-04ac22f62963-2fe18f2b-8036-42df-94d0-42e747c60d1a" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.793s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:29:47 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:47 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:29:48 user nova-compute[72418]: DEBUG nova.compute.manager [req-4a11adb9-4d2d-4550-85fa-75735c7f9c68 req-cfb6aad3-ccd0-42b2-ad8a-b495dfc64615 service nova] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Received event network-vif-plugged-2fe18f2b-8036-42df-94d0-42e747c60d1a {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:29:48 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-4a11adb9-4d2d-4550-85fa-75735c7f9c68 req-cfb6aad3-ccd0-42b2-ad8a-b495dfc64615 service nova] Acquiring lock "688f50af-0e41-4467-b2db-04ac22f62963-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:29:48 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-4a11adb9-4d2d-4550-85fa-75735c7f9c68 req-cfb6aad3-ccd0-42b2-ad8a-b495dfc64615 service nova] Lock "688f50af-0e41-4467-b2db-04ac22f62963-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:29:48 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-4a11adb9-4d2d-4550-85fa-75735c7f9c68 req-cfb6aad3-ccd0-42b2-ad8a-b495dfc64615 service nova] Lock "688f50af-0e41-4467-b2db-04ac22f62963-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:29:48 user nova-compute[72418]: DEBUG nova.compute.manager [req-4a11adb9-4d2d-4550-85fa-75735c7f9c68 req-cfb6aad3-ccd0-42b2-ad8a-b495dfc64615 service nova] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] No waiting events found dispatching network-vif-plugged-2fe18f2b-8036-42df-94d0-42e747c60d1a {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:29:48 user nova-compute[72418]: WARNING nova.compute.manager [req-4a11adb9-4d2d-4550-85fa-75735c7f9c68 req-cfb6aad3-ccd0-42b2-ad8a-b495dfc64615 service nova] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Received unexpected event network-vif-plugged-2fe18f2b-8036-42df-94d0-42e747c60d1a for instance with vm_state active and task_state None.
Aug 09 18:29:49 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:49 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:29:50 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:29:50 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:29:50 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:29:50 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72418) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 18:29:51 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:51 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:29:52 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:52 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:29:52 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:29:52 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:29:52 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:29:52 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Auditing locally available compute resources for user (node: user) {{(pid=72418) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 18:29:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/479ea4c3-ad7f-4da0-a901-defe46d96065/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/479ea4c3-ad7f-4da0-a901-defe46d96065/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/479ea4c3-ad7f-4da0-a901-defe46d96065/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:53 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/479ea4c3-ad7f-4da0-a901-defe46d96065/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/046617cf-13e5-44cf-9981-c1ae4ffd3851/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/046617cf-13e5-44cf-9981-c1ae4ffd3851/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/046617cf-13e5-44cf-9981-c1ae4ffd3851/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/046617cf-13e5-44cf-9981-c1ae4ffd3851/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json" returned: 0 in 0.153s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:55 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:55 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:55 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:55 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:55 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:55 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:55 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:55 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:29:55 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/688f50af-0e41-4467-b2db-04ac22f62963/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:55 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/688f50af-0e41-4467-b2db-04ac22f62963/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:55 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/688f50af-0e41-4467-b2db-04ac22f62963/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:29:55 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/688f50af-0e41-4467-b2db-04ac22f62963/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:29:55 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:29:56 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:56 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:29:56 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:29:56 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Hypervisor/Node resource view: name=user free_ram=7566MB free_disk=25.629657745361328GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72418) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 18:29:56 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:29:56 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:29:56 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 6af7918a-ce90-45ab-93d8-684e1489e891 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:29:56 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 8fe41968-a219-4a5a-afdb-32eb2082bb40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:29:56 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 01c46b33-6788-44a5-a43c-88ee4acc4d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:29:56 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 479ea4c3-ad7f-4da0-a901-defe46d96065 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:29:56 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance e019064c-955e-4f80-9b00-6b32b3835d58 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:29:56 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance e07beace-59d8-4c02-844b-1db1a6e81198 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:29:56 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance c46f2599-93f8-412e-9918-7ace8a9f19dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:29:56 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 688f50af-0e41-4467-b2db-04ac22f62963 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:29:56 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 046617cf-13e5-44cf-9981-c1ae4ffd3851 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:29:56 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 18:29:56 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 18:29:56 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:29:56 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:29:56 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Compute_service record updated for user:user {{(pid=72418) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 18:29:56 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.449s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:29:57 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:29:57 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:29:57 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:29:57 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Starting heal instance info cache {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 18:29:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "refresh_cache-8fe41968-a219-4a5a-afdb-32eb2082bb40" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:29:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquired lock "refresh_cache-8fe41968-a219-4a5a-afdb-32eb2082bb40" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:29:57 user nova-compute[72418]: DEBUG nova.network.neutron [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Forcefully refreshing network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 18:29:58 user nova-compute[72418]: DEBUG nova.network.neutron [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Updating instance_info_cache with network_info: [{"id": "2e2b5832-b357-4012-8bfc-d26009aa91f8", "address": "fa:16:3e:ee:f9:5d", "network": {"id": "beaefb5c-f5e4-47e7-ab68-60131f532ade", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e5863cda54487682a4edcc24202c91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2b5832-b3", "ovs_interfaceid": "2e2b5832-b357-4012-8bfc-d26009aa91f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:29:58 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Releasing lock "refresh_cache-8fe41968-a219-4a5a-afdb-32eb2082bb40" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:29:58 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Updated the network info_cache for instance {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 18:30:00 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:02 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:02 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Acquiring lock "03ad5bab-ab32-47fc-b7e8-b32282b9c20d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:30:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lock "03ad5bab-ab32-47fc-b7e8-b32282b9c20d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:30:06 user nova-compute[72418]: DEBUG nova.compute.manager [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Starting instance... {{(pid=72418) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 18:30:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:30:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:30:06 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72418) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 18:30:06 user nova-compute[72418]: INFO nova.compute.claims [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Claim successful on node user
Aug 09 18:30:06 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:06 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:30:06 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:30:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.415s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:30:06 user nova-compute[72418]: DEBUG nova.compute.manager [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Start building networks asynchronously for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 18:30:06 user nova-compute[72418]: DEBUG nova.compute.manager [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Allocating IP information in the background. {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 18:30:06 user nova-compute[72418]: DEBUG nova.network.neutron [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] allocate_for_instance() {{(pid=72418) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 18:30:06 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 18:30:06 user nova-compute[72418]: DEBUG nova.compute.manager [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Start building block device mappings for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 18:30:06 user nova-compute[72418]: DEBUG nova.policy [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8174362ccd88488d867db28e18906a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405587d223d54c5ab4f72a1994ac2862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72418) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 18:30:06 user nova-compute[72418]: DEBUG nova.compute.manager [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Start spawning the instance on the hypervisor. {{(pid=72418) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 18:30:06 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Creating instance directory {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 18:30:06 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Creating image(s)
Aug 09 18:30:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Acquiring lock "/opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:30:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lock "/opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:30:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lock "/opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:30:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.429s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:07 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Acquiring lock "458773cfa7230b717e41c60277832e9f83806d71" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:30:07 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:30:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.161s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/disk 1073741824 {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:07 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/disk 1073741824" returned: 0 in 0.190s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:07 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.358s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:30:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.133s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:07 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Checking if we can resize image /opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/disk. size=1073741824 {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 18:30:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:08 user nova-compute[72418]: DEBUG nova.network.neutron [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Successfully created port: ea92909f-40d7-48a8-be09-50439674945c {{(pid=72418) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 18:30:08 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:08 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Cannot resize image /opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/disk to a smaller size. {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 18:30:08 user nova-compute[72418]: DEBUG nova.objects.instance [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lazy-loading 'migration_context' on Instance uuid 03ad5bab-ab32-47fc-b7e8-b32282b9c20d {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:30:08 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Created local disks {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 18:30:08 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Ensure instance console log exists: /opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/console.log {{(pid=72418) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 18:30:08 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:30:08 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:30:08 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:30:08 user nova-compute[72418]: DEBUG nova.network.neutron [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Successfully updated port: ea92909f-40d7-48a8-be09-50439674945c {{(pid=72418) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 18:30:08 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Acquiring lock "refresh_cache-03ad5bab-ab32-47fc-b7e8-b32282b9c20d" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:30:08 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Acquired lock "refresh_cache-03ad5bab-ab32-47fc-b7e8-b32282b9c20d" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:30:08 user nova-compute[72418]: DEBUG nova.network.neutron [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:30:08 user nova-compute[72418]: DEBUG nova.compute.manager [req-cd074eb2-92c0-41dc-9767-dcd45a258d6b req-2967842b-4b44-4e88-a470-2a57489cd956 service nova] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Received event network-changed-ea92909f-40d7-48a8-be09-50439674945c {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:30:08 user nova-compute[72418]: DEBUG nova.compute.manager [req-cd074eb2-92c0-41dc-9767-dcd45a258d6b req-2967842b-4b44-4e88-a470-2a57489cd956 service nova] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Refreshing instance network info cache due to event network-changed-ea92909f-40d7-48a8-be09-50439674945c. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:30:08 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-cd074eb2-92c0-41dc-9767-dcd45a258d6b req-2967842b-4b44-4e88-a470-2a57489cd956 service nova] Acquiring lock "refresh_cache-03ad5bab-ab32-47fc-b7e8-b32282b9c20d" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:30:08 user nova-compute[72418]: DEBUG nova.network.neutron [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Instance cache missing network info. {{(pid=72418) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 18:30:09 user nova-compute[72418]: DEBUG nova.network.neutron [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Updating instance_info_cache with network_info: [{"id": "ea92909f-40d7-48a8-be09-50439674945c", "address": "fa:16:3e:3e:5e:e7", "network": {"id": "8354f86b-1e91-42ca-9847-769bb0aadcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-664289957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405587d223d54c5ab4f72a1994ac2862", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea92909f-40", "ovs_interfaceid": "ea92909f-40d7-48a8-be09-50439674945c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:30:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Releasing lock "refresh_cache-03ad5bab-ab32-47fc-b7e8-b32282b9c20d" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:30:09 user nova-compute[72418]: DEBUG nova.compute.manager [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Instance network_info: |[{"id": "ea92909f-40d7-48a8-be09-50439674945c", "address": "fa:16:3e:3e:5e:e7", "network": {"id": "8354f86b-1e91-42ca-9847-769bb0aadcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-664289957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405587d223d54c5ab4f72a1994ac2862", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea92909f-40", "ovs_interfaceid": "ea92909f-40d7-48a8-be09-50439674945c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 18:30:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-cd074eb2-92c0-41dc-9767-dcd45a258d6b req-2967842b-4b44-4e88-a470-2a57489cd956 service nova] Acquired lock "refresh_cache-03ad5bab-ab32-47fc-b7e8-b32282b9c20d" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:30:09 user nova-compute[72418]: DEBUG nova.network.neutron [req-cd074eb2-92c0-41dc-9767-dcd45a258d6b req-2967842b-4b44-4e88-a470-2a57489cd956 service nova] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Refreshing network info cache for port ea92909f-40d7-48a8-be09-50439674945c {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:30:09 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Start _get_guest_xml network_info=[{"id": "ea92909f-40d7-48a8-be09-50439674945c", "address": "fa:16:3e:3e:5e:e7", "network": {"id": "8354f86b-1e91-42ca-9847-769bb0aadcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-664289957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405587d223d54c5ab4f72a1994ac2862", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea92909f-40", "ovs_interfaceid": "ea92909f-40d7-48a8-be09-50439674945c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 18:30:09 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:30:09 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:30:09 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 18:30:09 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] CPU controller missing on host. {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 18:30:09 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 18:30:09 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] CPU controller found on host. {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 18:30:09 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72418) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 18:30:09 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T18:17:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 18:30:09 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Flavor limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 18:30:09 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Image limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 18:30:09 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Flavor pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 18:30:09 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Image pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 18:30:09 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 18:30:09 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 18:30:09 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 18:30:09 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Got 1 possible topologies {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 18:30:09 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 18:30:09 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 18:30:09 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:30:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1873430052',display_name='tempest-ServerActionsTestOtherB-server-1873430052',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1873430052',id=22,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIcobG4HnuTYOQnNQv/MwdYT3LE/RLnOlgxtm9ZW7mVchwGrvFEE/XUOIJNiUK2ZNsyoG2e4ALumseJiS6y2HeRcRosbaQtxOHGtF7A55P++8WqVj1ISNQq63FhVymDdqQ==',key_name='tempest-keypair-1241971956',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='405587d223d54c5ab4f72a1994ac2862',ramdisk_id='',reservation_id='r-y3ado2eg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1643003262',owner_user_name='tempest-ServerActionsTestOtherB-1643003262-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:30:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8174362ccd88488d867db28e18906a62',uuid=03ad5bab-ab32-47fc-b7e8-b32282b9c20d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea92909f-40d7-48a8-be09-50439674945c", "address": "fa:16:3e:3e:5e:e7", "network": {"id": "8354f86b-1e91-42ca-9847-769bb0aadcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-664289957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405587d223d54c5ab4f72a1994ac2862", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea92909f-40", "ovs_interfaceid": "ea92909f-40d7-48a8-be09-50439674945c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:30:09 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Converting VIF {"id": "ea92909f-40d7-48a8-be09-50439674945c", "address": "fa:16:3e:3e:5e:e7", "network": {"id": "8354f86b-1e91-42ca-9847-769bb0aadcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-664289957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405587d223d54c5ab4f72a1994ac2862", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea92909f-40", "ovs_interfaceid": "ea92909f-40d7-48a8-be09-50439674945c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:30:09 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:5e:e7,bridge_name='br-int',has_traffic_filtering=True,id=ea92909f-40d7-48a8-be09-50439674945c,network=Network(8354f86b-1e91-42ca-9847-769bb0aadcd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea92909f-40') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:30:09 user nova-compute[72418]: DEBUG nova.objects.instance [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lazy-loading 'pci_devices' on Instance uuid 03ad5bab-ab32-47fc-b7e8-b32282b9c20d {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:30:09 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] End _get_guest_xml xml=<domain type="kvm">
Aug 09 18:30:09 user nova-compute[72418]:   <uuid>03ad5bab-ab32-47fc-b7e8-b32282b9c20d</uuid>
Aug 09 18:30:09 user nova-compute[72418]:   <name>instance-00000016</name>
Aug 09 18:30:09 user nova-compute[72418]:   <memory>524288</memory>
Aug 09 18:30:09 user nova-compute[72418]:   <vcpu>1</vcpu>
Aug 09 18:30:09 user nova-compute[72418]:   <metadata>
Aug 09 18:30:09 user nova-compute[72418]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:30:09 user nova-compute[72418]:       <nova:package version="0.0.0"/>
Aug 09 18:30:09 user nova-compute[72418]:       <nova:name>tempest-ServerActionsTestOtherB-server-1873430052</nova:name>
Aug 09 18:30:09 user nova-compute[72418]:       <nova:creationTime>2023-08-09 18:30:09</nova:creationTime>
Aug 09 18:30:09 user nova-compute[72418]:       <nova:flavor name="m1.tiny">
Aug 09 18:30:09 user nova-compute[72418]:         <nova:memory>512</nova:memory>
Aug 09 18:30:09 user nova-compute[72418]:         <nova:disk>1</nova:disk>
Aug 09 18:30:09 user nova-compute[72418]:         <nova:swap>0</nova:swap>
Aug 09 18:30:09 user nova-compute[72418]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:30:09 user nova-compute[72418]:         <nova:vcpus>1</nova:vcpus>
Aug 09 18:30:09 user nova-compute[72418]:       </nova:flavor>
Aug 09 18:30:09 user nova-compute[72418]:       <nova:owner>
Aug 09 18:30:09 user nova-compute[72418]:         <nova:user uuid="8174362ccd88488d867db28e18906a62">tempest-ServerActionsTestOtherB-1643003262-project-member</nova:user>
Aug 09 18:30:09 user nova-compute[72418]:         <nova:project uuid="405587d223d54c5ab4f72a1994ac2862">tempest-ServerActionsTestOtherB-1643003262</nova:project>
Aug 09 18:30:09 user nova-compute[72418]:       </nova:owner>
Aug 09 18:30:09 user nova-compute[72418]:       <nova:root type="image" uuid="8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e"/>
Aug 09 18:30:09 user nova-compute[72418]:       <nova:ports>
Aug 09 18:30:09 user nova-compute[72418]:         <nova:port uuid="ea92909f-40d7-48a8-be09-50439674945c">
Aug 09 18:30:09 user nova-compute[72418]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 18:30:09 user nova-compute[72418]:         </nova:port>
Aug 09 18:30:09 user nova-compute[72418]:       </nova:ports>
Aug 09 18:30:09 user nova-compute[72418]:     </nova:instance>
Aug 09 18:30:09 user nova-compute[72418]:   </metadata>
Aug 09 18:30:09 user nova-compute[72418]:   <sysinfo type="smbios">
Aug 09 18:30:09 user nova-compute[72418]:     <system>
Aug 09 18:30:09 user nova-compute[72418]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 18:30:09 user nova-compute[72418]:       <entry name="product">OpenStack Nova</entry>
Aug 09 18:30:09 user nova-compute[72418]:       <entry name="version">0.0.0</entry>
Aug 09 18:30:09 user nova-compute[72418]:       <entry name="serial">03ad5bab-ab32-47fc-b7e8-b32282b9c20d</entry>
Aug 09 18:30:09 user nova-compute[72418]:       <entry name="uuid">03ad5bab-ab32-47fc-b7e8-b32282b9c20d</entry>
Aug 09 18:30:09 user nova-compute[72418]:       <entry name="family">Virtual Machine</entry>
Aug 09 18:30:09 user nova-compute[72418]:     </system>
Aug 09 18:30:09 user nova-compute[72418]:   </sysinfo>
Aug 09 18:30:09 user nova-compute[72418]:   <os>
Aug 09 18:30:09 user nova-compute[72418]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 18:30:09 user nova-compute[72418]:     <boot dev="hd"/>
Aug 09 18:30:09 user nova-compute[72418]:     <smbios mode="sysinfo"/>
Aug 09 18:30:09 user nova-compute[72418]:   </os>
Aug 09 18:30:09 user nova-compute[72418]:   <features>
Aug 09 18:30:09 user nova-compute[72418]:     <acpi/>
Aug 09 18:30:09 user nova-compute[72418]:     <apic/>
Aug 09 18:30:09 user nova-compute[72418]:     <vmcoreinfo/>
Aug 09 18:30:09 user nova-compute[72418]:   </features>
Aug 09 18:30:09 user nova-compute[72418]:   <clock offset="utc">
Aug 09 18:30:09 user nova-compute[72418]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 18:30:09 user nova-compute[72418]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 18:30:09 user nova-compute[72418]:     <timer name="hpet" present="no"/>
Aug 09 18:30:09 user nova-compute[72418]:   </clock>
Aug 09 18:30:09 user nova-compute[72418]:   <cpu mode="custom" match="exact">
Aug 09 18:30:09 user nova-compute[72418]:     <model>Nehalem</model>
Aug 09 18:30:09 user nova-compute[72418]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 18:30:09 user nova-compute[72418]:   </cpu>
Aug 09 18:30:09 user nova-compute[72418]:   <devices>
Aug 09 18:30:09 user nova-compute[72418]:     <disk type="file" device="disk">
Aug 09 18:30:09 user nova-compute[72418]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 18:30:09 user nova-compute[72418]:       <source file="/opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/disk"/>
Aug 09 18:30:09 user nova-compute[72418]:       <target dev="vda" bus="virtio"/>
Aug 09 18:30:09 user nova-compute[72418]:     </disk>
Aug 09 18:30:09 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:30:09 user nova-compute[72418]:       <mac address="fa:16:3e:3e:5e:e7"/>
Aug 09 18:30:09 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:30:09 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:30:09 user nova-compute[72418]:       <target dev="tapea92909f-40"/>
Aug 09 18:30:09 user nova-compute[72418]:     </interface>
Aug 09 18:30:09 user nova-compute[72418]:     <serial type="pty">
Aug 09 18:30:09 user nova-compute[72418]:       <log file="/opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/console.log" append="off"/>
Aug 09 18:30:09 user nova-compute[72418]:     </serial>
Aug 09 18:30:09 user nova-compute[72418]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 18:30:09 user nova-compute[72418]:     <video>
Aug 09 18:30:09 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:30:09 user nova-compute[72418]:     </video>
Aug 09 18:30:09 user nova-compute[72418]:     <rng model="virtio">
Aug 09 18:30:09 user nova-compute[72418]:       <backend model="random">/dev/urandom</backend>
Aug 09 18:30:09 user nova-compute[72418]:     </rng>
Aug 09 18:30:09 user nova-compute[72418]:     <controller type="usb" index="0" model="none"/>
Aug 09 18:30:09 user nova-compute[72418]:     <memballoon model="virtio">
Aug 09 18:30:09 user nova-compute[72418]:       <stats period="10"/>
Aug 09 18:30:09 user nova-compute[72418]:     </memballoon>
Aug 09 18:30:09 user nova-compute[72418]:   </devices>
Aug 09 18:30:09 user nova-compute[72418]: </domain>
Aug 09 18:30:09 user nova-compute[72418]:  {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 18:30:09 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:30:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1873430052',display_name='tempest-ServerActionsTestOtherB-server-1873430052',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1873430052',id=22,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIcobG4HnuTYOQnNQv/MwdYT3LE/RLnOlgxtm9ZW7mVchwGrvFEE/XUOIJNiUK2ZNsyoG2e4ALumseJiS6y2HeRcRosbaQtxOHGtF7A55P++8WqVj1ISNQq63FhVymDdqQ==',key_name='tempest-keypair-1241971956',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='405587d223d54c5ab4f72a1994ac2862',ramdisk_id='',reservation_id='r-y3ado2eg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1643003262',owner_user_name='tempest-ServerActionsTestOtherB-1643003262-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:30:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8174362ccd88488d867db28e18906a62',uuid=03ad5bab-ab32-47fc-b7e8-b32282b9c20d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea92909f-40d7-48a8-be09-50439674945c", "address": "fa:16:3e:3e:5e:e7", "network": {"id": "8354f86b-1e91-42ca-9847-769bb0aadcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-664289957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405587d223d54c5ab4f72a1994ac2862", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea92909f-40", "ovs_interfaceid": "ea92909f-40d7-48a8-be09-50439674945c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:30:09 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Converting VIF {"id": "ea92909f-40d7-48a8-be09-50439674945c", "address": "fa:16:3e:3e:5e:e7", "network": {"id": "8354f86b-1e91-42ca-9847-769bb0aadcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-664289957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405587d223d54c5ab4f72a1994ac2862", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea92909f-40", "ovs_interfaceid": "ea92909f-40d7-48a8-be09-50439674945c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:30:09 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:5e:e7,bridge_name='br-int',has_traffic_filtering=True,id=ea92909f-40d7-48a8-be09-50439674945c,network=Network(8354f86b-1e91-42ca-9847-769bb0aadcd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea92909f-40') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:30:09 user nova-compute[72418]: DEBUG os_vif [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:5e:e7,bridge_name='br-int',has_traffic_filtering=True,id=ea92909f-40d7-48a8-be09-50439674945c,network=Network(8354f86b-1e91-42ca-9847-769bb0aadcd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea92909f-40') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:30:09 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:09 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:30:09 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:30:09 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:09 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea92909f-40, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:30:09 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapea92909f-40, col_values=(('external_ids', {'iface-id': 'ea92909f-40d7-48a8-be09-50439674945c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:5e:e7', 'vm-uuid': '03ad5bab-ab32-47fc-b7e8-b32282b9c20d'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:30:09 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:09 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:30:09 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:09 user nova-compute[72418]: INFO os_vif [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:5e:e7,bridge_name='br-int',has_traffic_filtering=True,id=ea92909f-40d7-48a8-be09-50439674945c,network=Network(8354f86b-1e91-42ca-9847-769bb0aadcd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea92909f-40')
Aug 09 18:30:09 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:30:09 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] No VIF found with MAC fa:16:3e:3e:5e:e7, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:30:09 user nova-compute[72418]: DEBUG nova.network.neutron [req-cd074eb2-92c0-41dc-9767-dcd45a258d6b req-2967842b-4b44-4e88-a470-2a57489cd956 service nova] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Updated VIF entry in instance network info cache for port ea92909f-40d7-48a8-be09-50439674945c. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:30:09 user nova-compute[72418]: DEBUG nova.network.neutron [req-cd074eb2-92c0-41dc-9767-dcd45a258d6b req-2967842b-4b44-4e88-a470-2a57489cd956 service nova] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Updating instance_info_cache with network_info: [{"id": "ea92909f-40d7-48a8-be09-50439674945c", "address": "fa:16:3e:3e:5e:e7", "network": {"id": "8354f86b-1e91-42ca-9847-769bb0aadcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-664289957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405587d223d54c5ab4f72a1994ac2862", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea92909f-40", "ovs_interfaceid": "ea92909f-40d7-48a8-be09-50439674945c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:30:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-cd074eb2-92c0-41dc-9767-dcd45a258d6b req-2967842b-4b44-4e88-a470-2a57489cd956 service nova] Releasing lock "refresh_cache-03ad5bab-ab32-47fc-b7e8-b32282b9c20d" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:30:12 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:12 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:12 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:13 user nova-compute[72418]: DEBUG nova.compute.manager [req-a9a384cf-13f9-4e92-ae01-70a535dd732d req-2cf6a348-b28e-4b3e-9923-6035453f6d0e service nova] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Received event network-vif-plugged-ea92909f-40d7-48a8-be09-50439674945c {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:30:13 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a9a384cf-13f9-4e92-ae01-70a535dd732d req-2cf6a348-b28e-4b3e-9923-6035453f6d0e service nova] Acquiring lock "03ad5bab-ab32-47fc-b7e8-b32282b9c20d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:30:13 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a9a384cf-13f9-4e92-ae01-70a535dd732d req-2cf6a348-b28e-4b3e-9923-6035453f6d0e service nova] Lock "03ad5bab-ab32-47fc-b7e8-b32282b9c20d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:30:13 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a9a384cf-13f9-4e92-ae01-70a535dd732d req-2cf6a348-b28e-4b3e-9923-6035453f6d0e service nova] Lock "03ad5bab-ab32-47fc-b7e8-b32282b9c20d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:30:13 user nova-compute[72418]: DEBUG nova.compute.manager [req-a9a384cf-13f9-4e92-ae01-70a535dd732d req-2cf6a348-b28e-4b3e-9923-6035453f6d0e service nova] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] No waiting events found dispatching network-vif-plugged-ea92909f-40d7-48a8-be09-50439674945c {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:30:13 user nova-compute[72418]: WARNING nova.compute.manager [req-a9a384cf-13f9-4e92-ae01-70a535dd732d req-2cf6a348-b28e-4b3e-9923-6035453f6d0e service nova] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Received unexpected event network-vif-plugged-ea92909f-40d7-48a8-be09-50439674945c for instance with vm_state building and task_state spawning.
Aug 09 18:30:14 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:14 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:14 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:14 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:14 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:14 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:15 user nova-compute[72418]: DEBUG nova.compute.manager [req-2994ebed-e713-4c7e-aa0f-2abbacb4c180 req-82d7545c-a5a4-480b-8f24-71c6e332b66c service nova] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Received event network-vif-plugged-ea92909f-40d7-48a8-be09-50439674945c {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:30:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-2994ebed-e713-4c7e-aa0f-2abbacb4c180 req-82d7545c-a5a4-480b-8f24-71c6e332b66c service nova] Acquiring lock "03ad5bab-ab32-47fc-b7e8-b32282b9c20d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:30:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-2994ebed-e713-4c7e-aa0f-2abbacb4c180 req-82d7545c-a5a4-480b-8f24-71c6e332b66c service nova] Lock "03ad5bab-ab32-47fc-b7e8-b32282b9c20d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:30:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-2994ebed-e713-4c7e-aa0f-2abbacb4c180 req-82d7545c-a5a4-480b-8f24-71c6e332b66c service nova] Lock "03ad5bab-ab32-47fc-b7e8-b32282b9c20d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:30:15 user nova-compute[72418]: DEBUG nova.compute.manager [req-2994ebed-e713-4c7e-aa0f-2abbacb4c180 req-82d7545c-a5a4-480b-8f24-71c6e332b66c service nova] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] No waiting events found dispatching network-vif-plugged-ea92909f-40d7-48a8-be09-50439674945c {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:30:15 user nova-compute[72418]: WARNING nova.compute.manager [req-2994ebed-e713-4c7e-aa0f-2abbacb4c180 req-82d7545c-a5a4-480b-8f24-71c6e332b66c service nova] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Received unexpected event network-vif-plugged-ea92909f-40d7-48a8-be09-50439674945c for instance with vm_state building and task_state spawning.
Aug 09 18:30:17 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:17 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605817.8079178, 03ad5bab-ab32-47fc-b7e8-b32282b9c20d => Resumed> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:30:17 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] VM Resumed (Lifecycle Event)
Aug 09 18:30:17 user nova-compute[72418]: DEBUG nova.compute.manager [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Instance event wait completed in 0 seconds for  {{(pid=72418) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 18:30:17 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Guest created on hypervisor {{(pid=72418) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 18:30:17 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Instance spawned successfully.
Aug 09 18:30:17 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 18:30:17 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:30:17 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:30:17 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Found default for hw_cdrom_bus of ide {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:30:17 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Found default for hw_disk_bus of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:30:17 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Found default for hw_input_bus of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:30:17 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Found default for hw_pointer_model of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:30:17 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Found default for hw_video_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:30:17 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Found default for hw_vif_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:30:17 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:30:17 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605817.8110514, 03ad5bab-ab32-47fc-b7e8-b32282b9c20d => Started> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:30:17 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] VM Started (Lifecycle Event)
Aug 09 18:30:17 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:30:17 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:30:17 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:30:17 user nova-compute[72418]: INFO nova.compute.manager [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Took 10.96 seconds to spawn the instance on the hypervisor.
Aug 09 18:30:17 user nova-compute[72418]: DEBUG nova.compute.manager [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:30:18 user nova-compute[72418]: INFO nova.compute.manager [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Took 11.72 seconds to build instance.
Aug 09 18:30:18 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-df543861-ea24-4461-b077-05610738ff93 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lock "03ad5bab-ab32-47fc-b7e8-b32282b9c20d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.830s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:30:19 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:20 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-6bff17c5-f838-408b-8814-209a85057227 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Acquiring lock "c46f2599-93f8-412e-9918-7ace8a9f19dd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:30:20 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-6bff17c5-f838-408b-8814-209a85057227 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "c46f2599-93f8-412e-9918-7ace8a9f19dd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:30:20 user nova-compute[72418]: DEBUG nova.objects.instance [None req-6bff17c5-f838-408b-8814-209a85057227 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lazy-loading 'flavor' on Instance uuid c46f2599-93f8-412e-9918-7ace8a9f19dd {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:30:20 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-6bff17c5-f838-408b-8814-209a85057227 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "c46f2599-93f8-412e-9918-7ace8a9f19dd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.085s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:30:20 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-6bff17c5-f838-408b-8814-209a85057227 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Acquiring lock "c46f2599-93f8-412e-9918-7ace8a9f19dd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:30:20 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-6bff17c5-f838-408b-8814-209a85057227 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "c46f2599-93f8-412e-9918-7ace8a9f19dd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:30:20 user nova-compute[72418]: INFO nova.compute.manager [None req-6bff17c5-f838-408b-8814-209a85057227 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Attaching volume bdd54f84-accb-4284-bc01-7fe689728ee2 to /dev/vdb
Aug 09 18:30:20 user nova-compute[72418]: DEBUG os_brick.utils [None req-6bff17c5-f838-408b-8814-209a85057227 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:30:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:20 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ab12f7-92dc-4651-8276-303fd2194323]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ad56b243ad71\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:30:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:20 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45fa332-0292-4312-bdb5-771219955788]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:30:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.030s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:20 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee32c1e0-7d4c-419b-b74d-13b7ea3576c1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:30:20 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dcdbf54-8073-4b25-a092-1f3e9087120a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:30:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-6bff17c5-f838-408b-8814-209a85057227 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Running cmd (subprocess): nvme version {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-6bff17c5-f838-408b-8814-209a85057227 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] 'nvme version' failed. Not Retrying. {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:30:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6bff17c5-f838-408b-8814-209a85057227 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] nvme not present on system {{(pid=72418) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 18:30:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:30:20 user nova-compute[72418]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 18:30:20 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc279a9-5727-4826-9d00-0a68f908ed4a]: (4, '') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:30:21 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-6bff17c5-f838-408b-8814-209a85057227 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72418) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 18:30:21 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-6bff17c5-f838-408b-8814-209a85057227 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 18:30:21 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-6bff17c5-f838-408b-8814-209a85057227 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] LIGHTOS: no hostnqn found. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 18:30:21 user nova-compute[72418]: DEBUG os_brick.utils [None req-6bff17c5-f838-408b-8814-209a85057227 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ad56b243ad71', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:30:21 user nova-compute[72418]: DEBUG nova.virt.block_device [None req-6bff17c5-f838-408b-8814-209a85057227 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Updating existing volume attachment record: aba64b2f-46b1-449c-acec-d8ceaf753e6c {{(pid=72418) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 18:30:24 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:30:28 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Acquiring lock "1c53f871-2be9-4119-b5c0-d5081e2f4388" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:30:29 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "1c53f871-2be9-4119-b5c0-d5081e2f4388" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:30:29 user nova-compute[72418]: DEBUG nova.compute.manager [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Starting instance... {{(pid=72418) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 18:30:29 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:30:29 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:30:29 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72418) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 18:30:29 user nova-compute[72418]: INFO nova.compute.claims [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Claim successful on node user
Aug 09 18:30:29 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquiring lock "e582b61c-d998-4a3f-8392-a7f0e94a4dec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:30:29 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "e582b61c-d998-4a3f-8392-a7f0e94a4dec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:30:29 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:30:29 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:29 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72418) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 18:30:29 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72418) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 18:30:29 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72418) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 18:30:29 user nova-compute[72418]: DEBUG nova.compute.manager [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Starting instance... {{(pid=72418) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 18:30:29 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:30:29 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:30:29 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:30:29 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:30:29 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.589s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:30:29 user nova-compute[72418]: DEBUG nova.compute.manager [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Start building networks asynchronously for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 18:30:29 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.341s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:30:29 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72418) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 18:30:29 user nova-compute[72418]: INFO nova.compute.claims [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Claim successful on node user
Aug 09 18:30:29 user nova-compute[72418]: DEBUG nova.compute.manager [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Allocating IP information in the background. {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 18:30:29 user nova-compute[72418]: DEBUG nova.network.neutron [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] allocate_for_instance() {{(pid=72418) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 18:30:29 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 18:30:30 user nova-compute[72418]: DEBUG nova.compute.manager [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Start building block device mappings for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 18:30:30 user nova-compute[72418]: DEBUG nova.policy [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b3c4feb0a14841eeb757a79b6a05d1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5c68622cd79472ba6ad14a6876aeaea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72418) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 18:30:30 user nova-compute[72418]: DEBUG nova.compute.manager [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Start spawning the instance on the hypervisor. {{(pid=72418) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 18:30:30 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Creating instance directory {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 18:30:30 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Creating image(s)
Aug 09 18:30:30 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Acquiring lock "/opt/stack/data/nova/instances/1c53f871-2be9-4119-b5c0-d5081e2f4388/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:30:30 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "/opt/stack/data/nova/instances/1c53f871-2be9-4119-b5c0-d5081e2f4388/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:30:30 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "/opt/stack/data/nova/instances/1c53f871-2be9-4119-b5c0-d5081e2f4388/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:30:30 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:30 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:30:30 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:30:30 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.190s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:30 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Acquiring lock "458773cfa7230b717e41c60277832e9f83806d71" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:30:30 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:30:30 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:30 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.744s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:30:30 user nova-compute[72418]: DEBUG nova.compute.manager [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Start building networks asynchronously for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 18:30:30 user nova-compute[72418]: DEBUG nova.compute.manager [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Allocating IP information in the background. {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 18:30:30 user nova-compute[72418]: DEBUG nova.network.neutron [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] allocate_for_instance() {{(pid=72418) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 18:30:30 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.146s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:30 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/1c53f871-2be9-4119-b5c0-d5081e2f4388/disk 1073741824 {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:30 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 18:30:30 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/1c53f871-2be9-4119-b5c0-d5081e2f4388/disk 1073741824" returned: 0 in 0.069s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:30 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.218s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:30:30 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:30 user nova-compute[72418]: DEBUG nova.compute.manager [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Start building block device mappings for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 18:30:30 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bff17c5-f838-408b-8814-209a85057227 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Calling os-brick to attach iSCSI Volume {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 18:30:30 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bff17c5-f838-408b-8814-209a85057227 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lJvqKipO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:30:30 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-6bff17c5-f838-408b-8814-209a85057227 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:30:30 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-6bff17c5-f838-408b-8814-209a85057227 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:30:30 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-6bff17c5-f838-408b-8814-209a85057227 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:30:30 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-6bff17c5-f838-408b-8814-209a85057227 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:30:30 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-6bff17c5-f838-408b-8814-209a85057227 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:30:30 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-6bff17c5-f838-408b-8814-209a85057227 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:30:30 user nova-compute[72418]: INFO os_brick.initiator.connectors.iscsi [None req-6bff17c5-f838-408b-8814-209a85057227 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 18:30:30 user nova-compute[72418]: DEBUG nova.policy [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '621fd2b971c543d197a354c38e0d1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e5863cda54487682a4edcc24202c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72418) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 18:30:30 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 -p 172.16.0.220:3260 {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:30 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:30 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc3e020-3f87-4de2-8de0-02d4c2cb8db8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:30:30 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bff17c5-f838-408b-8814-209a85057227 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 18:30:30 user nova-compute[72418]:  {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:30:30 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 -p 172.16.0.220:3260 --interface default --op new {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:30 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.064s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:30 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de3005b-70d1-4860-86ad-a0a188795786]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2] added\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:30:30 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bff17c5-f838-408b-8814-209a85057227 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2] added
Aug 09 18:30:30 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:30:30 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.177s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:30 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1c53f871-2be9-4119-b5c0-d5081e2f4388/disk. size=1073741824 {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 18:30:30 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c53f871-2be9-4119-b5c0-d5081e2f4388/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a06b02-f19f-40e7-9d49-05334323b18d]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bff17c5-f838-408b-8814-209a85057227 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG nova.compute.manager [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Start spawning the instance on the hypervisor. {{(pid=72418) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Creating instance directory {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 18:30:31 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Creating image(s)
Aug 09 18:30:31 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquiring lock "/opt/stack/data/nova/instances/e582b61c-d998-4a3f-8392-a7f0e94a4dec/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "/opt/stack/data/nova/instances/e582b61c-d998-4a3f-8392-a7f0e94a4dec/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "/opt/stack/data/nova/instances/e582b61c-d998-4a3f-8392-a7f0e94a4dec/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.038s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.061s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d78df0-46c8-4b2b-9408-9f80c7c663de]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bff17c5-f838-408b-8814-209a85057227 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lJvqKipO {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lJvqKipO" returned: 0 in 0.031s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[853d1cb6-adc3-4a1e-ac14-181282eaa4a0]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bff17c5-f838-408b-8814-209a85057227 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lJvqKipO'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c53f871-2be9-4119-b5c0-d5081e2f4388/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Cannot resize image /opt/stack/data/nova/instances/1c53f871-2be9-4119-b5c0-d5081e2f4388/disk to a smaller size. {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG nova.objects.instance [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lazy-loading 'migration_context' on Instance uuid 1c53f871-2be9-4119-b5c0-d5081e2f4388 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Created local disks {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Ensure instance console log exists: /opt/stack/data/nova/instances/1c53f871-2be9-4119-b5c0-d5081e2f4388/console.log {{(pid=72418) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.066s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc29ad94-a183-4391-85f4-4b34d5036f8a]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bff17c5-f838-408b-8814-209a85057227 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc710d1f-79ec-4590-a07c-a3471ec6cc1f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bff17c5-f838-408b-8814-209a85057227 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:30:31 user nova-compute[72418]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f (non-flash)
Aug 09 18:30:31 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bff17c5-f838-408b-8814-209a85057227 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:30:31 user nova-compute[72418]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f (non-flash)
Aug 09 18:30:31 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 -p 172.16.0.220:3260 --login {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.214s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquiring lock "458773cfa7230b717e41c60277832e9f83806d71" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[356ffc3c-3edb-4899-b10a-5eac32f9e265]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bff17c5-f838-408b-8814-209a85057227 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2, portal: 172.16.0.220,3260]
Aug 09 18:30:31 user nova-compute[72418]: Login to [iface: default, target: iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2, portal: 172.16.0.220,3260] successful.
Aug 09 18:30:31 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[957a7354-7cea-428f-bcc2-622ef6acf1df]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bff17c5-f838-408b-8814-209a85057227 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6b2682-0c51-4878-a90a-f2c2c51f2a5f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bff17c5-f838-408b-8814-209a85057227 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:30:31 user nova-compute[72418]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f (non-flash)
Aug 09 18:30:31 user nova-compute[72418]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 (non-flash)
Aug 09 18:30:31 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bff17c5-f838-408b-8814-209a85057227 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:30:31 user nova-compute[72418]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f (non-flash)
Aug 09 18:30:31 user nova-compute[72418]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 (non-flash)
Aug 09 18:30:31 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-6bff17c5-f838-408b-8814-209a85057227 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.559s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bff17c5-f838-408b-8814-209a85057227 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Connected to 172.16.0.220:3260 {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-6bff17c5-f838-408b-8814-209a85057227 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] HCTL ('35', '-', '-', 0) found on session 21 with lun 0 {{(pid=72418) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-6bff17c5-f838-408b-8814-209a85057227 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72418) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.028s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[11cdaffa-32c1-4cc5-b518-0725d9f00ea6]: (4, ('- - 0', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-6bff17c5-f838-408b-8814-209a85057227 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72418) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bff17c5-f838-408b-8814-209a85057227 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lJvqKipO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.173s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/e582b61c-d998-4a3f-8392-a7f0e94a4dec/disk 1073741824 {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/e582b61c-d998-4a3f-8392-a7f0e94a4dec/disk 1073741824" returned: 0 in 0.059s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.161s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e582b61c-d998-4a3f-8392-a7f0e94a4dec/disk. size=1073741824 {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e582b61c-d998-4a3f-8392-a7f0e94a4dec/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG nova.network.neutron [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Successfully created port: 12a58797-57bf-44b6-8f44-d93bf97dd41f {{(pid=72418) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e582b61c-d998-4a3f-8392-a7f0e94a4dec/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Cannot resize image /opt/stack/data/nova/instances/e582b61c-d998-4a3f-8392-a7f0e94a4dec/disk to a smaller size. {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG nova.objects.instance [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lazy-loading 'migration_context' on Instance uuid e582b61c-d998-4a3f-8392-a7f0e94a4dec {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Created local disks {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Ensure instance console log exists: /opt/stack/data/nova/instances/e582b61c-d998-4a3f-8392-a7f0e94a4dec/console.log {{(pid=72418) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:30:31 user nova-compute[72418]: DEBUG nova.network.neutron [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Successfully created port: 84eb2df4-6995-47c5-bf0f-387932ece66d {{(pid=72418) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 18:30:32 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-6bff17c5-f838-408b-8814-209a85057227 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.604s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:30:32 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bff17c5-f838-408b-8814-209a85057227 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] <== connect_volume: return (1607ms) {'type': 'block', 'scsi_wwn': '26432393764663163', 'path': '/dev/sdd'} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:30:32 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bff17c5-f838-408b-8814-209a85057227 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432393764663163', 'path': '/dev/sdd'} {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 18:30:32 user nova-compute[72418]: DEBUG nova.objects.instance [None req-6bff17c5-f838-408b-8814-209a85057227 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lazy-loading 'flavor' on Instance uuid c46f2599-93f8-412e-9918-7ace8a9f19dd {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:30:32 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-6bff17c5-f838-408b-8814-209a85057227 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 18:30:32 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:30:32 user nova-compute[72418]:   <source dev="/dev/sdd"/>
Aug 09 18:30:32 user nova-compute[72418]:   <target dev="vdb" bus="virtio"/>
Aug 09 18:30:32 user nova-compute[72418]:   <serial>bdd54f84-accb-4284-bc01-7fe689728ee2</serial>
Aug 09 18:30:32 user nova-compute[72418]: </disk>
Aug 09 18:30:32 user nova-compute[72418]:  {{(pid=72418) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 18:30:32 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:32 user nova-compute[72418]: DEBUG nova.network.neutron [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Successfully updated port: 12a58797-57bf-44b6-8f44-d93bf97dd41f {{(pid=72418) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 18:30:32 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquiring lock "refresh_cache-e582b61c-d998-4a3f-8392-a7f0e94a4dec" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:30:32 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquired lock "refresh_cache-e582b61c-d998-4a3f-8392-a7f0e94a4dec" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:30:32 user nova-compute[72418]: DEBUG nova.network.neutron [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:30:32 user nova-compute[72418]: DEBUG nova.compute.manager [req-88aff949-e48f-4d73-9272-ceacf84db4f6 req-fa55bc36-3b4c-4c41-85c3-20b8fc564cf4 service nova] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Received event network-changed-12a58797-57bf-44b6-8f44-d93bf97dd41f {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:30:32 user nova-compute[72418]: DEBUG nova.compute.manager [req-88aff949-e48f-4d73-9272-ceacf84db4f6 req-fa55bc36-3b4c-4c41-85c3-20b8fc564cf4 service nova] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Refreshing instance network info cache due to event network-changed-12a58797-57bf-44b6-8f44-d93bf97dd41f. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:30:32 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-88aff949-e48f-4d73-9272-ceacf84db4f6 req-fa55bc36-3b4c-4c41-85c3-20b8fc564cf4 service nova] Acquiring lock "refresh_cache-e582b61c-d998-4a3f-8392-a7f0e94a4dec" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:30:32 user nova-compute[72418]: DEBUG nova.network.neutron [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Instance cache missing network info. {{(pid=72418) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 18:30:32 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-6bff17c5-f838-408b-8814-209a85057227 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:30:32 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-6bff17c5-f838-408b-8814-209a85057227 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:30:32 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-6bff17c5-f838-408b-8814-209a85057227 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] No VIF found with MAC fa:16:3e:80:17:d9, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:30:33 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-6bff17c5-f838-408b-8814-209a85057227 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "c46f2599-93f8-412e-9918-7ace8a9f19dd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.380s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:30:33 user nova-compute[72418]: DEBUG nova.network.neutron [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Updating instance_info_cache with network_info: [{"id": "12a58797-57bf-44b6-8f44-d93bf97dd41f", "address": "fa:16:3e:18:83:79", "network": {"id": "beaefb5c-f5e4-47e7-ab68-60131f532ade", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e5863cda54487682a4edcc24202c91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a58797-57", "ovs_interfaceid": "12a58797-57bf-44b6-8f44-d93bf97dd41f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:30:33 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Releasing lock "refresh_cache-e582b61c-d998-4a3f-8392-a7f0e94a4dec" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:30:33 user nova-compute[72418]: DEBUG nova.compute.manager [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Instance network_info: |[{"id": "12a58797-57bf-44b6-8f44-d93bf97dd41f", "address": "fa:16:3e:18:83:79", "network": {"id": "beaefb5c-f5e4-47e7-ab68-60131f532ade", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e5863cda54487682a4edcc24202c91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a58797-57", "ovs_interfaceid": "12a58797-57bf-44b6-8f44-d93bf97dd41f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 18:30:33 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-88aff949-e48f-4d73-9272-ceacf84db4f6 req-fa55bc36-3b4c-4c41-85c3-20b8fc564cf4 service nova] Acquired lock "refresh_cache-e582b61c-d998-4a3f-8392-a7f0e94a4dec" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:30:33 user nova-compute[72418]: DEBUG nova.network.neutron [req-88aff949-e48f-4d73-9272-ceacf84db4f6 req-fa55bc36-3b4c-4c41-85c3-20b8fc564cf4 service nova] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Refreshing network info cache for port 12a58797-57bf-44b6-8f44-d93bf97dd41f {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:30:33 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Start _get_guest_xml network_info=[{"id": "12a58797-57bf-44b6-8f44-d93bf97dd41f", "address": "fa:16:3e:18:83:79", "network": {"id": "beaefb5c-f5e4-47e7-ab68-60131f532ade", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e5863cda54487682a4edcc24202c91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a58797-57", "ovs_interfaceid": "12a58797-57bf-44b6-8f44-d93bf97dd41f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 18:30:33 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:30:33 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:30:33 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 18:30:33 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] CPU controller missing on host. {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 18:30:33 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 18:30:33 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] CPU controller found on host. {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 18:30:33 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72418) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 18:30:33 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T18:17:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 18:30:33 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Flavor limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 18:30:33 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Image limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 18:30:33 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Flavor pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 18:30:33 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Image pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 18:30:33 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 18:30:33 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 18:30:33 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 18:30:33 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Got 1 possible topologies {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 18:30:33 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 18:30:33 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 18:30:33 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:30:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-968235622',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-968235622',id=24,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52e5863cda54487682a4edcc24202c91',ramdisk_id='',reservation_id='r-nvwts06c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1120385592',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:30:31Z,user_data=None,user_id='621fd2b971c543d197a354c38e0d1867',uuid=e582b61c-d998-4a3f-8392-a7f0e94a4dec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12a58797-57bf-44b6-8f44-d93bf97dd41f", "address": "fa:16:3e:18:83:79", "network": {"id": "beaefb5c-f5e4-47e7-ab68-60131f532ade", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e5863cda54487682a4edcc24202c91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a58797-57", "ovs_interfaceid": "12a58797-57bf-44b6-8f44-d93bf97dd41f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:30:33 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Converting VIF {"id": "12a58797-57bf-44b6-8f44-d93bf97dd41f", "address": "fa:16:3e:18:83:79", "network": {"id": "beaefb5c-f5e4-47e7-ab68-60131f532ade", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e5863cda54487682a4edcc24202c91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a58797-57", "ovs_interfaceid": "12a58797-57bf-44b6-8f44-d93bf97dd41f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:30:33 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:83:79,bridge_name='br-int',has_traffic_filtering=True,id=12a58797-57bf-44b6-8f44-d93bf97dd41f,network=Network(beaefb5c-f5e4-47e7-ab68-60131f532ade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12a58797-57') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:30:33 user nova-compute[72418]: DEBUG nova.objects.instance [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lazy-loading 'pci_devices' on Instance uuid e582b61c-d998-4a3f-8392-a7f0e94a4dec {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:30:33 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] End _get_guest_xml xml=<domain type="kvm">
Aug 09 18:30:33 user nova-compute[72418]:   <uuid>e582b61c-d998-4a3f-8392-a7f0e94a4dec</uuid>
Aug 09 18:30:33 user nova-compute[72418]:   <name>instance-00000018</name>
Aug 09 18:30:33 user nova-compute[72418]:   <memory>524288</memory>
Aug 09 18:30:33 user nova-compute[72418]:   <vcpu>1</vcpu>
Aug 09 18:30:33 user nova-compute[72418]:   <metadata>
Aug 09 18:30:33 user nova-compute[72418]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:30:33 user nova-compute[72418]:       <nova:package version="0.0.0"/>
Aug 09 18:30:33 user nova-compute[72418]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-968235622</nova:name>
Aug 09 18:30:33 user nova-compute[72418]:       <nova:creationTime>2023-08-09 18:30:33</nova:creationTime>
Aug 09 18:30:33 user nova-compute[72418]:       <nova:flavor name="m1.tiny">
Aug 09 18:30:33 user nova-compute[72418]:         <nova:memory>512</nova:memory>
Aug 09 18:30:33 user nova-compute[72418]:         <nova:disk>1</nova:disk>
Aug 09 18:30:33 user nova-compute[72418]:         <nova:swap>0</nova:swap>
Aug 09 18:30:33 user nova-compute[72418]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:30:33 user nova-compute[72418]:         <nova:vcpus>1</nova:vcpus>
Aug 09 18:30:33 user nova-compute[72418]:       </nova:flavor>
Aug 09 18:30:33 user nova-compute[72418]:       <nova:owner>
Aug 09 18:30:33 user nova-compute[72418]:         <nova:user uuid="621fd2b971c543d197a354c38e0d1867">tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member</nova:user>
Aug 09 18:30:33 user nova-compute[72418]:         <nova:project uuid="52e5863cda54487682a4edcc24202c91">tempest-ServerBootFromVolumeStableRescueTest-1120385592</nova:project>
Aug 09 18:30:33 user nova-compute[72418]:       </nova:owner>
Aug 09 18:30:33 user nova-compute[72418]:       <nova:root type="image" uuid="8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e"/>
Aug 09 18:30:33 user nova-compute[72418]:       <nova:ports>
Aug 09 18:30:33 user nova-compute[72418]:         <nova:port uuid="12a58797-57bf-44b6-8f44-d93bf97dd41f">
Aug 09 18:30:33 user nova-compute[72418]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 09 18:30:33 user nova-compute[72418]:         </nova:port>
Aug 09 18:30:33 user nova-compute[72418]:       </nova:ports>
Aug 09 18:30:33 user nova-compute[72418]:     </nova:instance>
Aug 09 18:30:33 user nova-compute[72418]:   </metadata>
Aug 09 18:30:33 user nova-compute[72418]:   <sysinfo type="smbios">
Aug 09 18:30:33 user nova-compute[72418]:     <system>
Aug 09 18:30:33 user nova-compute[72418]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 18:30:33 user nova-compute[72418]:       <entry name="product">OpenStack Nova</entry>
Aug 09 18:30:33 user nova-compute[72418]:       <entry name="version">0.0.0</entry>
Aug 09 18:30:33 user nova-compute[72418]:       <entry name="serial">e582b61c-d998-4a3f-8392-a7f0e94a4dec</entry>
Aug 09 18:30:33 user nova-compute[72418]:       <entry name="uuid">e582b61c-d998-4a3f-8392-a7f0e94a4dec</entry>
Aug 09 18:30:33 user nova-compute[72418]:       <entry name="family">Virtual Machine</entry>
Aug 09 18:30:33 user nova-compute[72418]:     </system>
Aug 09 18:30:33 user nova-compute[72418]:   </sysinfo>
Aug 09 18:30:33 user nova-compute[72418]:   <os>
Aug 09 18:30:33 user nova-compute[72418]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 18:30:33 user nova-compute[72418]:     <boot dev="hd"/>
Aug 09 18:30:33 user nova-compute[72418]:     <smbios mode="sysinfo"/>
Aug 09 18:30:33 user nova-compute[72418]:   </os>
Aug 09 18:30:33 user nova-compute[72418]:   <features>
Aug 09 18:30:33 user nova-compute[72418]:     <acpi/>
Aug 09 18:30:33 user nova-compute[72418]:     <apic/>
Aug 09 18:30:33 user nova-compute[72418]:     <vmcoreinfo/>
Aug 09 18:30:33 user nova-compute[72418]:   </features>
Aug 09 18:30:33 user nova-compute[72418]:   <clock offset="utc">
Aug 09 18:30:33 user nova-compute[72418]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 18:30:33 user nova-compute[72418]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 18:30:33 user nova-compute[72418]:     <timer name="hpet" present="no"/>
Aug 09 18:30:33 user nova-compute[72418]:   </clock>
Aug 09 18:30:33 user nova-compute[72418]:   <cpu mode="custom" match="exact">
Aug 09 18:30:33 user nova-compute[72418]:     <model>Nehalem</model>
Aug 09 18:30:33 user nova-compute[72418]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 18:30:33 user nova-compute[72418]:   </cpu>
Aug 09 18:30:33 user nova-compute[72418]:   <devices>
Aug 09 18:30:33 user nova-compute[72418]:     <disk type="file" device="disk">
Aug 09 18:30:33 user nova-compute[72418]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 18:30:33 user nova-compute[72418]:       <source file="/opt/stack/data/nova/instances/e582b61c-d998-4a3f-8392-a7f0e94a4dec/disk"/>
Aug 09 18:30:33 user nova-compute[72418]:       <target dev="vda" bus="virtio"/>
Aug 09 18:30:33 user nova-compute[72418]:     </disk>
Aug 09 18:30:33 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:30:33 user nova-compute[72418]:       <mac address="fa:16:3e:18:83:79"/>
Aug 09 18:30:33 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:30:33 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:30:33 user nova-compute[72418]:       <target dev="tap12a58797-57"/>
Aug 09 18:30:33 user nova-compute[72418]:     </interface>
Aug 09 18:30:33 user nova-compute[72418]:     <serial type="pty">
Aug 09 18:30:33 user nova-compute[72418]:       <log file="/opt/stack/data/nova/instances/e582b61c-d998-4a3f-8392-a7f0e94a4dec/console.log" append="off"/>
Aug 09 18:30:33 user nova-compute[72418]:     </serial>
Aug 09 18:30:33 user nova-compute[72418]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 18:30:33 user nova-compute[72418]:     <video>
Aug 09 18:30:33 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:30:33 user nova-compute[72418]:     </video>
Aug 09 18:30:33 user nova-compute[72418]:     <rng model="virtio">
Aug 09 18:30:33 user nova-compute[72418]:       <backend model="random">/dev/urandom</backend>
Aug 09 18:30:33 user nova-compute[72418]:     </rng>
Aug 09 18:30:33 user nova-compute[72418]:     <controller type="usb" index="0" model="none"/>
Aug 09 18:30:33 user nova-compute[72418]:     <memballoon model="virtio">
Aug 09 18:30:33 user nova-compute[72418]:       <stats period="10"/>
Aug 09 18:30:33 user nova-compute[72418]:     </memballoon>
Aug 09 18:30:33 user nova-compute[72418]:   </devices>
Aug 09 18:30:33 user nova-compute[72418]: </domain>
Aug 09 18:30:33 user nova-compute[72418]:  {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 18:30:33 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:30:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-968235622',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-968235622',id=24,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52e5863cda54487682a4edcc24202c91',ramdisk_id='',reservation_id='r-nvwts06c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1120385592',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:30:31Z,user_data=None,user_id='621fd2b971c543d197a354c38e0d1867',uuid=e582b61c-d998-4a3f-8392-a7f0e94a4dec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12a58797-57bf-44b6-8f44-d93bf97dd41f", "address": "fa:16:3e:18:83:79", "network": {"id": "beaefb5c-f5e4-47e7-ab68-60131f532ade", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e5863cda54487682a4edcc24202c91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a58797-57", "ovs_interfaceid": "12a58797-57bf-44b6-8f44-d93bf97dd41f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:30:33 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Converting VIF {"id": "12a58797-57bf-44b6-8f44-d93bf97dd41f", "address": "fa:16:3e:18:83:79", "network": {"id": "beaefb5c-f5e4-47e7-ab68-60131f532ade", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e5863cda54487682a4edcc24202c91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a58797-57", "ovs_interfaceid": "12a58797-57bf-44b6-8f44-d93bf97dd41f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:30:33 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:83:79,bridge_name='br-int',has_traffic_filtering=True,id=12a58797-57bf-44b6-8f44-d93bf97dd41f,network=Network(beaefb5c-f5e4-47e7-ab68-60131f532ade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12a58797-57') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:30:33 user nova-compute[72418]: DEBUG os_vif [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:83:79,bridge_name='br-int',has_traffic_filtering=True,id=12a58797-57bf-44b6-8f44-d93bf97dd41f,network=Network(beaefb5c-f5e4-47e7-ab68-60131f532ade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12a58797-57') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:30:33 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:33 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:30:33 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:30:33 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:33 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap12a58797-57, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:30:33 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap12a58797-57, col_values=(('external_ids', {'iface-id': '12a58797-57bf-44b6-8f44-d93bf97dd41f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:83:79', 'vm-uuid': 'e582b61c-d998-4a3f-8392-a7f0e94a4dec'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:30:33 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:33 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:30:33 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:33 user nova-compute[72418]: INFO os_vif [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:83:79,bridge_name='br-int',has_traffic_filtering=True,id=12a58797-57bf-44b6-8f44-d93bf97dd41f,network=Network(beaefb5c-f5e4-47e7-ab68-60131f532ade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12a58797-57')
Aug 09 18:30:33 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:30:33 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] No VIF found with MAC fa:16:3e:18:83:79, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:30:33 user nova-compute[72418]: DEBUG nova.network.neutron [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Successfully updated port: 84eb2df4-6995-47c5-bf0f-387932ece66d {{(pid=72418) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 18:30:33 user nova-compute[72418]: DEBUG nova.network.neutron [req-88aff949-e48f-4d73-9272-ceacf84db4f6 req-fa55bc36-3b4c-4c41-85c3-20b8fc564cf4 service nova] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Updated VIF entry in instance network info cache for port 12a58797-57bf-44b6-8f44-d93bf97dd41f. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:30:33 user nova-compute[72418]: DEBUG nova.network.neutron [req-88aff949-e48f-4d73-9272-ceacf84db4f6 req-fa55bc36-3b4c-4c41-85c3-20b8fc564cf4 service nova] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Updating instance_info_cache with network_info: [{"id": "12a58797-57bf-44b6-8f44-d93bf97dd41f", "address": "fa:16:3e:18:83:79", "network": {"id": "beaefb5c-f5e4-47e7-ab68-60131f532ade", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e5863cda54487682a4edcc24202c91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a58797-57", "ovs_interfaceid": "12a58797-57bf-44b6-8f44-d93bf97dd41f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:30:33 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Acquiring lock "refresh_cache-1c53f871-2be9-4119-b5c0-d5081e2f4388" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:30:33 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Acquired lock "refresh_cache-1c53f871-2be9-4119-b5c0-d5081e2f4388" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:30:33 user nova-compute[72418]: DEBUG nova.network.neutron [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:30:33 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-88aff949-e48f-4d73-9272-ceacf84db4f6 req-fa55bc36-3b4c-4c41-85c3-20b8fc564cf4 service nova] Releasing lock "refresh_cache-e582b61c-d998-4a3f-8392-a7f0e94a4dec" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:30:33 user nova-compute[72418]: DEBUG nova.compute.manager [req-8f9fa214-a369-43ab-8534-081571c6bd8f req-db4ab713-ce22-415f-8171-287f0864bed9 service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Received event network-changed-84eb2df4-6995-47c5-bf0f-387932ece66d {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:30:33 user nova-compute[72418]: DEBUG nova.compute.manager [req-8f9fa214-a369-43ab-8534-081571c6bd8f req-db4ab713-ce22-415f-8171-287f0864bed9 service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Refreshing instance network info cache due to event network-changed-84eb2df4-6995-47c5-bf0f-387932ece66d. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:30:33 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-8f9fa214-a369-43ab-8534-081571c6bd8f req-db4ab713-ce22-415f-8171-287f0864bed9 service nova] Acquiring lock "refresh_cache-1c53f871-2be9-4119-b5c0-d5081e2f4388" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:30:33 user nova-compute[72418]: DEBUG nova.network.neutron [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Instance cache missing network info. {{(pid=72418) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 18:30:33 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:34 user nova-compute[72418]: DEBUG nova.network.neutron [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Updating instance_info_cache with network_info: [{"id": "84eb2df4-6995-47c5-bf0f-387932ece66d", "address": "fa:16:3e:d2:b0:b4", "network": {"id": "15a49d9b-3c0d-449b-9473-29f219960e2c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c68622cd79472ba6ad14a6876aeaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84eb2df4-69", "ovs_interfaceid": "84eb2df4-6995-47c5-bf0f-387932ece66d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:30:34 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Releasing lock "refresh_cache-1c53f871-2be9-4119-b5c0-d5081e2f4388" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:30:34 user nova-compute[72418]: DEBUG nova.compute.manager [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Instance network_info: |[{"id": "84eb2df4-6995-47c5-bf0f-387932ece66d", "address": "fa:16:3e:d2:b0:b4", "network": {"id": "15a49d9b-3c0d-449b-9473-29f219960e2c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c68622cd79472ba6ad14a6876aeaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84eb2df4-69", "ovs_interfaceid": "84eb2df4-6995-47c5-bf0f-387932ece66d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 18:30:34 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-8f9fa214-a369-43ab-8534-081571c6bd8f req-db4ab713-ce22-415f-8171-287f0864bed9 service nova] Acquired lock "refresh_cache-1c53f871-2be9-4119-b5c0-d5081e2f4388" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:30:34 user nova-compute[72418]: DEBUG nova.network.neutron [req-8f9fa214-a369-43ab-8534-081571c6bd8f req-db4ab713-ce22-415f-8171-287f0864bed9 service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Refreshing network info cache for port 84eb2df4-6995-47c5-bf0f-387932ece66d {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:30:34 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Start _get_guest_xml network_info=[{"id": "84eb2df4-6995-47c5-bf0f-387932ece66d", "address": "fa:16:3e:d2:b0:b4", "network": {"id": "15a49d9b-3c0d-449b-9473-29f219960e2c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c68622cd79472ba6ad14a6876aeaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84eb2df4-69", "ovs_interfaceid": "84eb2df4-6995-47c5-bf0f-387932ece66d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 18:30:34 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:30:34 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:30:34 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 18:30:34 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] CPU controller missing on host. {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 18:30:34 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 18:30:34 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] CPU controller found on host. {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 18:30:34 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72418) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 18:30:34 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T18:17:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 18:30:34 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Flavor limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 18:30:34 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Image limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 18:30:34 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Flavor pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 18:30:34 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Image pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 18:30:34 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 18:30:34 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 18:30:34 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 18:30:34 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Got 1 possible topologies {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 18:30:34 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 18:30:34 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 18:30:34 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:30:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-726518213',display_name='tempest-ServerRescueNegativeTestJSON-server-726518213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-726518213',id=23,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYgqOVWyn0dFX4Ed9YyvsFFE+jrecgTvMY887w9viUNHXtdgFMObE/m2tkO2gGT++FsK404JHMmKjOtdQQqB+ock45M5UHDZsc/R8Qw31XfQ2breULNzs/hrNYbxNLAYg==',key_name='tempest-keypair-462614825',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5c68622cd79472ba6ad14a6876aeaea',ramdisk_id='',reservation_id='r-pyrt30fh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-326572915',owner_user_name='tempest-ServerRescueNegativeTestJSON-326572915-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:30:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3c4feb0a14841eeb757a79b6a05d1fa',uuid=1c53f871-2be9-4119-b5c0-d5081e2f4388,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84eb2df4-6995-47c5-bf0f-387932ece66d", "address": "fa:16:3e:d2:b0:b4", "network": {"id": "15a49d9b-3c0d-449b-9473-29f219960e2c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c68622cd79472ba6ad14a6876aeaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84eb2df4-69", "ovs_interfaceid": "84eb2df4-6995-47c5-bf0f-387932ece66d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:30:34 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Converting VIF {"id": "84eb2df4-6995-47c5-bf0f-387932ece66d", "address": "fa:16:3e:d2:b0:b4", "network": {"id": "15a49d9b-3c0d-449b-9473-29f219960e2c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c68622cd79472ba6ad14a6876aeaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84eb2df4-69", "ovs_interfaceid": "84eb2df4-6995-47c5-bf0f-387932ece66d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:30:34 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:b0:b4,bridge_name='br-int',has_traffic_filtering=True,id=84eb2df4-6995-47c5-bf0f-387932ece66d,network=Network(15a49d9b-3c0d-449b-9473-29f219960e2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84eb2df4-69') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:30:34 user nova-compute[72418]: DEBUG nova.objects.instance [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lazy-loading 'pci_devices' on Instance uuid 1c53f871-2be9-4119-b5c0-d5081e2f4388 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:30:34 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] End _get_guest_xml xml=<domain type="kvm">
Aug 09 18:30:34 user nova-compute[72418]:   <uuid>1c53f871-2be9-4119-b5c0-d5081e2f4388</uuid>
Aug 09 18:30:34 user nova-compute[72418]:   <name>instance-00000017</name>
Aug 09 18:30:34 user nova-compute[72418]:   <memory>524288</memory>
Aug 09 18:30:34 user nova-compute[72418]:   <vcpu>1</vcpu>
Aug 09 18:30:34 user nova-compute[72418]:   <metadata>
Aug 09 18:30:34 user nova-compute[72418]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:30:34 user nova-compute[72418]:       <nova:package version="0.0.0"/>
Aug 09 18:30:34 user nova-compute[72418]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-726518213</nova:name>
Aug 09 18:30:34 user nova-compute[72418]:       <nova:creationTime>2023-08-09 18:30:34</nova:creationTime>
Aug 09 18:30:34 user nova-compute[72418]:       <nova:flavor name="m1.tiny">
Aug 09 18:30:34 user nova-compute[72418]:         <nova:memory>512</nova:memory>
Aug 09 18:30:34 user nova-compute[72418]:         <nova:disk>1</nova:disk>
Aug 09 18:30:34 user nova-compute[72418]:         <nova:swap>0</nova:swap>
Aug 09 18:30:34 user nova-compute[72418]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:30:34 user nova-compute[72418]:         <nova:vcpus>1</nova:vcpus>
Aug 09 18:30:34 user nova-compute[72418]:       </nova:flavor>
Aug 09 18:30:34 user nova-compute[72418]:       <nova:owner>
Aug 09 18:30:34 user nova-compute[72418]:         <nova:user uuid="b3c4feb0a14841eeb757a79b6a05d1fa">tempest-ServerRescueNegativeTestJSON-326572915-project-member</nova:user>
Aug 09 18:30:34 user nova-compute[72418]:         <nova:project uuid="b5c68622cd79472ba6ad14a6876aeaea">tempest-ServerRescueNegativeTestJSON-326572915</nova:project>
Aug 09 18:30:34 user nova-compute[72418]:       </nova:owner>
Aug 09 18:30:34 user nova-compute[72418]:       <nova:root type="image" uuid="8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e"/>
Aug 09 18:30:34 user nova-compute[72418]:       <nova:ports>
Aug 09 18:30:34 user nova-compute[72418]:         <nova:port uuid="84eb2df4-6995-47c5-bf0f-387932ece66d">
Aug 09 18:30:34 user nova-compute[72418]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 09 18:30:34 user nova-compute[72418]:         </nova:port>
Aug 09 18:30:34 user nova-compute[72418]:       </nova:ports>
Aug 09 18:30:34 user nova-compute[72418]:     </nova:instance>
Aug 09 18:30:34 user nova-compute[72418]:   </metadata>
Aug 09 18:30:34 user nova-compute[72418]:   <sysinfo type="smbios">
Aug 09 18:30:34 user nova-compute[72418]:     <system>
Aug 09 18:30:34 user nova-compute[72418]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 18:30:34 user nova-compute[72418]:       <entry name="product">OpenStack Nova</entry>
Aug 09 18:30:34 user nova-compute[72418]:       <entry name="version">0.0.0</entry>
Aug 09 18:30:34 user nova-compute[72418]:       <entry name="serial">1c53f871-2be9-4119-b5c0-d5081e2f4388</entry>
Aug 09 18:30:34 user nova-compute[72418]:       <entry name="uuid">1c53f871-2be9-4119-b5c0-d5081e2f4388</entry>
Aug 09 18:30:34 user nova-compute[72418]:       <entry name="family">Virtual Machine</entry>
Aug 09 18:30:34 user nova-compute[72418]:     </system>
Aug 09 18:30:34 user nova-compute[72418]:   </sysinfo>
Aug 09 18:30:34 user nova-compute[72418]:   <os>
Aug 09 18:30:34 user nova-compute[72418]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 18:30:34 user nova-compute[72418]:     <boot dev="hd"/>
Aug 09 18:30:34 user nova-compute[72418]:     <smbios mode="sysinfo"/>
Aug 09 18:30:34 user nova-compute[72418]:   </os>
Aug 09 18:30:34 user nova-compute[72418]:   <features>
Aug 09 18:30:34 user nova-compute[72418]:     <acpi/>
Aug 09 18:30:34 user nova-compute[72418]:     <apic/>
Aug 09 18:30:34 user nova-compute[72418]:     <vmcoreinfo/>
Aug 09 18:30:34 user nova-compute[72418]:   </features>
Aug 09 18:30:34 user nova-compute[72418]:   <clock offset="utc">
Aug 09 18:30:34 user nova-compute[72418]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 18:30:34 user nova-compute[72418]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 18:30:34 user nova-compute[72418]:     <timer name="hpet" present="no"/>
Aug 09 18:30:34 user nova-compute[72418]:   </clock>
Aug 09 18:30:34 user nova-compute[72418]:   <cpu mode="custom" match="exact">
Aug 09 18:30:34 user nova-compute[72418]:     <model>Nehalem</model>
Aug 09 18:30:34 user nova-compute[72418]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 18:30:34 user nova-compute[72418]:   </cpu>
Aug 09 18:30:34 user nova-compute[72418]:   <devices>
Aug 09 18:30:34 user nova-compute[72418]:     <disk type="file" device="disk">
Aug 09 18:30:34 user nova-compute[72418]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 18:30:34 user nova-compute[72418]:       <source file="/opt/stack/data/nova/instances/1c53f871-2be9-4119-b5c0-d5081e2f4388/disk"/>
Aug 09 18:30:34 user nova-compute[72418]:       <target dev="vda" bus="virtio"/>
Aug 09 18:30:34 user nova-compute[72418]:     </disk>
Aug 09 18:30:34 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:30:34 user nova-compute[72418]:       <mac address="fa:16:3e:d2:b0:b4"/>
Aug 09 18:30:34 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:30:34 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:30:34 user nova-compute[72418]:       <target dev="tap84eb2df4-69"/>
Aug 09 18:30:34 user nova-compute[72418]:     </interface>
Aug 09 18:30:34 user nova-compute[72418]:     <serial type="pty">
Aug 09 18:30:34 user nova-compute[72418]:       <log file="/opt/stack/data/nova/instances/1c53f871-2be9-4119-b5c0-d5081e2f4388/console.log" append="off"/>
Aug 09 18:30:34 user nova-compute[72418]:     </serial>
Aug 09 18:30:34 user nova-compute[72418]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 18:30:34 user nova-compute[72418]:     <video>
Aug 09 18:30:34 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:30:34 user nova-compute[72418]:     </video>
Aug 09 18:30:34 user nova-compute[72418]:     <rng model="virtio">
Aug 09 18:30:34 user nova-compute[72418]:       <backend model="random">/dev/urandom</backend>
Aug 09 18:30:34 user nova-compute[72418]:     </rng>
Aug 09 18:30:34 user nova-compute[72418]:     <controller type="usb" index="0" model="none"/>
Aug 09 18:30:34 user nova-compute[72418]:     <memballoon model="virtio">
Aug 09 18:30:34 user nova-compute[72418]:       <stats period="10"/>
Aug 09 18:30:34 user nova-compute[72418]:     </memballoon>
Aug 09 18:30:34 user nova-compute[72418]:   </devices>
Aug 09 18:30:34 user nova-compute[72418]: </domain>
Aug 09 18:30:34 user nova-compute[72418]:  {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 18:30:34 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:30:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-726518213',display_name='tempest-ServerRescueNegativeTestJSON-server-726518213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-726518213',id=23,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYgqOVWyn0dFX4Ed9YyvsFFE+jrecgTvMY887w9viUNHXtdgFMObE/m2tkO2gGT++FsK404JHMmKjOtdQQqB+ock45M5UHDZsc/R8Qw31XfQ2breULNzs/hrNYbxNLAYg==',key_name='tempest-keypair-462614825',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5c68622cd79472ba6ad14a6876aeaea',ramdisk_id='',reservation_id='r-pyrt30fh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-326572915',owner_user_name='tempest-ServerRescueNegativeTestJSON-326572915-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:30:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3c4feb0a14841eeb757a79b6a05d1fa',uuid=1c53f871-2be9-4119-b5c0-d5081e2f4388,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84eb2df4-6995-47c5-bf0f-387932ece66d", "address": "fa:16:3e:d2:b0:b4", "network": {"id": "15a49d9b-3c0d-449b-9473-29f219960e2c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c68622cd79472ba6ad14a6876aeaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84eb2df4-69", "ovs_interfaceid": "84eb2df4-6995-47c5-bf0f-387932ece66d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:30:34 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Converting VIF {"id": "84eb2df4-6995-47c5-bf0f-387932ece66d", "address": "fa:16:3e:d2:b0:b4", "network": {"id": "15a49d9b-3c0d-449b-9473-29f219960e2c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c68622cd79472ba6ad14a6876aeaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84eb2df4-69", "ovs_interfaceid": "84eb2df4-6995-47c5-bf0f-387932ece66d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:30:34 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:b0:b4,bridge_name='br-int',has_traffic_filtering=True,id=84eb2df4-6995-47c5-bf0f-387932ece66d,network=Network(15a49d9b-3c0d-449b-9473-29f219960e2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84eb2df4-69') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:30:34 user nova-compute[72418]: DEBUG os_vif [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:b0:b4,bridge_name='br-int',has_traffic_filtering=True,id=84eb2df4-6995-47c5-bf0f-387932ece66d,network=Network(15a49d9b-3c0d-449b-9473-29f219960e2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84eb2df4-69') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:30:34 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:34 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:30:34 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:30:34 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:34 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84eb2df4-69, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:30:34 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap84eb2df4-69, col_values=(('external_ids', {'iface-id': '84eb2df4-6995-47c5-bf0f-387932ece66d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:b0:b4', 'vm-uuid': '1c53f871-2be9-4119-b5c0-d5081e2f4388'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:30:34 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:34 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:30:34 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:34 user nova-compute[72418]: INFO os_vif [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:b0:b4,bridge_name='br-int',has_traffic_filtering=True,id=84eb2df4-6995-47c5-bf0f-387932ece66d,network=Network(15a49d9b-3c0d-449b-9473-29f219960e2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84eb2df4-69')
Aug 09 18:30:34 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:30:34 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] No VIF found with MAC fa:16:3e:d2:b0:b4, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:30:34 user nova-compute[72418]: INFO nova.compute.manager [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Rebuilding instance
Aug 09 18:30:34 user nova-compute[72418]: DEBUG nova.objects.instance [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lazy-loading 'trusted_certs' on Instance uuid c46f2599-93f8-412e-9918-7ace8a9f19dd {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:30:34 user nova-compute[72418]: DEBUG nova.compute.manager [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:30:34 user nova-compute[72418]: DEBUG nova.objects.instance [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lazy-loading 'pci_requests' on Instance uuid c46f2599-93f8-412e-9918-7ace8a9f19dd {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:30:34 user nova-compute[72418]: DEBUG nova.objects.instance [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lazy-loading 'pci_devices' on Instance uuid c46f2599-93f8-412e-9918-7ace8a9f19dd {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:30:34 user nova-compute[72418]: DEBUG nova.network.neutron [req-8f9fa214-a369-43ab-8534-081571c6bd8f req-db4ab713-ce22-415f-8171-287f0864bed9 service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Updated VIF entry in instance network info cache for port 84eb2df4-6995-47c5-bf0f-387932ece66d. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:30:34 user nova-compute[72418]: DEBUG nova.network.neutron [req-8f9fa214-a369-43ab-8534-081571c6bd8f req-db4ab713-ce22-415f-8171-287f0864bed9 service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Updating instance_info_cache with network_info: [{"id": "84eb2df4-6995-47c5-bf0f-387932ece66d", "address": "fa:16:3e:d2:b0:b4", "network": {"id": "15a49d9b-3c0d-449b-9473-29f219960e2c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c68622cd79472ba6ad14a6876aeaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84eb2df4-69", "ovs_interfaceid": "84eb2df4-6995-47c5-bf0f-387932ece66d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:30:34 user nova-compute[72418]: DEBUG nova.objects.instance [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lazy-loading 'resources' on Instance uuid c46f2599-93f8-412e-9918-7ace8a9f19dd {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:30:34 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-8f9fa214-a369-43ab-8534-081571c6bd8f req-db4ab713-ce22-415f-8171-287f0864bed9 service nova] Releasing lock "refresh_cache-1c53f871-2be9-4119-b5c0-d5081e2f4388" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:30:34 user nova-compute[72418]: DEBUG nova.objects.instance [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lazy-loading 'migration_context' on Instance uuid c46f2599-93f8-412e-9918-7ace8a9f19dd {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:30:34 user nova-compute[72418]: DEBUG nova.objects.instance [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72418) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 09 18:30:34 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:34 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:34 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:35 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:35 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:35 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:35 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:35 user nova-compute[72418]: DEBUG nova.compute.manager [req-42ab3bac-948e-41a7-bbdc-b37917312fff req-dd521928-8282-4fbc-8cec-41b90258886c service nova] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Received event network-vif-unplugged-6c9676d3-6e5d-4a95-a24f-0df4a15e993d {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:30:35 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-42ab3bac-948e-41a7-bbdc-b37917312fff req-dd521928-8282-4fbc-8cec-41b90258886c service nova] Acquiring lock "c46f2599-93f8-412e-9918-7ace8a9f19dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:30:35 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-42ab3bac-948e-41a7-bbdc-b37917312fff req-dd521928-8282-4fbc-8cec-41b90258886c service nova] Lock "c46f2599-93f8-412e-9918-7ace8a9f19dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:30:35 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-42ab3bac-948e-41a7-bbdc-b37917312fff req-dd521928-8282-4fbc-8cec-41b90258886c service nova] Lock "c46f2599-93f8-412e-9918-7ace8a9f19dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:30:35 user nova-compute[72418]: DEBUG nova.compute.manager [req-42ab3bac-948e-41a7-bbdc-b37917312fff req-dd521928-8282-4fbc-8cec-41b90258886c service nova] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] No waiting events found dispatching network-vif-unplugged-6c9676d3-6e5d-4a95-a24f-0df4a15e993d {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:30:35 user nova-compute[72418]: WARNING nova.compute.manager [req-42ab3bac-948e-41a7-bbdc-b37917312fff req-dd521928-8282-4fbc-8cec-41b90258886c service nova] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Received unexpected event network-vif-unplugged-6c9676d3-6e5d-4a95-a24f-0df4a15e993d for instance with vm_state active and task_state rebuilding.
Aug 09 18:30:35 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:35 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:36 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Instance destroyed successfully.
Aug 09 18:30:36 user nova-compute[72418]: INFO nova.compute.manager [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Detaching volume bdd54f84-accb-4284-bc01-7fe689728ee2
Aug 09 18:30:36 user nova-compute[72418]: INFO nova.virt.block_device [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Attempting to driver detach volume bdd54f84-accb-4284-bc01-7fe689728ee2 from mountpoint /dev/vdb
Aug 09 18:30:36 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Attempting to detach device vdb from instance c46f2599-93f8-412e-9918-7ace8a9f19dd from the persistent domain config. {{(pid=72418) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 18:30:36 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 18:30:36 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:30:36 user nova-compute[72418]:   <source dev="/dev/sdd"/>
Aug 09 18:30:36 user nova-compute[72418]:   <target dev="vdb" bus="virtio"/>
Aug 09 18:30:36 user nova-compute[72418]:   <serial>bdd54f84-accb-4284-bc01-7fe689728ee2</serial>
Aug 09 18:30:36 user nova-compute[72418]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 18:30:36 user nova-compute[72418]: </disk>
Aug 09 18:30:36 user nova-compute[72418]:  {{(pid=72418) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 18:30:36 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Successfully detached device vdb from instance c46f2599-93f8-412e-9918-7ace8a9f19dd from the persistent domain config.
Aug 09 18:30:36 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] calling os-brick to detach iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 18:30:36 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, {'target_iqns': ['iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lJvqKipO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:30:36 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 18:30:36 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:30:36 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:30:36 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2', 0)] {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 18:30:36 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:36 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:36 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[923f927a-e25c-448c-9b5f-8c8d57cb5432]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:30:36 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:36 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:36 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e827477-f9d5-44da-9187-d580645739e7]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:30:36 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:30:36 user nova-compute[72418]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f (non-flash)
Aug 09 18:30:36 user nova-compute[72418]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 (non-flash)
Aug 09 18:30:36 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:30:36 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:30:36 user nova-compute[72418]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f (non-flash)
Aug 09 18:30:36 user nova-compute[72418]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 (non-flash)
Aug 09 18:30:36 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:30:36 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f42d47ea830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2'): ({'sdd'}, set())}) {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 18:30:36 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Removing single pathed devices sdd {{(pid=72418) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 18:30:36 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:36 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:36 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70bc2af-42af-4fe8-8271-be0c3bbcaf9a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:30:36 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:36 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:36 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79a89ca-d8f8-4a50-ab61-7eadb5ad9484]: (4, ('ok\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:30:36 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Flushing IO for device /dev/sdd {{(pid=72418) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 18:30:36 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:36 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:36 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[840c4df8-7aec-48ca-9e08-a40b2c4c085b]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:30:36 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72418) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 18:30:36 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:36 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.062s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:36 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ce4ae0-e990-42d6-b1e8-26e4a97433c2]: (4, ('1', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:30:36 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 18:30:36 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] SCSI volumes sdd have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 18:30:36 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2')] {{(pid=72418) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 18:30:36 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:36 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:36 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[5136bb77-fcef-413b-a5e7-c1694171db4c]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:30:36 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:30:36 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 -p 172.16.0.220:3260 --logout {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:36 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:36 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a5c1ae-0696-4a9c-abdb-8fdf34b924be]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:30:36 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2, portal: 172.16.0.220,3260]
Aug 09 18:30:36 user nova-compute[72418]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2, portal: 172.16.0.220,3260] successful.
Aug 09 18:30:36 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:30:36 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 -p 172.16.0.220:3260 --op delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:36 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:36 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[94303eaf-f9b5-4a4d-aa59-1d559f8376ab]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:30:36 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:30:36 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:30:36 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] <== disconnect_volume: return (356ms) None {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:30:36 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Disconnected iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 18:30:36 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-2e96faf1-88cc-423c-811a-7cab66e3cd76 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Acquiring lock "688f50af-0e41-4467-b2db-04ac22f62963" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:30:36 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-2e96faf1-88cc-423c-811a-7cab66e3cd76 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Lock "688f50af-0e41-4467-b2db-04ac22f62963" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:30:36 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-2e96faf1-88cc-423c-811a-7cab66e3cd76 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Acquiring lock "688f50af-0e41-4467-b2db-04ac22f62963-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:30:36 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-2e96faf1-88cc-423c-811a-7cab66e3cd76 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Lock "688f50af-0e41-4467-b2db-04ac22f62963-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:30:36 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-2e96faf1-88cc-423c-811a-7cab66e3cd76 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Lock "688f50af-0e41-4467-b2db-04ac22f62963-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:30:36 user nova-compute[72418]: INFO nova.compute.manager [None req-2e96faf1-88cc-423c-811a-7cab66e3cd76 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Terminating instance
Aug 09 18:30:36 user nova-compute[72418]: DEBUG nova.compute.manager [None req-2e96faf1-88cc-423c-811a-7cab66e3cd76 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Start destroying the instance on the hypervisor. {{(pid=72418) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 18:30:36 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:36 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:36 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:36 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:37 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:37 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:37 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:37 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:37 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:37 user nova-compute[72418]: DEBUG nova.compute.manager [req-85ffa23d-17ae-41c8-9e70-534a707fb49b req-ae04c951-7251-4eed-b652-07c5cfaeed97 service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Received event network-vif-plugged-84eb2df4-6995-47c5-bf0f-387932ece66d {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:30:37 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-85ffa23d-17ae-41c8-9e70-534a707fb49b req-ae04c951-7251-4eed-b652-07c5cfaeed97 service nova] Acquiring lock "1c53f871-2be9-4119-b5c0-d5081e2f4388-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:30:37 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-85ffa23d-17ae-41c8-9e70-534a707fb49b req-ae04c951-7251-4eed-b652-07c5cfaeed97 service nova] Lock "1c53f871-2be9-4119-b5c0-d5081e2f4388-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:30:37 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-85ffa23d-17ae-41c8-9e70-534a707fb49b req-ae04c951-7251-4eed-b652-07c5cfaeed97 service nova] Lock "1c53f871-2be9-4119-b5c0-d5081e2f4388-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:30:37 user nova-compute[72418]: DEBUG nova.compute.manager [req-85ffa23d-17ae-41c8-9e70-534a707fb49b req-ae04c951-7251-4eed-b652-07c5cfaeed97 service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] No waiting events found dispatching network-vif-plugged-84eb2df4-6995-47c5-bf0f-387932ece66d {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:30:37 user nova-compute[72418]: WARNING nova.compute.manager [req-85ffa23d-17ae-41c8-9e70-534a707fb49b req-ae04c951-7251-4eed-b652-07c5cfaeed97 service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Received unexpected event network-vif-plugged-84eb2df4-6995-47c5-bf0f-387932ece66d for instance with vm_state building and task_state spawning.
Aug 09 18:30:37 user nova-compute[72418]: DEBUG nova.compute.manager [req-c6ddb55b-ed06-423a-a27d-e5af495ba155 req-972bc7ca-c22e-4104-8c34-b03c284d8c9d service nova] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Received event network-vif-plugged-6c9676d3-6e5d-4a95-a24f-0df4a15e993d {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:30:37 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-c6ddb55b-ed06-423a-a27d-e5af495ba155 req-972bc7ca-c22e-4104-8c34-b03c284d8c9d service nova] Acquiring lock "c46f2599-93f8-412e-9918-7ace8a9f19dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:30:37 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-c6ddb55b-ed06-423a-a27d-e5af495ba155 req-972bc7ca-c22e-4104-8c34-b03c284d8c9d service nova] Lock "c46f2599-93f8-412e-9918-7ace8a9f19dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:30:37 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-c6ddb55b-ed06-423a-a27d-e5af495ba155 req-972bc7ca-c22e-4104-8c34-b03c284d8c9d service nova] Lock "c46f2599-93f8-412e-9918-7ace8a9f19dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:30:37 user nova-compute[72418]: DEBUG nova.compute.manager [req-c6ddb55b-ed06-423a-a27d-e5af495ba155 req-972bc7ca-c22e-4104-8c34-b03c284d8c9d service nova] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] No waiting events found dispatching network-vif-plugged-6c9676d3-6e5d-4a95-a24f-0df4a15e993d {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:30:37 user nova-compute[72418]: WARNING nova.compute.manager [req-c6ddb55b-ed06-423a-a27d-e5af495ba155 req-972bc7ca-c22e-4104-8c34-b03c284d8c9d service nova] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Received unexpected event network-vif-plugged-6c9676d3-6e5d-4a95-a24f-0df4a15e993d for instance with vm_state active and task_state rebuilding.
Aug 09 18:30:37 user nova-compute[72418]: DEBUG nova.compute.manager [req-c6ddb55b-ed06-423a-a27d-e5af495ba155 req-972bc7ca-c22e-4104-8c34-b03c284d8c9d service nova] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Received event network-vif-plugged-12a58797-57bf-44b6-8f44-d93bf97dd41f {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:30:37 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-c6ddb55b-ed06-423a-a27d-e5af495ba155 req-972bc7ca-c22e-4104-8c34-b03c284d8c9d service nova] Acquiring lock "e582b61c-d998-4a3f-8392-a7f0e94a4dec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:30:37 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-c6ddb55b-ed06-423a-a27d-e5af495ba155 req-972bc7ca-c22e-4104-8c34-b03c284d8c9d service nova] Lock "e582b61c-d998-4a3f-8392-a7f0e94a4dec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:30:37 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-c6ddb55b-ed06-423a-a27d-e5af495ba155 req-972bc7ca-c22e-4104-8c34-b03c284d8c9d service nova] Lock "e582b61c-d998-4a3f-8392-a7f0e94a4dec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:30:37 user nova-compute[72418]: DEBUG nova.compute.manager [req-c6ddb55b-ed06-423a-a27d-e5af495ba155 req-972bc7ca-c22e-4104-8c34-b03c284d8c9d service nova] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] No waiting events found dispatching network-vif-plugged-12a58797-57bf-44b6-8f44-d93bf97dd41f {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:30:37 user nova-compute[72418]: WARNING nova.compute.manager [req-c6ddb55b-ed06-423a-a27d-e5af495ba155 req-972bc7ca-c22e-4104-8c34-b03c284d8c9d service nova] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Received unexpected event network-vif-plugged-12a58797-57bf-44b6-8f44-d93bf97dd41f for instance with vm_state building and task_state spawning.
Aug 09 18:30:37 user nova-compute[72418]: DEBUG nova.compute.manager [req-c6ddb55b-ed06-423a-a27d-e5af495ba155 req-972bc7ca-c22e-4104-8c34-b03c284d8c9d service nova] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Received event network-vif-plugged-12a58797-57bf-44b6-8f44-d93bf97dd41f {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:30:37 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-c6ddb55b-ed06-423a-a27d-e5af495ba155 req-972bc7ca-c22e-4104-8c34-b03c284d8c9d service nova] Acquiring lock "e582b61c-d998-4a3f-8392-a7f0e94a4dec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:30:37 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-c6ddb55b-ed06-423a-a27d-e5af495ba155 req-972bc7ca-c22e-4104-8c34-b03c284d8c9d service nova] Lock "e582b61c-d998-4a3f-8392-a7f0e94a4dec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:30:37 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-c6ddb55b-ed06-423a-a27d-e5af495ba155 req-972bc7ca-c22e-4104-8c34-b03c284d8c9d service nova] Lock "e582b61c-d998-4a3f-8392-a7f0e94a4dec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:30:37 user nova-compute[72418]: DEBUG nova.compute.manager [req-c6ddb55b-ed06-423a-a27d-e5af495ba155 req-972bc7ca-c22e-4104-8c34-b03c284d8c9d service nova] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] No waiting events found dispatching network-vif-plugged-12a58797-57bf-44b6-8f44-d93bf97dd41f {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:30:37 user nova-compute[72418]: WARNING nova.compute.manager [req-c6ddb55b-ed06-423a-a27d-e5af495ba155 req-972bc7ca-c22e-4104-8c34-b03c284d8c9d service nova] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Received unexpected event network-vif-plugged-12a58797-57bf-44b6-8f44-d93bf97dd41f for instance with vm_state building and task_state spawning.
Aug 09 18:30:37 user nova-compute[72418]: DEBUG nova.compute.manager [req-c6ddb55b-ed06-423a-a27d-e5af495ba155 req-972bc7ca-c22e-4104-8c34-b03c284d8c9d service nova] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Received event network-vif-unplugged-b2c3fa50-5615-4a58-8820-54c67c5d65bc {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:30:37 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-c6ddb55b-ed06-423a-a27d-e5af495ba155 req-972bc7ca-c22e-4104-8c34-b03c284d8c9d service nova] Acquiring lock "688f50af-0e41-4467-b2db-04ac22f62963-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:30:37 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-c6ddb55b-ed06-423a-a27d-e5af495ba155 req-972bc7ca-c22e-4104-8c34-b03c284d8c9d service nova] Lock "688f50af-0e41-4467-b2db-04ac22f62963-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:30:37 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-c6ddb55b-ed06-423a-a27d-e5af495ba155 req-972bc7ca-c22e-4104-8c34-b03c284d8c9d service nova] Lock "688f50af-0e41-4467-b2db-04ac22f62963-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:30:37 user nova-compute[72418]: DEBUG nova.compute.manager [req-c6ddb55b-ed06-423a-a27d-e5af495ba155 req-972bc7ca-c22e-4104-8c34-b03c284d8c9d service nova] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] No waiting events found dispatching network-vif-unplugged-b2c3fa50-5615-4a58-8820-54c67c5d65bc {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:30:37 user nova-compute[72418]: DEBUG nova.compute.manager [req-c6ddb55b-ed06-423a-a27d-e5af495ba155 req-972bc7ca-c22e-4104-8c34-b03c284d8c9d service nova] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Received event network-vif-unplugged-b2c3fa50-5615-4a58-8820-54c67c5d65bc for instance with task_state deleting. {{(pid=72418) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 18:30:37 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Instance destroyed successfully.
Aug 09 18:30:37 user nova-compute[72418]: DEBUG nova.objects.instance [None req-2e96faf1-88cc-423c-811a-7cab66e3cd76 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Lazy-loading 'resources' on Instance uuid 688f50af-0e41-4467-b2db-04ac22f62963 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:30:37 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-2e96faf1-88cc-423c-811a-7cab66e3cd76 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T18:27:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-630623237',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-630623237',id=20,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJchtztQL/UH2D7W5ks5SFjnLeiOZKRpefilUR0gjk7AuwJAWWS/gJOgdgu+Tp4jMu5wIaL/uSL50sh+6WeG1BBlMsFAUgEPx6/v6KmgLX0CBGzXIbAnMWDK0rX8sqetTQ==',key_name='tempest-keypair-267340570',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:27:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='86896e6544164fda93f7bea95a751707',ramdisk_id='',reservation_id='r-fo0cn966',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1428601923',owner_user_name='tempest-TaggedAttachmentsTest-1428601923-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:27:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df6cd3ad06524ae59968b133efceaa4c',uuid=688f50af-0e41-4467-b2db-04ac22f62963,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b2c3fa50-5615-4a58-8820-54c67c5d65bc", "address": "fa:16:3e:0a:9c:69", "network": {"id": "e24f7df5-d3a9-477d-997c-c145a2613ec8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1802267495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86896e6544164fda93f7bea95a751707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c3fa50-56", "ovs_interfaceid": "b2c3fa50-5615-4a58-8820-54c67c5d65bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 18:30:37 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-2e96faf1-88cc-423c-811a-7cab66e3cd76 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Converting VIF {"id": "b2c3fa50-5615-4a58-8820-54c67c5d65bc", "address": "fa:16:3e:0a:9c:69", "network": {"id": "e24f7df5-d3a9-477d-997c-c145a2613ec8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1802267495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86896e6544164fda93f7bea95a751707", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c3fa50-56", "ovs_interfaceid": "b2c3fa50-5615-4a58-8820-54c67c5d65bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:30:37 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-2e96faf1-88cc-423c-811a-7cab66e3cd76 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0a:9c:69,bridge_name='br-int',has_traffic_filtering=True,id=b2c3fa50-5615-4a58-8820-54c67c5d65bc,network=Network(e24f7df5-d3a9-477d-997c-c145a2613ec8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2c3fa50-56') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:30:37 user nova-compute[72418]: DEBUG os_vif [None req-2e96faf1-88cc-423c-811a-7cab66e3cd76 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:9c:69,bridge_name='br-int',has_traffic_filtering=True,id=b2c3fa50-5615-4a58-8820-54c67c5d65bc,network=Network(e24f7df5-d3a9-477d-997c-c145a2613ec8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2c3fa50-56') {{(pid=72418) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 18:30:37 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:37 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb2c3fa50-56, bridge=br-int, if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:30:37 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:37 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:30:37 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:37 user nova-compute[72418]: INFO os_vif [None req-2e96faf1-88cc-423c-811a-7cab66e3cd76 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:9c:69,bridge_name='br-int',has_traffic_filtering=True,id=b2c3fa50-5615-4a58-8820-54c67c5d65bc,network=Network(e24f7df5-d3a9-477d-997c-c145a2613ec8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2c3fa50-56')
Aug 09 18:30:37 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-2e96faf1-88cc-423c-811a-7cab66e3cd76 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Deleting instance files /opt/stack/data/nova/instances/688f50af-0e41-4467-b2db-04ac22f62963_del
Aug 09 18:30:37 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-2e96faf1-88cc-423c-811a-7cab66e3cd76 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Deletion of /opt/stack/data/nova/instances/688f50af-0e41-4467-b2db-04ac22f62963_del complete
Aug 09 18:30:37 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:37 user nova-compute[72418]: INFO nova.compute.manager [None req-2e96faf1-88cc-423c-811a-7cab66e3cd76 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Took 1.03 seconds to destroy the instance on the hypervisor.
Aug 09 18:30:37 user nova-compute[72418]: DEBUG oslo.service.loopingcall [None req-2e96faf1-88cc-423c-811a-7cab66e3cd76 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72418) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 18:30:37 user nova-compute[72418]: DEBUG nova.compute.manager [-] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Deallocating network for instance {{(pid=72418) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 18:30:37 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] deallocate_for_instance() {{(pid=72418) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 18:30:38 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:30:38 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Took 1.21 seconds to deallocate network for instance.
Aug 09 18:30:38 user nova-compute[72418]: DEBUG nova.compute.manager [req-5a54f746-8c3f-49d7-98c7-3f0e5973d435 req-307d3e7a-20e8-4c33-aac8-ea8e1d82fdbd service nova] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Received event network-vif-deleted-b2c3fa50-5615-4a58-8820-54c67c5d65bc {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:30:38 user nova-compute[72418]: INFO nova.compute.manager [req-5a54f746-8c3f-49d7-98c7-3f0e5973d435 req-307d3e7a-20e8-4c33-aac8-ea8e1d82fdbd service nova] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Neutron deleted interface b2c3fa50-5615-4a58-8820-54c67c5d65bc; detaching it from the instance and deleting it from the info cache
Aug 09 18:30:38 user nova-compute[72418]: DEBUG nova.network.neutron [req-5a54f746-8c3f-49d7-98c7-3f0e5973d435 req-307d3e7a-20e8-4c33-aac8-ea8e1d82fdbd service nova] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:30:39 user nova-compute[72418]: DEBUG nova.compute.manager [req-5a54f746-8c3f-49d7-98c7-3f0e5973d435 req-307d3e7a-20e8-4c33-aac8-ea8e1d82fdbd service nova] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Detach interface failed, port_id=b2c3fa50-5615-4a58-8820-54c67c5d65bc, reason: Instance 688f50af-0e41-4467-b2db-04ac22f62963 could not be found. {{(pid=72418) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 18:30:39 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-2e96faf1-88cc-423c-811a-7cab66e3cd76 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:30:39 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-2e96faf1-88cc-423c-811a-7cab66e3cd76 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:30:39 user nova-compute[72418]: DEBUG nova.compute.manager [req-5fc22589-276b-424d-8275-239ae78a2f0c req-bf24c416-f454-421c-a571-c9ebcdd11a74 service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Received event network-vif-plugged-84eb2df4-6995-47c5-bf0f-387932ece66d {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:30:39 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-5fc22589-276b-424d-8275-239ae78a2f0c req-bf24c416-f454-421c-a571-c9ebcdd11a74 service nova] Acquiring lock "1c53f871-2be9-4119-b5c0-d5081e2f4388-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:30:39 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-5fc22589-276b-424d-8275-239ae78a2f0c req-bf24c416-f454-421c-a571-c9ebcdd11a74 service nova] Lock "1c53f871-2be9-4119-b5c0-d5081e2f4388-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:30:39 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-5fc22589-276b-424d-8275-239ae78a2f0c req-bf24c416-f454-421c-a571-c9ebcdd11a74 service nova] Lock "1c53f871-2be9-4119-b5c0-d5081e2f4388-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:30:39 user nova-compute[72418]: DEBUG nova.compute.manager [req-5fc22589-276b-424d-8275-239ae78a2f0c req-bf24c416-f454-421c-a571-c9ebcdd11a74 service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] No waiting events found dispatching network-vif-plugged-84eb2df4-6995-47c5-bf0f-387932ece66d {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:30:39 user nova-compute[72418]: WARNING nova.compute.manager [req-5fc22589-276b-424d-8275-239ae78a2f0c req-bf24c416-f454-421c-a571-c9ebcdd11a74 service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Received unexpected event network-vif-plugged-84eb2df4-6995-47c5-bf0f-387932ece66d for instance with vm_state building and task_state spawning.
Aug 09 18:30:39 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-2e96faf1-88cc-423c-811a-7cab66e3cd76 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:30:39 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605839.423611, e582b61c-d998-4a3f-8392-a7f0e94a4dec => Resumed> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:30:39 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] VM Resumed (Lifecycle Event)
Aug 09 18:30:39 user nova-compute[72418]: DEBUG nova.compute.manager [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Instance event wait completed in 0 seconds for  {{(pid=72418) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 18:30:39 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Guest created on hypervisor {{(pid=72418) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 18:30:39 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Instance spawned successfully.
Aug 09 18:30:39 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 18:30:39 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-2e96faf1-88cc-423c-811a-7cab66e3cd76 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:30:39 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:30:39 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Found default for hw_cdrom_bus of ide {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:30:39 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Found default for hw_disk_bus of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:30:39 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Found default for hw_input_bus of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:30:39 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Found default for hw_pointer_model of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:30:39 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Found default for hw_video_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:30:39 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Found default for hw_vif_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:30:39 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:30:39 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-2e96faf1-88cc-423c-811a-7cab66e3cd76 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.451s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:30:39 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:30:39 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605839.4249115, e582b61c-d998-4a3f-8392-a7f0e94a4dec => Started> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:30:39 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] VM Started (Lifecycle Event)
Aug 09 18:30:39 user nova-compute[72418]: INFO nova.scheduler.client.report [None req-2e96faf1-88cc-423c-811a-7cab66e3cd76 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Deleted allocations for instance 688f50af-0e41-4467-b2db-04ac22f62963
Aug 09 18:30:39 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:30:39 user nova-compute[72418]: DEBUG nova.compute.manager [req-c076d305-02d9-4304-9e95-21b3dbf6ae89 req-3e22faec-3680-49f6-9015-7ee70071de97 service nova] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Received event network-vif-plugged-b2c3fa50-5615-4a58-8820-54c67c5d65bc {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:30:39 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-c076d305-02d9-4304-9e95-21b3dbf6ae89 req-3e22faec-3680-49f6-9015-7ee70071de97 service nova] Acquiring lock "688f50af-0e41-4467-b2db-04ac22f62963-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:30:39 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-c076d305-02d9-4304-9e95-21b3dbf6ae89 req-3e22faec-3680-49f6-9015-7ee70071de97 service nova] Lock "688f50af-0e41-4467-b2db-04ac22f62963-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:30:39 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-c076d305-02d9-4304-9e95-21b3dbf6ae89 req-3e22faec-3680-49f6-9015-7ee70071de97 service nova] Lock "688f50af-0e41-4467-b2db-04ac22f62963-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:30:39 user nova-compute[72418]: DEBUG nova.compute.manager [req-c076d305-02d9-4304-9e95-21b3dbf6ae89 req-3e22faec-3680-49f6-9015-7ee70071de97 service nova] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] No waiting events found dispatching network-vif-plugged-b2c3fa50-5615-4a58-8820-54c67c5d65bc {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:30:39 user nova-compute[72418]: WARNING nova.compute.manager [req-c076d305-02d9-4304-9e95-21b3dbf6ae89 req-3e22faec-3680-49f6-9015-7ee70071de97 service nova] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Received unexpected event network-vif-plugged-b2c3fa50-5615-4a58-8820-54c67c5d65bc for instance with vm_state deleted and task_state None.
Aug 09 18:30:39 user nova-compute[72418]: INFO nova.compute.manager [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Took 8.51 seconds to spawn the instance on the hypervisor.
Aug 09 18:30:39 user nova-compute[72418]: DEBUG nova.compute.manager [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:30:39 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:30:39 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:30:39 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-2e96faf1-88cc-423c-811a-7cab66e3cd76 tempest-TaggedAttachmentsTest-1428601923 tempest-TaggedAttachmentsTest-1428601923-project-member] Lock "688f50af-0e41-4467-b2db-04ac22f62963" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.891s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:30:39 user nova-compute[72418]: INFO nova.compute.manager [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Took 10.14 seconds to build instance.
Aug 09 18:30:39 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-e773736f-eb8e-48f3-b9aa-76d48febefea tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "e582b61c-d998-4a3f-8392-a7f0e94a4dec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.325s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:30:39 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605839.8386772, 1c53f871-2be9-4119-b5c0-d5081e2f4388 => Resumed> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:30:39 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] VM Resumed (Lifecycle Event)
Aug 09 18:30:39 user nova-compute[72418]: DEBUG nova.compute.manager [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Instance event wait completed in 0 seconds for  {{(pid=72418) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 18:30:39 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Guest created on hypervisor {{(pid=72418) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 18:30:39 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Instance spawned successfully.
Aug 09 18:30:39 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 18:30:39 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:30:39 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:30:39 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Found default for hw_cdrom_bus of ide {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:30:39 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Found default for hw_disk_bus of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:30:39 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Found default for hw_input_bus of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:30:39 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Found default for hw_pointer_model of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:30:39 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Found default for hw_video_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:30:39 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Found default for hw_vif_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:30:39 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:30:39 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605839.842915, 1c53f871-2be9-4119-b5c0-d5081e2f4388 => Started> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:30:39 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] VM Started (Lifecycle Event)
Aug 09 18:30:39 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:30:39 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:30:39 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:30:39 user nova-compute[72418]: INFO nova.compute.manager [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Took 9.62 seconds to spawn the instance on the hypervisor.
Aug 09 18:30:39 user nova-compute[72418]: DEBUG nova.compute.manager [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:30:40 user nova-compute[72418]: INFO nova.compute.manager [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Took 10.94 seconds to build instance.
Aug 09 18:30:40 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-630a5930-b253-4d58-a0eb-42d1e3a414ba tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "1c53f871-2be9-4119-b5c0-d5081e2f4388" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.110s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:30:42 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:42 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:43 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Instance destroyed successfully.
Aug 09 18:30:43 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:26:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1080698985',display_name='tempest-ServerActionsTestOtherA-server-837028949',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1080698985',id=17,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZ8H8MvJhas/vPLXexc9KvUsV16Uhsl6uYTaDGrZC9aE3rBb3x7zoV+NqPR5zKzOIkCqtgn8ZVvU3tdtAtEAYrB/yDbEIXvY0hEVuVM8ww17BzMc60Vtn0IN61LmfWZ8Q==',key_name='tempest-keypair-882054128',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:26:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='78b6e36a5b61456092ce7de9212c3c82',ramdisk_id='',reservation_id='r-g13uz4wm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1039384122',owner_user_name='tempest-ServerActionsTestOtherA-1039384122-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:30:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='edc9ed6980274b978caf0666a9b31379',uuid=c46f2599-93f8-412e-9918-7ace8a9f19dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6c9676d3-6e5d-4a95-a24f-0df4a15e993d", "address": "fa:16:3e:80:17:d9", "network": {"id": "bd36ef30-e57d-473f-97bc-c51b5db08aa7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-425133239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78b6e36a5b61456092ce7de9212c3c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9676d3-6e", "ovs_interfaceid": "6c9676d3-6e5d-4a95-a24f-0df4a15e993d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 18:30:43 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Converting VIF {"id": "6c9676d3-6e5d-4a95-a24f-0df4a15e993d", "address": "fa:16:3e:80:17:d9", "network": {"id": "bd36ef30-e57d-473f-97bc-c51b5db08aa7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-425133239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78b6e36a5b61456092ce7de9212c3c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9676d3-6e", "ovs_interfaceid": "6c9676d3-6e5d-4a95-a24f-0df4a15e993d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:30:43 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:17:d9,bridge_name='br-int',has_traffic_filtering=True,id=6c9676d3-6e5d-4a95-a24f-0df4a15e993d,network=Network(bd36ef30-e57d-473f-97bc-c51b5db08aa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9676d3-6e') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:30:43 user nova-compute[72418]: DEBUG os_vif [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:17:d9,bridge_name='br-int',has_traffic_filtering=True,id=6c9676d3-6e5d-4a95-a24f-0df4a15e993d,network=Network(bd36ef30-e57d-473f-97bc-c51b5db08aa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9676d3-6e') {{(pid=72418) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 18:30:43 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:43 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6c9676d3-6e, bridge=br-int, if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:30:43 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:43 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:30:43 user nova-compute[72418]: INFO os_vif [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:17:d9,bridge_name='br-int',has_traffic_filtering=True,id=6c9676d3-6e5d-4a95-a24f-0df4a15e993d,network=Network(bd36ef30-e57d-473f-97bc-c51b5db08aa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9676d3-6e')
Aug 09 18:30:43 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] calling os-brick to detach iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 18:30:43 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, {'target_iqns': ['iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lJvqKipO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:30:43 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 18:30:43 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:30:43 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:30:43 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2', 0)] {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 18:30:43 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:43 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:43 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[460746fc-c8c0-48be-ac54-cce646c771d2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:30:43 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:43 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:43 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3823065-a526-4942-aea9-0a43e0ca2bfe]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:30:43 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:30:43 user nova-compute[72418]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f (non-flash)
Aug 09 18:30:43 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:30:43 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:30:43 user nova-compute[72418]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f (non-flash)
Aug 09 18:30:43 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:30:43 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f42d47057e0>, {}) {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 18:30:43 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Disconnecting from: [] {{(pid=72418) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 18:30:43 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.062s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:30:43 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] <== disconnect_volume: return (63ms) None {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:30:43 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Disconnected iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 18:30:43 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Deleting instance files /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd_del
Aug 09 18:30:43 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Deletion of /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd_del complete
Aug 09 18:30:43 user nova-compute[72418]: INFO nova.virt.block_device [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Booting with volume bdd54f84-accb-4284-bc01-7fe689728ee2 at /dev/vdb
Aug 09 18:30:43 user nova-compute[72418]: DEBUG os_brick.utils [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:30:43 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:43 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:43 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[6525b291-fb6c-4763-bc44-7e08f81d4895]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ad56b243ad71\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:30:43 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:44 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:44 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65b9c85-debc-4137-a65e-5f16f3779e45]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:30:44 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:44 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:44 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d68e84-98df-4952-b0bb-e8e4a6176583]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:30:44 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c145bef-3b9e-44c4-9e69-06e4dea30cc8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:30:44 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Running cmd (subprocess): nvme version {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:44 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] 'nvme version' failed. Not Retrying. {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:30:44 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] nvme not present on system {{(pid=72418) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 18:30:44 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:44 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:30:44 user nova-compute[72418]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 18:30:44 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d33a50b-82d9-4566-a949-c746579faabe]: (4, '') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:30:44 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72418) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 18:30:44 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 18:30:44 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] LIGHTOS: no hostnqn found. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 18:30:44 user nova-compute[72418]: DEBUG os_brick.utils [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ad56b243ad71', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:30:44 user nova-compute[72418]: DEBUG nova.virt.block_device [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Updating existing volume attachment record: f8ce1d16-1332-4543-927b-9497e0aebf1c {{(pid=72418) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 18:30:47 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:47 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:30:48 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:48 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:30:50 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:30:50 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:30:50 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72418) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 18:30:51 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-744b94a7-cb89-4a48-bad4-d0cc0e1b5133 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Acquiring lock "479ea4c3-ad7f-4da0-a901-defe46d96065" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:30:51 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-744b94a7-cb89-4a48-bad4-d0cc0e1b5133 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Lock "479ea4c3-ad7f-4da0-a901-defe46d96065" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:30:51 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-744b94a7-cb89-4a48-bad4-d0cc0e1b5133 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Acquiring lock "479ea4c3-ad7f-4da0-a901-defe46d96065-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:30:51 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-744b94a7-cb89-4a48-bad4-d0cc0e1b5133 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Lock "479ea4c3-ad7f-4da0-a901-defe46d96065-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:30:51 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-744b94a7-cb89-4a48-bad4-d0cc0e1b5133 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Lock "479ea4c3-ad7f-4da0-a901-defe46d96065-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:30:51 user nova-compute[72418]: INFO nova.compute.manager [None req-744b94a7-cb89-4a48-bad4-d0cc0e1b5133 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Terminating instance
Aug 09 18:30:51 user nova-compute[72418]: DEBUG nova.compute.manager [None req-744b94a7-cb89-4a48-bad4-d0cc0e1b5133 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Start destroying the instance on the hypervisor. {{(pid=72418) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 18:30:51 user nova-compute[72418]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691605836.1161711, c46f2599-93f8-412e-9918-7ace8a9f19dd => Stopped> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:30:51 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] VM Stopped (Lifecycle Event)
Aug 09 18:30:51 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:51 user nova-compute[72418]: DEBUG nova.compute.manager [None req-d0c5491c-afd3-43a7-b8cd-cc92b8466562 None None] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:30:51 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:51 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:51 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:51 user nova-compute[72418]: DEBUG nova.compute.manager [req-d7f92a26-c3e0-49a2-859f-e4f1aae047f1 req-a695cc8b-e920-452a-b3cf-37a4d1ada1aa service nova] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Received event network-vif-unplugged-1ebdd43e-c423-4e1c-9e50-1419f2857ae4 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:30:51 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-d7f92a26-c3e0-49a2-859f-e4f1aae047f1 req-a695cc8b-e920-452a-b3cf-37a4d1ada1aa service nova] Acquiring lock "479ea4c3-ad7f-4da0-a901-defe46d96065-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:30:51 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-d7f92a26-c3e0-49a2-859f-e4f1aae047f1 req-a695cc8b-e920-452a-b3cf-37a4d1ada1aa service nova] Lock "479ea4c3-ad7f-4da0-a901-defe46d96065-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:30:51 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-d7f92a26-c3e0-49a2-859f-e4f1aae047f1 req-a695cc8b-e920-452a-b3cf-37a4d1ada1aa service nova] Lock "479ea4c3-ad7f-4da0-a901-defe46d96065-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:30:51 user nova-compute[72418]: DEBUG nova.compute.manager [req-d7f92a26-c3e0-49a2-859f-e4f1aae047f1 req-a695cc8b-e920-452a-b3cf-37a4d1ada1aa service nova] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] No waiting events found dispatching network-vif-unplugged-1ebdd43e-c423-4e1c-9e50-1419f2857ae4 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:30:51 user nova-compute[72418]: DEBUG nova.compute.manager [req-d7f92a26-c3e0-49a2-859f-e4f1aae047f1 req-a695cc8b-e920-452a-b3cf-37a4d1ada1aa service nova] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Received event network-vif-unplugged-1ebdd43e-c423-4e1c-9e50-1419f2857ae4 for instance with task_state deleting. {{(pid=72418) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 18:30:51 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:51 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:51 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:51 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Instance destroyed successfully.
Aug 09 18:30:51 user nova-compute[72418]: DEBUG nova.objects.instance [None req-744b94a7-cb89-4a48-bad4-d0cc0e1b5133 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Lazy-loading 'resources' on Instance uuid 479ea4c3-ad7f-4da0-a901-defe46d96065 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:30:51 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-744b94a7-cb89-4a48-bad4-d0cc0e1b5133 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:21:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1950373992',display_name='tempest-ServersNegativeTestJSON-server-1950373992',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1950373992',id=5,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:22:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60e3274c2e3447fcad6d1f16765f4afd',ramdisk_id='',reservation_id='r-vf6jwbyi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1802403477',owner_user_name='tempest-ServersNegativeTestJSON-1802403477-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:22:14Z,user_data=None,user_id='6e1439f58ac640f481a59944ee145f97',uuid=479ea4c3-ad7f-4da0-a901-defe46d96065,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ebdd43e-c423-4e1c-9e50-1419f2857ae4", "address": "fa:16:3e:3b:33:c3", "network": {"id": "d72da164-7e30-4eeb-8c28-765454c2b24f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1301909372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e3274c2e3447fcad6d1f16765f4afd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ebdd43e-c4", "ovs_interfaceid": "1ebdd43e-c423-4e1c-9e50-1419f2857ae4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 18:30:51 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-744b94a7-cb89-4a48-bad4-d0cc0e1b5133 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Converting VIF {"id": "1ebdd43e-c423-4e1c-9e50-1419f2857ae4", "address": "fa:16:3e:3b:33:c3", "network": {"id": "d72da164-7e30-4eeb-8c28-765454c2b24f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1301909372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e3274c2e3447fcad6d1f16765f4afd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ebdd43e-c4", "ovs_interfaceid": "1ebdd43e-c423-4e1c-9e50-1419f2857ae4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:30:51 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-744b94a7-cb89-4a48-bad4-d0cc0e1b5133 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:33:c3,bridge_name='br-int',has_traffic_filtering=True,id=1ebdd43e-c423-4e1c-9e50-1419f2857ae4,network=Network(d72da164-7e30-4eeb-8c28-765454c2b24f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ebdd43e-c4') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:30:51 user nova-compute[72418]: DEBUG os_vif [None req-744b94a7-cb89-4a48-bad4-d0cc0e1b5133 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:33:c3,bridge_name='br-int',has_traffic_filtering=True,id=1ebdd43e-c423-4e1c-9e50-1419f2857ae4,network=Network(d72da164-7e30-4eeb-8c28-765454c2b24f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ebdd43e-c4') {{(pid=72418) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 18:30:51 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:51 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ebdd43e-c4, bridge=br-int, if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:30:51 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:52 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:30:52 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:52 user nova-compute[72418]: INFO os_vif [None req-744b94a7-cb89-4a48-bad4-d0cc0e1b5133 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:33:c3,bridge_name='br-int',has_traffic_filtering=True,id=1ebdd43e-c423-4e1c-9e50-1419f2857ae4,network=Network(d72da164-7e30-4eeb-8c28-765454c2b24f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ebdd43e-c4')
Aug 09 18:30:52 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-744b94a7-cb89-4a48-bad4-d0cc0e1b5133 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Deleting instance files /opt/stack/data/nova/instances/479ea4c3-ad7f-4da0-a901-defe46d96065_del
Aug 09 18:30:52 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-744b94a7-cb89-4a48-bad4-d0cc0e1b5133 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Deletion of /opt/stack/data/nova/instances/479ea4c3-ad7f-4da0-a901-defe46d96065_del complete
Aug 09 18:30:52 user nova-compute[72418]: INFO nova.compute.manager [None req-744b94a7-cb89-4a48-bad4-d0cc0e1b5133 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Took 1.08 seconds to destroy the instance on the hypervisor.
Aug 09 18:30:52 user nova-compute[72418]: DEBUG oslo.service.loopingcall [None req-744b94a7-cb89-4a48-bad4-d0cc0e1b5133 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72418) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 18:30:52 user nova-compute[72418]: DEBUG nova.compute.manager [-] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Deallocating network for instance {{(pid=72418) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 18:30:52 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] deallocate_for_instance() {{(pid=72418) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 18:30:52 user nova-compute[72418]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691605837.6016786, 688f50af-0e41-4467-b2db-04ac22f62963 => Stopped> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:30:52 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] VM Stopped (Lifecycle Event)
Aug 09 18:30:52 user nova-compute[72418]: DEBUG nova.compute.manager [None req-531ea8bd-2ff5-4a02-88b2-6239b57e2c05 None None] [instance: 688f50af-0e41-4467-b2db-04ac22f62963] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:30:52 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:52 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:52 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:52 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:52 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:52 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:52 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:30:52 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:30:53 user nova-compute[72418]: DEBUG nova.compute.manager [req-a00547fd-4a61-4498-83ee-15d8ceabae61 req-a7ff4b40-e48a-4861-8f5f-79615b2fd955 service nova] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Received event network-vif-plugged-1ebdd43e-c423-4e1c-9e50-1419f2857ae4 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:30:53 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a00547fd-4a61-4498-83ee-15d8ceabae61 req-a7ff4b40-e48a-4861-8f5f-79615b2fd955 service nova] Acquiring lock "479ea4c3-ad7f-4da0-a901-defe46d96065-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:30:53 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a00547fd-4a61-4498-83ee-15d8ceabae61 req-a7ff4b40-e48a-4861-8f5f-79615b2fd955 service nova] Lock "479ea4c3-ad7f-4da0-a901-defe46d96065-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:30:53 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a00547fd-4a61-4498-83ee-15d8ceabae61 req-a7ff4b40-e48a-4861-8f5f-79615b2fd955 service nova] Lock "479ea4c3-ad7f-4da0-a901-defe46d96065-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:30:53 user nova-compute[72418]: DEBUG nova.compute.manager [req-a00547fd-4a61-4498-83ee-15d8ceabae61 req-a7ff4b40-e48a-4861-8f5f-79615b2fd955 service nova] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] No waiting events found dispatching network-vif-plugged-1ebdd43e-c423-4e1c-9e50-1419f2857ae4 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:30:53 user nova-compute[72418]: WARNING nova.compute.manager [req-a00547fd-4a61-4498-83ee-15d8ceabae61 req-a7ff4b40-e48a-4861-8f5f-79615b2fd955 service nova] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Received unexpected event network-vif-plugged-1ebdd43e-c423-4e1c-9e50-1419f2857ae4 for instance with vm_state active and task_state deleting.
Aug 09 18:30:53 user nova-compute[72418]: DEBUG nova.compute.manager [req-a00547fd-4a61-4498-83ee-15d8ceabae61 req-a7ff4b40-e48a-4861-8f5f-79615b2fd955 service nova] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Received event network-vif-plugged-1ebdd43e-c423-4e1c-9e50-1419f2857ae4 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:30:53 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a00547fd-4a61-4498-83ee-15d8ceabae61 req-a7ff4b40-e48a-4861-8f5f-79615b2fd955 service nova] Acquiring lock "479ea4c3-ad7f-4da0-a901-defe46d96065-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:30:53 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a00547fd-4a61-4498-83ee-15d8ceabae61 req-a7ff4b40-e48a-4861-8f5f-79615b2fd955 service nova] Lock "479ea4c3-ad7f-4da0-a901-defe46d96065-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:30:53 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a00547fd-4a61-4498-83ee-15d8ceabae61 req-a7ff4b40-e48a-4861-8f5f-79615b2fd955 service nova] Lock "479ea4c3-ad7f-4da0-a901-defe46d96065-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:30:53 user nova-compute[72418]: DEBUG nova.compute.manager [req-a00547fd-4a61-4498-83ee-15d8ceabae61 req-a7ff4b40-e48a-4861-8f5f-79615b2fd955 service nova] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] No waiting events found dispatching network-vif-plugged-1ebdd43e-c423-4e1c-9e50-1419f2857ae4 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:30:53 user nova-compute[72418]: WARNING nova.compute.manager [req-a00547fd-4a61-4498-83ee-15d8ceabae61 req-a7ff4b40-e48a-4861-8f5f-79615b2fd955 service nova] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Received unexpected event network-vif-plugged-1ebdd43e-c423-4e1c-9e50-1419f2857ae4 for instance with vm_state active and task_state deleting.
Aug 09 18:30:53 user nova-compute[72418]: DEBUG nova.compute.manager [req-a00547fd-4a61-4498-83ee-15d8ceabae61 req-a7ff4b40-e48a-4861-8f5f-79615b2fd955 service nova] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Received event network-vif-plugged-1ebdd43e-c423-4e1c-9e50-1419f2857ae4 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:30:53 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a00547fd-4a61-4498-83ee-15d8ceabae61 req-a7ff4b40-e48a-4861-8f5f-79615b2fd955 service nova] Acquiring lock "479ea4c3-ad7f-4da0-a901-defe46d96065-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:30:53 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a00547fd-4a61-4498-83ee-15d8ceabae61 req-a7ff4b40-e48a-4861-8f5f-79615b2fd955 service nova] Lock "479ea4c3-ad7f-4da0-a901-defe46d96065-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:30:53 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a00547fd-4a61-4498-83ee-15d8ceabae61 req-a7ff4b40-e48a-4861-8f5f-79615b2fd955 service nova] Lock "479ea4c3-ad7f-4da0-a901-defe46d96065-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:30:53 user nova-compute[72418]: DEBUG nova.compute.manager [req-a00547fd-4a61-4498-83ee-15d8ceabae61 req-a7ff4b40-e48a-4861-8f5f-79615b2fd955 service nova] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] No waiting events found dispatching network-vif-plugged-1ebdd43e-c423-4e1c-9e50-1419f2857ae4 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:30:53 user nova-compute[72418]: WARNING nova.compute.manager [req-a00547fd-4a61-4498-83ee-15d8ceabae61 req-a7ff4b40-e48a-4861-8f5f-79615b2fd955 service nova] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Received unexpected event network-vif-plugged-1ebdd43e-c423-4e1c-9e50-1419f2857ae4 for instance with vm_state active and task_state deleting.
Aug 09 18:30:53 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:30:53 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Took 1.69 seconds to deallocate network for instance.
Aug 09 18:30:53 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-744b94a7-cb89-4a48-bad4-d0cc0e1b5133 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:30:53 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-744b94a7-cb89-4a48-bad4-d0cc0e1b5133 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:30:53 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:30:53 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:30:53 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:30:54 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-744b94a7-cb89-4a48-bad4-d0cc0e1b5133 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:30:54 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-744b94a7-cb89-4a48-bad4-d0cc0e1b5133 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:30:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-744b94a7-cb89-4a48-bad4-d0cc0e1b5133 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.527s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:30:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.486s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:30:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:30:54 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Auditing locally available compute resources for user (node: user) {{(pid=72418) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 18:30:54 user nova-compute[72418]: INFO nova.scheduler.client.report [None req-744b94a7-cb89-4a48-bad4-d0cc0e1b5133 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Deleted allocations for instance 479ea4c3-ad7f-4da0-a901-defe46d96065
Aug 09 18:30:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-744b94a7-cb89-4a48-bad4-d0cc0e1b5133 tempest-ServersNegativeTestJSON-1802403477 tempest-ServersNegativeTestJSON-1802403477-project-member] Lock "479ea4c3-ad7f-4da0-a901-defe46d96065" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.533s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:30:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c53f871-2be9-4119-b5c0-d5081e2f4388/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c53f871-2be9-4119-b5c0-d5081e2f4388/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c53f871-2be9-4119-b5c0-d5081e2f4388/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c53f871-2be9-4119-b5c0-d5081e2f4388/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:55 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/046617cf-13e5-44cf-9981-c1ae4ffd3851/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:55 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/046617cf-13e5-44cf-9981-c1ae4ffd3851/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:55 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/046617cf-13e5-44cf-9981-c1ae4ffd3851/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:55 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/046617cf-13e5-44cf-9981-c1ae4ffd3851/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:55 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:55 user nova-compute[72418]: DEBUG nova.compute.manager [req-a9802357-3362-4d4a-ae13-b93da98db9ee req-e5678f67-e68e-4a95-96bb-e75870f53c7f service nova] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Received event network-vif-unplugged-1ebdd43e-c423-4e1c-9e50-1419f2857ae4 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:30:55 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a9802357-3362-4d4a-ae13-b93da98db9ee req-e5678f67-e68e-4a95-96bb-e75870f53c7f service nova] Acquiring lock "479ea4c3-ad7f-4da0-a901-defe46d96065-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:30:55 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a9802357-3362-4d4a-ae13-b93da98db9ee req-e5678f67-e68e-4a95-96bb-e75870f53c7f service nova] Lock "479ea4c3-ad7f-4da0-a901-defe46d96065-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:30:55 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a9802357-3362-4d4a-ae13-b93da98db9ee req-e5678f67-e68e-4a95-96bb-e75870f53c7f service nova] Lock "479ea4c3-ad7f-4da0-a901-defe46d96065-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:30:55 user nova-compute[72418]: DEBUG nova.compute.manager [req-a9802357-3362-4d4a-ae13-b93da98db9ee req-e5678f67-e68e-4a95-96bb-e75870f53c7f service nova] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] No waiting events found dispatching network-vif-unplugged-1ebdd43e-c423-4e1c-9e50-1419f2857ae4 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:30:55 user nova-compute[72418]: WARNING nova.compute.manager [req-a9802357-3362-4d4a-ae13-b93da98db9ee req-e5678f67-e68e-4a95-96bb-e75870f53c7f service nova] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Received unexpected event network-vif-unplugged-1ebdd43e-c423-4e1c-9e50-1419f2857ae4 for instance with vm_state deleted and task_state None.
Aug 09 18:30:55 user nova-compute[72418]: DEBUG nova.compute.manager [req-a9802357-3362-4d4a-ae13-b93da98db9ee req-e5678f67-e68e-4a95-96bb-e75870f53c7f service nova] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Received event network-vif-deleted-1ebdd43e-c423-4e1c-9e50-1419f2857ae4 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:30:55 user nova-compute[72418]: DEBUG nova.compute.manager [req-a9802357-3362-4d4a-ae13-b93da98db9ee req-e5678f67-e68e-4a95-96bb-e75870f53c7f service nova] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Received event network-vif-plugged-1ebdd43e-c423-4e1c-9e50-1419f2857ae4 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:30:55 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a9802357-3362-4d4a-ae13-b93da98db9ee req-e5678f67-e68e-4a95-96bb-e75870f53c7f service nova] Acquiring lock "479ea4c3-ad7f-4da0-a901-defe46d96065-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:30:55 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a9802357-3362-4d4a-ae13-b93da98db9ee req-e5678f67-e68e-4a95-96bb-e75870f53c7f service nova] Lock "479ea4c3-ad7f-4da0-a901-defe46d96065-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:30:55 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a9802357-3362-4d4a-ae13-b93da98db9ee req-e5678f67-e68e-4a95-96bb-e75870f53c7f service nova] Lock "479ea4c3-ad7f-4da0-a901-defe46d96065-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:30:55 user nova-compute[72418]: DEBUG nova.compute.manager [req-a9802357-3362-4d4a-ae13-b93da98db9ee req-e5678f67-e68e-4a95-96bb-e75870f53c7f service nova] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] No waiting events found dispatching network-vif-plugged-1ebdd43e-c423-4e1c-9e50-1419f2857ae4 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:30:55 user nova-compute[72418]: WARNING nova.compute.manager [req-a9802357-3362-4d4a-ae13-b93da98db9ee req-e5678f67-e68e-4a95-96bb-e75870f53c7f service nova] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Received unexpected event network-vif-plugged-1ebdd43e-c423-4e1c-9e50-1419f2857ae4 for instance with vm_state deleted and task_state None.
Aug 09 18:30:55 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:55 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:55 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:55 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:56 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:57 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:30:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e582b61c-d998-4a3f-8392-a7f0e94a4dec/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e582b61c-d998-4a3f-8392-a7f0e94a4dec/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e582b61c-d998-4a3f-8392-a7f0e94a4dec/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:57 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:30:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e582b61c-d998-4a3f-8392-a7f0e94a4dec/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:57 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:30:58 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:30:58 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:30:58 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Hypervisor/Node resource view: name=user free_ram=7382MB free_disk=25.64327621459961GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72418) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 18:30:58 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:30:58 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:30:58 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 6af7918a-ce90-45ab-93d8-684e1489e891 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:30:58 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 8fe41968-a219-4a5a-afdb-32eb2082bb40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:30:58 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 01c46b33-6788-44a5-a43c-88ee4acc4d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:30:58 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance e019064c-955e-4f80-9b00-6b32b3835d58 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:30:58 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance e07beace-59d8-4c02-844b-1db1a6e81198 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:30:58 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance c46f2599-93f8-412e-9918-7ace8a9f19dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:30:58 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 046617cf-13e5-44cf-9981-c1ae4ffd3851 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:30:58 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 03ad5bab-ab32-47fc-b7e8-b32282b9c20d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:30:58 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 1c53f871-2be9-4119-b5c0-d5081e2f4388 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:30:58 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance e582b61c-d998-4a3f-8392-a7f0e94a4dec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:30:58 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 18:30:58 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 18:30:58 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:30:58 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:30:58 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Creating instance directory {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 18:30:58 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Creating image(s)
Aug 09 18:30:58 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Acquiring lock "/opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:30:58 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "/opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:30:58 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "/opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:30:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Compute_service record updated for user:user {{(pid=72418) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.541s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.132s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Acquiring lock "458773cfa7230b717e41c60277832e9f83806d71" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.133s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk 1073741824 {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk 1073741824" returned: 0 in 0.061s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.135s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk. size=1073741824 {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Cannot resize image /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk to a smaller size. {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Created local disks {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Ensure instance console log exists: /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/console.log {{(pid=72418) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Start _get_guest_xml network_info=[{"id": "6c9676d3-6e5d-4a95-a24f-0df4a15e993d", "address": "fa:16:3e:80:17:d9", "network": {"id": "bd36ef30-e57d-473f-97bc-c51b5db08aa7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-425133239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78b6e36a5b61456092ce7de9212c3c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9676d3-6e", "ovs_interfaceid": "6c9676d3-6e5d-4a95-a24f-0df4a15e993d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'attachment_id': 'f8ce1d16-1332-4543-927b-9497e0aebf1c', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lJvqKipO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c46f2599-93f8-412e-9918-7ace8a9f19dd', 'attached_at': '', 'detached_at': '', 'volume_id': 'bdd54f84-accb-4284-bc01-7fe689728ee2', 'serial': 'bdd54f84-accb-4284-bc01-7fe689728ee2'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'volume_type': None} {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 18:30:59 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 09 18:30:59 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 09 18:30:59 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] CPU controller missing on host. {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] CPU controller found on host. {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72418) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T18:17:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Flavor limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Image limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Flavor pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Image pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Got 1 possible topologies {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG nova.objects.instance [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lazy-loading 'vcpu_model' on Instance uuid c46f2599-93f8-412e-9918-7ace8a9f19dd {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Calling os-brick to attach iSCSI Volume {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lJvqKipO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:30:59 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 18:30:59 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:30:59 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 18:30:59 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:30:59 user nova-compute[72418]: INFO os_brick.initiator.connectors.iscsi [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 18:30:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 -p 172.16.0.220:3260 {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[98856a48-c8c7-41be-a636-1a1a23d4cdae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 18:30:59 user nova-compute[72418]:  {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 -p 172.16.0.220:3260 --interface default --op new {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[56310b1f-3421-4292-97f4-70da075e4c88]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2] added\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2] added
Aug 09 18:30:59 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f135f3c-1f0c-413d-8f3c-1a2d6830574c]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[3234f3b1-2f76-4393-bc5f-edfd7187f0b9]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lJvqKipO {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lJvqKipO" returned: 0 in 0.017s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[374d05ec-9eec-4285-9e5a-d10530fff355]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lJvqKipO'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3db90cc-7007-4e05-a3a9-e318fe689465]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35587cc-ac89-4d53-a309-2602cb4527ac]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:30:59 user nova-compute[72418]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f (non-flash)
Aug 09 18:30:59 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:30:59 user nova-compute[72418]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f (non-flash)
Aug 09 18:30:59 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 -p 172.16.0.220:3260 --login {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f000c15-ba32-4aaf-beb5-e48a763145ae]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2, portal: 172.16.0.220,3260]
Aug 09 18:30:59 user nova-compute[72418]: Login to [iface: default, target: iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2, portal: 172.16.0.220,3260] successful.
Aug 09 18:30:59 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6bc0d45-07d7-4862-80ab-403d250738f4]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41bf24a-e1f8-4101-8291-bbe86dbf4830]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:30:59 user nova-compute[72418]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f (non-flash)
Aug 09 18:30:59 user nova-compute[72418]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 (non-flash)
Aug 09 18:30:59 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:30:59 user nova-compute[72418]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f (non-flash)
Aug 09 18:30:59 user nova-compute[72418]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 (non-flash)
Aug 09 18:30:59 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Connected to 172.16.0.220:3260 {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] HCTL ('35', '-', '-', 0) found on session 22 with lun 0 {{(pid=72418) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72418) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 18:30:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:31:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:31:00 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[9abeb36e-76a5-4ce9-a952-188c7f8ffa27]: (4, ('- - 0', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:31:00 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Searching for a device in session 22 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72418) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 18:31:00 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lJvqKipO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 18:31:01 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:31:01 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '26432393764663163', 'path': '/dev/sdd'} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:31:01 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432393764663163', 'path': '/dev/sdd'} {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 18:31:01 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:31:01 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Starting heal instance info cache {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 18:31:01 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T18:26:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1080698985',display_name='tempest-ServerActionsTestOtherA-server-837028949',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1080698985',id=17,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZ8H8MvJhas/vPLXexc9KvUsV16Uhsl6uYTaDGrZC9aE3rBb3x7zoV+NqPR5zKzOIkCqtgn8ZVvU3tdtAtEAYrB/yDbEIXvY0hEVuVM8ww17BzMc60Vtn0IN61LmfWZ8Q==',key_name='tempest-keypair-882054128',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:26:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='78b6e36a5b61456092ce7de9212c3c82',ramdisk_id='',reservation_id='r-g13uz4wm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1039384122',owner_user_name='tempest-ServerActionsTestOtherA-1039384122-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:30:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='edc9ed6980274b978caf0666a9b31379',uuid=c46f2599-93f8-412e-9918-7ace8a9f19dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6c9676d3-6e5d-4a95-a24f-0df4a15e993d", "address": "fa:16:3e:80:17:d9", "network": {"id": "bd36ef30-e57d-473f-97bc-c51b5db08aa7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-425133239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78b6e36a5b61456092ce7de9212c3c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9676d3-6e", "ovs_interfaceid": "6c9676d3-6e5d-4a95-a24f-0df4a15e993d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:31:01 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Converting VIF {"id": "6c9676d3-6e5d-4a95-a24f-0df4a15e993d", "address": "fa:16:3e:80:17:d9", "network": {"id": "bd36ef30-e57d-473f-97bc-c51b5db08aa7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-425133239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78b6e36a5b61456092ce7de9212c3c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9676d3-6e", "ovs_interfaceid": "6c9676d3-6e5d-4a95-a24f-0df4a15e993d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:31:01 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:17:d9,bridge_name='br-int',has_traffic_filtering=True,id=6c9676d3-6e5d-4a95-a24f-0df4a15e993d,network=Network(bd36ef30-e57d-473f-97bc-c51b5db08aa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9676d3-6e') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:31:01 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] End _get_guest_xml xml=<domain type="kvm">
Aug 09 18:31:01 user nova-compute[72418]:   <uuid>c46f2599-93f8-412e-9918-7ace8a9f19dd</uuid>
Aug 09 18:31:01 user nova-compute[72418]:   <name>instance-00000011</name>
Aug 09 18:31:01 user nova-compute[72418]:   <memory>524288</memory>
Aug 09 18:31:01 user nova-compute[72418]:   <vcpu>1</vcpu>
Aug 09 18:31:01 user nova-compute[72418]:   <metadata>
Aug 09 18:31:01 user nova-compute[72418]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:31:01 user nova-compute[72418]:       <nova:package version="0.0.0"/>
Aug 09 18:31:01 user nova-compute[72418]:       <nova:name>tempest-ServerActionsTestOtherA-server-837028949</nova:name>
Aug 09 18:31:01 user nova-compute[72418]:       <nova:creationTime>2023-08-09 18:30:59</nova:creationTime>
Aug 09 18:31:01 user nova-compute[72418]:       <nova:flavor name="m1.tiny">
Aug 09 18:31:01 user nova-compute[72418]:         <nova:memory>512</nova:memory>
Aug 09 18:31:01 user nova-compute[72418]:         <nova:disk>1</nova:disk>
Aug 09 18:31:01 user nova-compute[72418]:         <nova:swap>0</nova:swap>
Aug 09 18:31:01 user nova-compute[72418]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:31:01 user nova-compute[72418]:         <nova:vcpus>1</nova:vcpus>
Aug 09 18:31:01 user nova-compute[72418]:       </nova:flavor>
Aug 09 18:31:01 user nova-compute[72418]:       <nova:owner>
Aug 09 18:31:01 user nova-compute[72418]:         <nova:user uuid="edc9ed6980274b978caf0666a9b31379">tempest-ServerActionsTestOtherA-1039384122-project-member</nova:user>
Aug 09 18:31:01 user nova-compute[72418]:         <nova:project uuid="78b6e36a5b61456092ce7de9212c3c82">tempest-ServerActionsTestOtherA-1039384122</nova:project>
Aug 09 18:31:01 user nova-compute[72418]:       </nova:owner>
Aug 09 18:31:01 user nova-compute[72418]:       <nova:root type="image" uuid="8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e"/>
Aug 09 18:31:01 user nova-compute[72418]:       <nova:ports>
Aug 09 18:31:01 user nova-compute[72418]:         <nova:port uuid="6c9676d3-6e5d-4a95-a24f-0df4a15e993d">
Aug 09 18:31:01 user nova-compute[72418]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 09 18:31:01 user nova-compute[72418]:         </nova:port>
Aug 09 18:31:01 user nova-compute[72418]:       </nova:ports>
Aug 09 18:31:01 user nova-compute[72418]:     </nova:instance>
Aug 09 18:31:01 user nova-compute[72418]:   </metadata>
Aug 09 18:31:01 user nova-compute[72418]:   <sysinfo type="smbios">
Aug 09 18:31:01 user nova-compute[72418]:     <system>
Aug 09 18:31:01 user nova-compute[72418]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 18:31:01 user nova-compute[72418]:       <entry name="product">OpenStack Nova</entry>
Aug 09 18:31:01 user nova-compute[72418]:       <entry name="version">0.0.0</entry>
Aug 09 18:31:01 user nova-compute[72418]:       <entry name="serial">c46f2599-93f8-412e-9918-7ace8a9f19dd</entry>
Aug 09 18:31:01 user nova-compute[72418]:       <entry name="uuid">c46f2599-93f8-412e-9918-7ace8a9f19dd</entry>
Aug 09 18:31:01 user nova-compute[72418]:       <entry name="family">Virtual Machine</entry>
Aug 09 18:31:01 user nova-compute[72418]:     </system>
Aug 09 18:31:01 user nova-compute[72418]:   </sysinfo>
Aug 09 18:31:01 user nova-compute[72418]:   <os>
Aug 09 18:31:01 user nova-compute[72418]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 18:31:01 user nova-compute[72418]:     <boot dev="hd"/>
Aug 09 18:31:01 user nova-compute[72418]:     <smbios mode="sysinfo"/>
Aug 09 18:31:01 user nova-compute[72418]:   </os>
Aug 09 18:31:01 user nova-compute[72418]:   <features>
Aug 09 18:31:01 user nova-compute[72418]:     <acpi/>
Aug 09 18:31:01 user nova-compute[72418]:     <apic/>
Aug 09 18:31:01 user nova-compute[72418]:     <vmcoreinfo/>
Aug 09 18:31:01 user nova-compute[72418]:   </features>
Aug 09 18:31:01 user nova-compute[72418]:   <clock offset="utc">
Aug 09 18:31:01 user nova-compute[72418]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 18:31:01 user nova-compute[72418]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 18:31:01 user nova-compute[72418]:     <timer name="hpet" present="no"/>
Aug 09 18:31:01 user nova-compute[72418]:   </clock>
Aug 09 18:31:01 user nova-compute[72418]:   <cpu mode="custom" match="exact">
Aug 09 18:31:01 user nova-compute[72418]:     <model>Nehalem</model>
Aug 09 18:31:01 user nova-compute[72418]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 18:31:01 user nova-compute[72418]:   </cpu>
Aug 09 18:31:01 user nova-compute[72418]:   <devices>
Aug 09 18:31:01 user nova-compute[72418]:     <disk type="file" device="disk">
Aug 09 18:31:01 user nova-compute[72418]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 18:31:01 user nova-compute[72418]:       <source file="/opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk"/>
Aug 09 18:31:01 user nova-compute[72418]:       <target dev="vda" bus="virtio"/>
Aug 09 18:31:01 user nova-compute[72418]:     </disk>
Aug 09 18:31:01 user nova-compute[72418]:     <disk type="block" device="disk">
Aug 09 18:31:01 user nova-compute[72418]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:31:01 user nova-compute[72418]:       <source dev="/dev/sdd"/>
Aug 09 18:31:01 user nova-compute[72418]:       <target dev="vdb" bus="virtio"/>
Aug 09 18:31:01 user nova-compute[72418]:       <serial>bdd54f84-accb-4284-bc01-7fe689728ee2</serial>
Aug 09 18:31:01 user nova-compute[72418]:     </disk>
Aug 09 18:31:01 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:31:01 user nova-compute[72418]:       <mac address="fa:16:3e:80:17:d9"/>
Aug 09 18:31:01 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:31:01 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:31:01 user nova-compute[72418]:       <target dev="tap6c9676d3-6e"/>
Aug 09 18:31:01 user nova-compute[72418]:     </interface>
Aug 09 18:31:01 user nova-compute[72418]:     <serial type="pty">
Aug 09 18:31:01 user nova-compute[72418]:       <log file="/opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/console.log" append="off"/>
Aug 09 18:31:01 user nova-compute[72418]:     </serial>
Aug 09 18:31:01 user nova-compute[72418]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 18:31:01 user nova-compute[72418]:     <video>
Aug 09 18:31:01 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:31:01 user nova-compute[72418]:     </video>
Aug 09 18:31:01 user nova-compute[72418]:     <rng model="virtio">
Aug 09 18:31:01 user nova-compute[72418]:       <backend model="random">/dev/urandom</backend>
Aug 09 18:31:01 user nova-compute[72418]:     </rng>
Aug 09 18:31:01 user nova-compute[72418]:     <controller type="usb" index="0" model="none"/>
Aug 09 18:31:01 user nova-compute[72418]:     <memballoon model="virtio">
Aug 09 18:31:01 user nova-compute[72418]:       <stats period="10"/>
Aug 09 18:31:01 user nova-compute[72418]:     </memballoon>
Aug 09 18:31:01 user nova-compute[72418]:   </devices>
Aug 09 18:31:01 user nova-compute[72418]: </domain>
Aug 09 18:31:01 user nova-compute[72418]:  {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 18:31:01 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T18:26:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1080698985',display_name='tempest-ServerActionsTestOtherA-server-837028949',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1080698985',id=17,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZ8H8MvJhas/vPLXexc9KvUsV16Uhsl6uYTaDGrZC9aE3rBb3x7zoV+NqPR5zKzOIkCqtgn8ZVvU3tdtAtEAYrB/yDbEIXvY0hEVuVM8ww17BzMc60Vtn0IN61LmfWZ8Q==',key_name='tempest-keypair-882054128',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:26:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='78b6e36a5b61456092ce7de9212c3c82',ramdisk_id='',reservation_id='r-g13uz4wm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1039384122',owner_user_name='tempest-ServerActionsTestOtherA-1039384122-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:30:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='edc9ed6980274b978caf0666a9b31379',uuid=c46f2599-93f8-412e-9918-7ace8a9f19dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6c9676d3-6e5d-4a95-a24f-0df4a15e993d", "address": "fa:16:3e:80:17:d9", "network": {"id": "bd36ef30-e57d-473f-97bc-c51b5db08aa7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-425133239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78b6e36a5b61456092ce7de9212c3c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9676d3-6e", "ovs_interfaceid": "6c9676d3-6e5d-4a95-a24f-0df4a15e993d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:31:01 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Converting VIF {"id": "6c9676d3-6e5d-4a95-a24f-0df4a15e993d", "address": "fa:16:3e:80:17:d9", "network": {"id": "bd36ef30-e57d-473f-97bc-c51b5db08aa7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-425133239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78b6e36a5b61456092ce7de9212c3c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9676d3-6e", "ovs_interfaceid": "6c9676d3-6e5d-4a95-a24f-0df4a15e993d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:31:01 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:17:d9,bridge_name='br-int',has_traffic_filtering=True,id=6c9676d3-6e5d-4a95-a24f-0df4a15e993d,network=Network(bd36ef30-e57d-473f-97bc-c51b5db08aa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9676d3-6e') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:31:01 user nova-compute[72418]: DEBUG os_vif [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:17:d9,bridge_name='br-int',has_traffic_filtering=True,id=6c9676d3-6e5d-4a95-a24f-0df4a15e993d,network=Network(bd36ef30-e57d-473f-97bc-c51b5db08aa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9676d3-6e') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:31:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:31:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:31:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:31:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:31:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6c9676d3-6e, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:31:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6c9676d3-6e, col_values=(('external_ids', {'iface-id': '6c9676d3-6e5d-4a95-a24f-0df4a15e993d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:17:d9', 'vm-uuid': 'c46f2599-93f8-412e-9918-7ace8a9f19dd'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:31:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:31:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:31:01 user nova-compute[72418]: INFO os_vif [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:17:d9,bridge_name='br-int',has_traffic_filtering=True,id=6c9676d3-6e5d-4a95-a24f-0df4a15e993d,network=Network(bd36ef30-e57d-473f-97bc-c51b5db08aa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9676d3-6e')
Aug 09 18:31:01 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:31:01 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:31:01 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] No VIF found with MAC fa:16:3e:80:17:d9, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:31:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "refresh_cache-01c46b33-6788-44a5-a43c-88ee4acc4d39" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:31:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquired lock "refresh_cache-01c46b33-6788-44a5-a43c-88ee4acc4d39" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:31:01 user nova-compute[72418]: DEBUG nova.network.neutron [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Forcefully refreshing network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 18:31:01 user nova-compute[72418]: DEBUG nova.network.neutron [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Updating instance_info_cache with network_info: [{"id": "1487cbc0-54ec-4134-9e08-88f02ff870f5", "address": "fa:16:3e:b3:6b:21", "network": {"id": "15a49d9b-3c0d-449b-9473-29f219960e2c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c68622cd79472ba6ad14a6876aeaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1487cbc0-54", "ovs_interfaceid": "1487cbc0-54ec-4134-9e08-88f02ff870f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:31:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Releasing lock "refresh_cache-01c46b33-6788-44a5-a43c-88ee4acc4d39" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:31:01 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Updated the network info_cache for instance {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 18:31:02 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:31:02 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:31:02 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:31:02 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:31:02 user nova-compute[72418]: DEBUG nova.compute.manager [req-302319db-a7da-43a9-b14a-6c18f57fc01d req-8096bce0-cba9-423d-a9e1-d80088ff7188 service nova] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Received event network-vif-plugged-6c9676d3-6e5d-4a95-a24f-0df4a15e993d {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:31:02 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-302319db-a7da-43a9-b14a-6c18f57fc01d req-8096bce0-cba9-423d-a9e1-d80088ff7188 service nova] Acquiring lock "c46f2599-93f8-412e-9918-7ace8a9f19dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:31:02 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-302319db-a7da-43a9-b14a-6c18f57fc01d req-8096bce0-cba9-423d-a9e1-d80088ff7188 service nova] Lock "c46f2599-93f8-412e-9918-7ace8a9f19dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:31:02 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-302319db-a7da-43a9-b14a-6c18f57fc01d req-8096bce0-cba9-423d-a9e1-d80088ff7188 service nova] Lock "c46f2599-93f8-412e-9918-7ace8a9f19dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:31:02 user nova-compute[72418]: DEBUG nova.compute.manager [req-302319db-a7da-43a9-b14a-6c18f57fc01d req-8096bce0-cba9-423d-a9e1-d80088ff7188 service nova] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] No waiting events found dispatching network-vif-plugged-6c9676d3-6e5d-4a95-a24f-0df4a15e993d {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:31:02 user nova-compute[72418]: WARNING nova.compute.manager [req-302319db-a7da-43a9-b14a-6c18f57fc01d req-8096bce0-cba9-423d-a9e1-d80088ff7188 service nova] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Received unexpected event network-vif-plugged-6c9676d3-6e5d-4a95-a24f-0df4a15e993d for instance with vm_state active and task_state rebuild_spawning.
Aug 09 18:31:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:31:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:31:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:31:04 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605864.7836137, c46f2599-93f8-412e-9918-7ace8a9f19dd => Resumed> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:31:04 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] VM Resumed (Lifecycle Event)
Aug 09 18:31:04 user nova-compute[72418]: DEBUG nova.compute.manager [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Instance event wait completed in 0 seconds for  {{(pid=72418) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 18:31:04 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Guest created on hypervisor {{(pid=72418) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 18:31:04 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Instance spawned successfully.
Aug 09 18:31:04 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 18:31:04 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:31:04 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:31:04 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Found default for hw_cdrom_bus of ide {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:31:04 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Found default for hw_disk_bus of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:31:04 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Found default for hw_input_bus of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:31:04 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Found default for hw_pointer_model of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:31:04 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Found default for hw_video_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:31:04 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Found default for hw_vif_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:31:04 user nova-compute[72418]: DEBUG nova.compute.manager [req-e4407dc6-8086-487d-a6ef-f8764d0b6f07 req-5de265b3-6ee8-4f0c-b493-435bcaee268b service nova] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Received event network-vif-plugged-6c9676d3-6e5d-4a95-a24f-0df4a15e993d {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:31:04 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-e4407dc6-8086-487d-a6ef-f8764d0b6f07 req-5de265b3-6ee8-4f0c-b493-435bcaee268b service nova] Acquiring lock "c46f2599-93f8-412e-9918-7ace8a9f19dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:31:04 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-e4407dc6-8086-487d-a6ef-f8764d0b6f07 req-5de265b3-6ee8-4f0c-b493-435bcaee268b service nova] Lock "c46f2599-93f8-412e-9918-7ace8a9f19dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:31:04 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-e4407dc6-8086-487d-a6ef-f8764d0b6f07 req-5de265b3-6ee8-4f0c-b493-435bcaee268b service nova] Lock "c46f2599-93f8-412e-9918-7ace8a9f19dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:31:04 user nova-compute[72418]: DEBUG nova.compute.manager [req-e4407dc6-8086-487d-a6ef-f8764d0b6f07 req-5de265b3-6ee8-4f0c-b493-435bcaee268b service nova] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] No waiting events found dispatching network-vif-plugged-6c9676d3-6e5d-4a95-a24f-0df4a15e993d {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:31:04 user nova-compute[72418]: WARNING nova.compute.manager [req-e4407dc6-8086-487d-a6ef-f8764d0b6f07 req-5de265b3-6ee8-4f0c-b493-435bcaee268b service nova] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Received unexpected event network-vif-plugged-6c9676d3-6e5d-4a95-a24f-0df4a15e993d for instance with vm_state active and task_state rebuild_spawning.
Aug 09 18:31:04 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 09 18:31:04 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605864.7876399, c46f2599-93f8-412e-9918-7ace8a9f19dd => Started> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:31:04 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] VM Started (Lifecycle Event)
Aug 09 18:31:04 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:31:04 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:31:04 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 09 18:31:04 user nova-compute[72418]: DEBUG nova.compute.manager [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:31:04 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:31:04 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:31:04 user nova-compute[72418]: DEBUG nova.objects.instance [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72418) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 09 18:31:05 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-f10bbd7c-30b3-4f26-8744-31038ff625c6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.071s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:31:06 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:31:06 user nova-compute[72418]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691605851.9353251, 479ea4c3-ad7f-4da0-a901-defe46d96065 => Stopped> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:31:06 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] VM Stopped (Lifecycle Event)
Aug 09 18:31:06 user nova-compute[72418]: DEBUG nova.compute.manager [None req-05d64b92-0bcb-44d6-9368-a48145bc3e11 None None] [instance: 479ea4c3-ad7f-4da0-a901-defe46d96065] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:31:07 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:31:10 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-7787f315-1b9e-4754-a7fe-52763ad1f5b7 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Acquiring lock "e07beace-59d8-4c02-844b-1db1a6e81198" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:31:10 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-7787f315-1b9e-4754-a7fe-52763ad1f5b7 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "e07beace-59d8-4c02-844b-1db1a6e81198" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:31:11 user nova-compute[72418]: INFO nova.compute.manager [None req-7787f315-1b9e-4754-a7fe-52763ad1f5b7 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Detaching volume 3fca4401-afce-4779-b7f0-3c2a0a64757f
Aug 09 18:31:11 user nova-compute[72418]: INFO nova.virt.block_device [None req-7787f315-1b9e-4754-a7fe-52763ad1f5b7 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Attempting to driver detach volume 3fca4401-afce-4779-b7f0-3c2a0a64757f from mountpoint /dev/vdb
Aug 09 18:31:11 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:31:11 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-7787f315-1b9e-4754-a7fe-52763ad1f5b7 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Attempting to detach device vdb from instance e07beace-59d8-4c02-844b-1db1a6e81198 from the persistent domain config. {{(pid=72418) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 18:31:11 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-7787f315-1b9e-4754-a7fe-52763ad1f5b7 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 18:31:11 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:31:11 user nova-compute[72418]:   <source dev="/dev/sdc"/>
Aug 09 18:31:11 user nova-compute[72418]:   <target dev="vdb" bus="virtio"/>
Aug 09 18:31:11 user nova-compute[72418]:   <serial>3fca4401-afce-4779-b7f0-3c2a0a64757f</serial>
Aug 09 18:31:11 user nova-compute[72418]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 18:31:11 user nova-compute[72418]: </disk>
Aug 09 18:31:11 user nova-compute[72418]:  {{(pid=72418) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 18:31:11 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-7787f315-1b9e-4754-a7fe-52763ad1f5b7 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Successfully detached device vdb from instance e07beace-59d8-4c02-844b-1db1a6e81198 from the persistent domain config.
Aug 09 18:31:11 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-7787f315-1b9e-4754-a7fe-52763ad1f5b7 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e07beace-59d8-4c02-844b-1db1a6e81198 from the live domain config. {{(pid=72418) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 18:31:11 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-7787f315-1b9e-4754-a7fe-52763ad1f5b7 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 18:31:11 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:31:11 user nova-compute[72418]:   <source dev="/dev/sdc"/>
Aug 09 18:31:11 user nova-compute[72418]:   <target dev="vdb" bus="virtio"/>
Aug 09 18:31:11 user nova-compute[72418]:   <serial>3fca4401-afce-4779-b7f0-3c2a0a64757f</serial>
Aug 09 18:31:11 user nova-compute[72418]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 18:31:11 user nova-compute[72418]: </disk>
Aug 09 18:31:11 user nova-compute[72418]:  {{(pid=72418) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 18:31:11 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Received event <DeviceRemovedEvent: 1691605871.5833876, e07beace-59d8-4c02-844b-1db1a6e81198 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72418) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 18:31:11 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-7787f315-1b9e-4754-a7fe-52763ad1f5b7 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e07beace-59d8-4c02-844b-1db1a6e81198 {{(pid=72418) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 18:31:11 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-7787f315-1b9e-4754-a7fe-52763ad1f5b7 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Successfully detached device vdb from instance e07beace-59d8-4c02-844b-1db1a6e81198 from the live domain config.
Aug 09 18:31:11 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7787f315-1b9e-4754-a7fe-52763ad1f5b7 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] calling os-brick to detach iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 18:31:11 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-7787f315-1b9e-4754-a7fe-52763ad1f5b7 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, {'target_iqns': ['iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'idOFSGrK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:31:11 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-7787f315-1b9e-4754-a7fe-52763ad1f5b7 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:31:11 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-7787f315-1b9e-4754-a7fe-52763ad1f5b7 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:31:11 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-7787f315-1b9e-4754-a7fe-52763ad1f5b7 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:31:11 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-7787f315-1b9e-4754-a7fe-52763ad1f5b7 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f', 0)] {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 18:31:11 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:31:11 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:31:11 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[90648039-6c3e-4773-83b6-08bca2417c9d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:31:11 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:31:11 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:31:11 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5b6696-d29f-4223-9634-b90735f0a038]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:31:11 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-7787f315-1b9e-4754-a7fe-52763ad1f5b7 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:31:11 user nova-compute[72418]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f (non-flash)
Aug 09 18:31:11 user nova-compute[72418]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 (non-flash)
Aug 09 18:31:11 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:31:11 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-7787f315-1b9e-4754-a7fe-52763ad1f5b7 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:31:11 user nova-compute[72418]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f (non-flash)
Aug 09 18:31:11 user nova-compute[72418]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 (non-flash)
Aug 09 18:31:11 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:31:11 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-7787f315-1b9e-4754-a7fe-52763ad1f5b7 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f42d463a320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f'): ({'sdc'}, set())}) {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 18:31:11 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-7787f315-1b9e-4754-a7fe-52763ad1f5b7 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Removing single pathed devices sdc {{(pid=72418) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 18:31:11 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:31:11 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:31:11 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f2d43f-d4a0-42a2-ae17-b652620eda31]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:31:11 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:31:11 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:31:11 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc50669-b9e0-48cf-b7cd-017416d7c3b6]: (4, ('ok\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:31:11 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-7787f315-1b9e-4754-a7fe-52763ad1f5b7 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Flushing IO for device /dev/sdc {{(pid=72418) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 18:31:11 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:31:11 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:31:11 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57b7398-c60b-4648-a062-035a79a8a22b]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:31:11 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-7787f315-1b9e-4754-a7fe-52763ad1f5b7 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72418) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 18:31:11 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:31:11 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:31:11 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb16a096-1e26-4dad-8076-03c45fada56c]: (4, ('1', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:31:11 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-7787f315-1b9e-4754-a7fe-52763ad1f5b7 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 18:31:11 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-7787f315-1b9e-4754-a7fe-52763ad1f5b7 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] SCSI volumes sdc have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 18:31:11 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-7787f315-1b9e-4754-a7fe-52763ad1f5b7 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f')] {{(pid=72418) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 18:31:11 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:31:11 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:31:11 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0bae1c1-b9f5-44ad-918b-7e2374c8ee67]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:31:11 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-7787f315-1b9e-4754-a7fe-52763ad1f5b7 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:31:11 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f -p 172.16.0.220:3260 --logout {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:31:11 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:31:11 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dac53a7-6ccd-4ccf-b98b-60c96909595f]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:31:11 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-7787f315-1b9e-4754-a7fe-52763ad1f5b7 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f, portal: 172.16.0.220,3260]
Aug 09 18:31:11 user nova-compute[72418]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f, portal: 172.16.0.220,3260] successful.
Aug 09 18:31:11 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:31:11 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f -p 172.16.0.220:3260 --op delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:31:11 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fca4401-afce-4779-b7f0-3c2a0a64757f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:31:11 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2cfb83-55ed-4bef-ad94-83dd886707e6]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:31:11 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-7787f315-1b9e-4754-a7fe-52763ad1f5b7 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:31:11 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-7787f315-1b9e-4754-a7fe-52763ad1f5b7 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:31:11 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-7787f315-1b9e-4754-a7fe-52763ad1f5b7 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] <== disconnect_volume: return (291ms) None {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:31:11 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7787f315-1b9e-4754-a7fe-52763ad1f5b7 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Disconnected iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 18:31:12 user nova-compute[72418]: DEBUG nova.objects.instance [None req-7787f315-1b9e-4754-a7fe-52763ad1f5b7 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lazy-loading 'flavor' on Instance uuid e07beace-59d8-4c02-844b-1db1a6e81198 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:31:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-7787f315-1b9e-4754-a7fe-52763ad1f5b7 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "e07beace-59d8-4c02-844b-1db1a6e81198" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.751s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:31:12 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:31:13 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-6079f640-fb27-42a9-b159-8fc1c5164110 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Acquiring lock "e07beace-59d8-4c02-844b-1db1a6e81198" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:31:13 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-6079f640-fb27-42a9-b159-8fc1c5164110 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "e07beace-59d8-4c02-844b-1db1a6e81198" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:31:13 user nova-compute[72418]: DEBUG nova.compute.manager [None req-6079f640-fb27-42a9-b159-8fc1c5164110 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:31:13 user nova-compute[72418]: DEBUG nova.compute.manager [None req-6079f640-fb27-42a9-b159-8fc1c5164110 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72418) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 09 18:31:13 user nova-compute[72418]: DEBUG nova.objects.instance [None req-6079f640-fb27-42a9-b159-8fc1c5164110 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lazy-loading 'flavor' on Instance uuid e07beace-59d8-4c02-844b-1db1a6e81198 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:31:13 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:31:13 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:31:13 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:31:13 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:31:13 user nova-compute[72418]: DEBUG nova.compute.manager [req-1c0c5726-da38-43a0-af35-338e320b446b req-afe93e7b-3151-4068-8fde-c5b70503552c service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Received event network-vif-unplugged-301d9f8c-022d-4c02-90dd-374ead3daa23 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:31:13 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-1c0c5726-da38-43a0-af35-338e320b446b req-afe93e7b-3151-4068-8fde-c5b70503552c service nova] Acquiring lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:31:13 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-1c0c5726-da38-43a0-af35-338e320b446b req-afe93e7b-3151-4068-8fde-c5b70503552c service nova] Lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:31:13 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-1c0c5726-da38-43a0-af35-338e320b446b req-afe93e7b-3151-4068-8fde-c5b70503552c service nova] Lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.006s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:31:13 user nova-compute[72418]: DEBUG nova.compute.manager [req-1c0c5726-da38-43a0-af35-338e320b446b req-afe93e7b-3151-4068-8fde-c5b70503552c service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] No waiting events found dispatching network-vif-unplugged-301d9f8c-022d-4c02-90dd-374ead3daa23 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:31:13 user nova-compute[72418]: WARNING nova.compute.manager [req-1c0c5726-da38-43a0-af35-338e320b446b req-afe93e7b-3151-4068-8fde-c5b70503552c service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Received unexpected event network-vif-unplugged-301d9f8c-022d-4c02-90dd-374ead3daa23 for instance with vm_state active and task_state powering-off.
Aug 09 18:31:14 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:31:14 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:31:14 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Instance destroyed successfully.
Aug 09 18:31:14 user nova-compute[72418]: DEBUG nova.compute.manager [None req-6079f640-fb27-42a9-b159-8fc1c5164110 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:31:14 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:31:14 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-6079f640-fb27-42a9-b159-8fc1c5164110 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "e07beace-59d8-4c02-844b-1db1a6e81198" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.018s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:31:14 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:31:14 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:31:14 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:31:14 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:31:14 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:31:14 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:31:15 user nova-compute[72418]: DEBUG nova.compute.manager [req-fcf40074-cdc4-47b9-8fe1-bceaa9feb868 req-560c135a-2e46-4810-8710-5a79b459eb2f service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Received event network-vif-plugged-301d9f8c-022d-4c02-90dd-374ead3daa23 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:31:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-fcf40074-cdc4-47b9-8fe1-bceaa9feb868 req-560c135a-2e46-4810-8710-5a79b459eb2f service nova] Acquiring lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:31:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-fcf40074-cdc4-47b9-8fe1-bceaa9feb868 req-560c135a-2e46-4810-8710-5a79b459eb2f service nova] Lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:31:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-fcf40074-cdc4-47b9-8fe1-bceaa9feb868 req-560c135a-2e46-4810-8710-5a79b459eb2f service nova] Lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:31:15 user nova-compute[72418]: DEBUG nova.compute.manager [req-fcf40074-cdc4-47b9-8fe1-bceaa9feb868 req-560c135a-2e46-4810-8710-5a79b459eb2f service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] No waiting events found dispatching network-vif-plugged-301d9f8c-022d-4c02-90dd-374ead3daa23 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:31:15 user nova-compute[72418]: WARNING nova.compute.manager [req-fcf40074-cdc4-47b9-8fe1-bceaa9feb868 req-560c135a-2e46-4810-8710-5a79b459eb2f service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Received unexpected event network-vif-plugged-301d9f8c-022d-4c02-90dd-374ead3daa23 for instance with vm_state stopped and task_state None.
Aug 09 18:31:15 user nova-compute[72418]: DEBUG nova.compute.manager [req-fcf40074-cdc4-47b9-8fe1-bceaa9feb868 req-560c135a-2e46-4810-8710-5a79b459eb2f service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Received event network-vif-plugged-301d9f8c-022d-4c02-90dd-374ead3daa23 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:31:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-fcf40074-cdc4-47b9-8fe1-bceaa9feb868 req-560c135a-2e46-4810-8710-5a79b459eb2f service nova] Acquiring lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:31:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-fcf40074-cdc4-47b9-8fe1-bceaa9feb868 req-560c135a-2e46-4810-8710-5a79b459eb2f service nova] Lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:31:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-fcf40074-cdc4-47b9-8fe1-bceaa9feb868 req-560c135a-2e46-4810-8710-5a79b459eb2f service nova] Lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:31:15 user nova-compute[72418]: DEBUG nova.compute.manager [req-fcf40074-cdc4-47b9-8fe1-bceaa9feb868 req-560c135a-2e46-4810-8710-5a79b459eb2f service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] No waiting events found dispatching network-vif-plugged-301d9f8c-022d-4c02-90dd-374ead3daa23 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:31:15 user nova-compute[72418]: WARNING nova.compute.manager [req-fcf40074-cdc4-47b9-8fe1-bceaa9feb868 req-560c135a-2e46-4810-8710-5a79b459eb2f service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Received unexpected event network-vif-plugged-301d9f8c-022d-4c02-90dd-374ead3daa23 for instance with vm_state stopped and task_state None.
Aug 09 18:31:15 user nova-compute[72418]: DEBUG nova.compute.manager [req-fcf40074-cdc4-47b9-8fe1-bceaa9feb868 req-560c135a-2e46-4810-8710-5a79b459eb2f service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Received event network-vif-plugged-301d9f8c-022d-4c02-90dd-374ead3daa23 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:31:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-fcf40074-cdc4-47b9-8fe1-bceaa9feb868 req-560c135a-2e46-4810-8710-5a79b459eb2f service nova] Acquiring lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:31:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-fcf40074-cdc4-47b9-8fe1-bceaa9feb868 req-560c135a-2e46-4810-8710-5a79b459eb2f service nova] Lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:31:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-fcf40074-cdc4-47b9-8fe1-bceaa9feb868 req-560c135a-2e46-4810-8710-5a79b459eb2f service nova] Lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:31:15 user nova-compute[72418]: DEBUG nova.compute.manager [req-fcf40074-cdc4-47b9-8fe1-bceaa9feb868 req-560c135a-2e46-4810-8710-5a79b459eb2f service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] No waiting events found dispatching network-vif-plugged-301d9f8c-022d-4c02-90dd-374ead3daa23 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:31:15 user nova-compute[72418]: WARNING nova.compute.manager [req-fcf40074-cdc4-47b9-8fe1-bceaa9feb868 req-560c135a-2e46-4810-8710-5a79b459eb2f service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Received unexpected event network-vif-plugged-301d9f8c-022d-4c02-90dd-374ead3daa23 for instance with vm_state stopped and task_state None.
Aug 09 18:31:15 user nova-compute[72418]: DEBUG nova.compute.manager [req-fcf40074-cdc4-47b9-8fe1-bceaa9feb868 req-560c135a-2e46-4810-8710-5a79b459eb2f service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Received event network-vif-unplugged-301d9f8c-022d-4c02-90dd-374ead3daa23 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:31:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-fcf40074-cdc4-47b9-8fe1-bceaa9feb868 req-560c135a-2e46-4810-8710-5a79b459eb2f service nova] Acquiring lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:31:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-fcf40074-cdc4-47b9-8fe1-bceaa9feb868 req-560c135a-2e46-4810-8710-5a79b459eb2f service nova] Lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:31:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-fcf40074-cdc4-47b9-8fe1-bceaa9feb868 req-560c135a-2e46-4810-8710-5a79b459eb2f service nova] Lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:31:15 user nova-compute[72418]: DEBUG nova.compute.manager [req-fcf40074-cdc4-47b9-8fe1-bceaa9feb868 req-560c135a-2e46-4810-8710-5a79b459eb2f service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] No waiting events found dispatching network-vif-unplugged-301d9f8c-022d-4c02-90dd-374ead3daa23 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:31:15 user nova-compute[72418]: WARNING nova.compute.manager [req-fcf40074-cdc4-47b9-8fe1-bceaa9feb868 req-560c135a-2e46-4810-8710-5a79b459eb2f service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Received unexpected event network-vif-unplugged-301d9f8c-022d-4c02-90dd-374ead3daa23 for instance with vm_state stopped and task_state None.
Aug 09 18:31:15 user nova-compute[72418]: DEBUG nova.compute.manager [req-fcf40074-cdc4-47b9-8fe1-bceaa9feb868 req-560c135a-2e46-4810-8710-5a79b459eb2f service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Received event network-vif-plugged-301d9f8c-022d-4c02-90dd-374ead3daa23 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:31:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-fcf40074-cdc4-47b9-8fe1-bceaa9feb868 req-560c135a-2e46-4810-8710-5a79b459eb2f service nova] Acquiring lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:31:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-fcf40074-cdc4-47b9-8fe1-bceaa9feb868 req-560c135a-2e46-4810-8710-5a79b459eb2f service nova] Lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:31:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-fcf40074-cdc4-47b9-8fe1-bceaa9feb868 req-560c135a-2e46-4810-8710-5a79b459eb2f service nova] Lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:31:15 user nova-compute[72418]: DEBUG nova.compute.manager [req-fcf40074-cdc4-47b9-8fe1-bceaa9feb868 req-560c135a-2e46-4810-8710-5a79b459eb2f service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] No waiting events found dispatching network-vif-plugged-301d9f8c-022d-4c02-90dd-374ead3daa23 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:31:15 user nova-compute[72418]: WARNING nova.compute.manager [req-fcf40074-cdc4-47b9-8fe1-bceaa9feb868 req-560c135a-2e46-4810-8710-5a79b459eb2f service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Received unexpected event network-vif-plugged-301d9f8c-022d-4c02-90dd-374ead3daa23 for instance with vm_state stopped and task_state None.
Aug 09 18:31:16 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:31:21 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:31:22 user nova-compute[72418]: DEBUG nova.compute.manager [req-c751ca42-26f1-4022-837f-03c0854141f6 req-a9ad45a5-61ae-4496-af93-66cded16cba6 service nova] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Received event network-changed-3054c1b9-3a7c-4caa-ab24-f3ed0db15b64 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:31:22 user nova-compute[72418]: DEBUG nova.compute.manager [req-c751ca42-26f1-4022-837f-03c0854141f6 req-a9ad45a5-61ae-4496-af93-66cded16cba6 service nova] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Refreshing instance network info cache due to event network-changed-3054c1b9-3a7c-4caa-ab24-f3ed0db15b64. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:31:22 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-c751ca42-26f1-4022-837f-03c0854141f6 req-a9ad45a5-61ae-4496-af93-66cded16cba6 service nova] Acquiring lock "refresh_cache-046617cf-13e5-44cf-9981-c1ae4ffd3851" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:31:22 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-c751ca42-26f1-4022-837f-03c0854141f6 req-a9ad45a5-61ae-4496-af93-66cded16cba6 service nova] Acquired lock "refresh_cache-046617cf-13e5-44cf-9981-c1ae4ffd3851" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:31:22 user nova-compute[72418]: DEBUG nova.network.neutron [req-c751ca42-26f1-4022-837f-03c0854141f6 req-a9ad45a5-61ae-4496-af93-66cded16cba6 service nova] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Refreshing network info cache for port 3054c1b9-3a7c-4caa-ab24-f3ed0db15b64 {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:31:22 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-a4927dec-0172-44be-8e2a-11ff6e85b54b tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Acquiring lock "046617cf-13e5-44cf-9981-c1ae4ffd3851" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:31:22 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-a4927dec-0172-44be-8e2a-11ff6e85b54b tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "046617cf-13e5-44cf-9981-c1ae4ffd3851" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:31:22 user nova-compute[72418]: DEBUG nova.objects.instance [None req-a4927dec-0172-44be-8e2a-11ff6e85b54b tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lazy-loading 'flavor' on Instance uuid 046617cf-13e5-44cf-9981-c1ae4ffd3851 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:31:22 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-a4927dec-0172-44be-8e2a-11ff6e85b54b tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Ignoring supplied device name: /dev/vdb
Aug 09 18:31:22 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-a4927dec-0172-44be-8e2a-11ff6e85b54b tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "046617cf-13e5-44cf-9981-c1ae4ffd3851" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:31:22 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:31:22 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-a4927dec-0172-44be-8e2a-11ff6e85b54b tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Acquiring lock "046617cf-13e5-44cf-9981-c1ae4ffd3851" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:31:22 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-a4927dec-0172-44be-8e2a-11ff6e85b54b tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "046617cf-13e5-44cf-9981-c1ae4ffd3851" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:31:22 user nova-compute[72418]: INFO nova.compute.manager [None req-a4927dec-0172-44be-8e2a-11ff6e85b54b tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Attaching volume e4d55e80-cbbd-4d03-adea-0b3e54c32e82 to /dev/vdb
Aug 09 18:31:22 user nova-compute[72418]: DEBUG os_brick.utils [None req-a4927dec-0172-44be-8e2a-11ff6e85b54b tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:31:22 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:31:22 user nova-compute[72418]: DEBUG nova.network.neutron [req-c751ca42-26f1-4022-837f-03c0854141f6 req-a9ad45a5-61ae-4496-af93-66cded16cba6 service nova] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Updated VIF entry in instance network info cache for port 3054c1b9-3a7c-4caa-ab24-f3ed0db15b64. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:31:22 user nova-compute[72418]: DEBUG nova.network.neutron [req-c751ca42-26f1-4022-837f-03c0854141f6 req-a9ad45a5-61ae-4496-af93-66cded16cba6 service nova] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Updating instance_info_cache with network_info: [{"id": "3054c1b9-3a7c-4caa-ab24-f3ed0db15b64", "address": "fa:16:3e:ef:ad:af", "network": {"id": "34f771ea-9846-4f27-94a0-c00494d053ab", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-973491744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eee663228cbc483896e4fd409c4aa135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3054c1b9-3a", "ovs_interfaceid": "3054c1b9-3a7c-4caa-ab24-f3ed0db15b64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:31:22 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:31:22 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[963c46b8-13ee-4c3b-abe9-8fb21ee84060]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ad56b243ad71\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:31:22 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:31:22 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-c751ca42-26f1-4022-837f-03c0854141f6 req-a9ad45a5-61ae-4496-af93-66cded16cba6 service nova] Releasing lock "refresh_cache-046617cf-13e5-44cf-9981-c1ae4ffd3851" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:31:22 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:31:22 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[54370f9f-e390-47d7-acc3-6ae24feefaea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:31:22 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:31:22 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:31:22 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[393ae201-8c91-4666-b241-9d1fbff948ed]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:31:22 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61b768b-bce1-416d-8303-099da62e30c5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:31:22 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-a4927dec-0172-44be-8e2a-11ff6e85b54b tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Running cmd (subprocess): nvme version {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:31:22 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-a4927dec-0172-44be-8e2a-11ff6e85b54b tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] 'nvme version' failed. Not Retrying. {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:31:22 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a4927dec-0172-44be-8e2a-11ff6e85b54b tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] nvme not present on system {{(pid=72418) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 18:31:22 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:31:22 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:31:22 user nova-compute[72418]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 18:31:22 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2dd04a-0cc2-4f8c-b09b-d14ec8eeba0d]: (4, '') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:31:22 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-a4927dec-0172-44be-8e2a-11ff6e85b54b tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72418) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 18:31:22 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-a4927dec-0172-44be-8e2a-11ff6e85b54b tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 18:31:22 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-a4927dec-0172-44be-8e2a-11ff6e85b54b tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] LIGHTOS: no hostnqn found. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 18:31:22 user nova-compute[72418]: DEBUG os_brick.utils [None req-a4927dec-0172-44be-8e2a-11ff6e85b54b tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ad56b243ad71', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:31:22 user nova-compute[72418]: DEBUG nova.virt.block_device [None req-a4927dec-0172-44be-8e2a-11ff6e85b54b tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Updating existing volume attachment record: b08a0492-e93a-4e20-adb1-aeee2676d282 {{(pid=72418) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 18:31:26 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:31:27 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:31:28 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:31:29 user nova-compute[72418]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691605874.2192528, e07beace-59d8-4c02-844b-1db1a6e81198 => Stopped> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:31:29 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] VM Stopped (Lifecycle Event)
Aug 09 18:31:29 user nova-compute[72418]: DEBUG nova.compute.manager [None req-7b223fa3-82dc-4230-ad76-34a355bf7dcf None None] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:31:29 user nova-compute[72418]: DEBUG nova.compute.manager [None req-7b223fa3-82dc-4230-ad76-34a355bf7dcf None None] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:31:31 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:31:31 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4927dec-0172-44be-8e2a-11ff6e85b54b tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Calling os-brick to attach iSCSI Volume {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 18:31:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4927dec-0172-44be-8e2a-11ff6e85b54b tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e4d55e80-cbbd-4d03-adea-0b3e54c32e82'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eopkCrjK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:31:31 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-a4927dec-0172-44be-8e2a-11ff6e85b54b tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:31:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-a4927dec-0172-44be-8e2a-11ff6e85b54b tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:31:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-a4927dec-0172-44be-8e2a-11ff6e85b54b tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:31:31 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-a4927dec-0172-44be-8e2a-11ff6e85b54b tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:31:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-a4927dec-0172-44be-8e2a-11ff6e85b54b tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4d55e80-cbbd-4d03-adea-0b3e54c32e82" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:31:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-a4927dec-0172-44be-8e2a-11ff6e85b54b tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4d55e80-cbbd-4d03-adea-0b3e54c32e82" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:31:31 user nova-compute[72418]: INFO os_brick.initiator.connectors.iscsi [None req-a4927dec-0172-44be-8e2a-11ff6e85b54b tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 18:31:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4d55e80-cbbd-4d03-adea-0b3e54c32e82 -p 172.16.0.220:3260 {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:31:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4d55e80-cbbd-4d03-adea-0b3e54c32e82 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:31:31 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a8befd-0fc1-4646-b6af-7ade8d8d1c3c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:31:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4927dec-0172-44be-8e2a-11ff6e85b54b tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 18:31:31 user nova-compute[72418]:  {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:31:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4d55e80-cbbd-4d03-adea-0b3e54c32e82 -p 172.16.0.220:3260 --interface default --op new {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:31:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4d55e80-cbbd-4d03-adea-0b3e54c32e82 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:31:31 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[519b8378-3e70-48fc-83c9-efcc952eb6f8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4d55e80-cbbd-4d03-adea-0b3e54c32e82] added\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:31:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4927dec-0172-44be-8e2a-11ff6e85b54b tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4d55e80-cbbd-4d03-adea-0b3e54c32e82] added
Aug 09 18:31:31 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:31:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4d55e80-cbbd-4d03-adea-0b3e54c32e82 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:31:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4d55e80-cbbd-4d03-adea-0b3e54c32e82 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:31:31 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d25e03f-1b57-4fd3-a5b2-6b5ab1aac78c]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:31:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4927dec-0172-44be-8e2a-11ff6e85b54b tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:31:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4d55e80-cbbd-4d03-adea-0b3e54c32e82 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:31:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4d55e80-cbbd-4d03-adea-0b3e54c32e82 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:31:31 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8866e4-083c-4fdf-97bd-ed94a0c83672]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:31:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4927dec-0172-44be-8e2a-11ff6e85b54b tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:31:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4d55e80-cbbd-4d03-adea-0b3e54c32e82 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eopkCrjK {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:31:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4d55e80-cbbd-4d03-adea-0b3e54c32e82 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eopkCrjK" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:31:31 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[569a06c0-f10b-42ce-b34a-c6203d332925]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:31:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4927dec-0172-44be-8e2a-11ff6e85b54b tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eopkCrjK'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:31:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4d55e80-cbbd-4d03-adea-0b3e54c32e82 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:31:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4d55e80-cbbd-4d03-adea-0b3e54c32e82 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:31:31 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[89420021-1af0-4909-9352-431428be52ae]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:31:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4927dec-0172-44be-8e2a-11ff6e85b54b tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:31:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:31:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:31:31 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[d123e1fc-2131-4f58-b4bf-2605461478b0]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:31:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4927dec-0172-44be-8e2a-11ff6e85b54b tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:31:31 user nova-compute[72418]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 (non-flash)
Aug 09 18:31:31 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:31:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4927dec-0172-44be-8e2a-11ff6e85b54b tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:31:31 user nova-compute[72418]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 (non-flash)
Aug 09 18:31:31 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:31:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4d55e80-cbbd-4d03-adea-0b3e54c32e82 -p 172.16.0.220:3260 --login {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:31:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4d55e80-cbbd-4d03-adea-0b3e54c32e82 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:31:31 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e59804-dcee-48b7-afaf-58efcc52b5d7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4d55e80-cbbd-4d03-adea-0b3e54c32e82, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e4d55e80-cbbd-4d03-adea-0b3e54c32e82, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:31:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4927dec-0172-44be-8e2a-11ff6e85b54b tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4d55e80-cbbd-4d03-adea-0b3e54c32e82, portal: 172.16.0.220,3260]
Aug 09 18:31:31 user nova-compute[72418]: Login to [iface: default, target: iqn.2010-10.org.openstack:e4d55e80-cbbd-4d03-adea-0b3e54c32e82, portal: 172.16.0.220,3260] successful.
Aug 09 18:31:31 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:31:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4d55e80-cbbd-4d03-adea-0b3e54c32e82 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:31:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4d55e80-cbbd-4d03-adea-0b3e54c32e82 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:31:31 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9bbae1-2fb5-4404-b864-69c389cd9b1c]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:31:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4927dec-0172-44be-8e2a-11ff6e85b54b tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:31:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:31:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:31:31 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5df74d-9887-400f-9664-6f9e7a0dcbd3]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4d55e80-cbbd-4d03-adea-0b3e54c32e82 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:31:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4927dec-0172-44be-8e2a-11ff6e85b54b tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:31:31 user nova-compute[72418]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 (non-flash)
Aug 09 18:31:31 user nova-compute[72418]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4d55e80-cbbd-4d03-adea-0b3e54c32e82 (non-flash)
Aug 09 18:31:31 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:31:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4927dec-0172-44be-8e2a-11ff6e85b54b tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:31:31 user nova-compute[72418]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 (non-flash)
Aug 09 18:31:31 user nova-compute[72418]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4d55e80-cbbd-4d03-adea-0b3e54c32e82 (non-flash)
Aug 09 18:31:31 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:31:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-a4927dec-0172-44be-8e2a-11ff6e85b54b tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4d55e80-cbbd-4d03-adea-0b3e54c32e82" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:31:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4927dec-0172-44be-8e2a-11ff6e85b54b tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Connected to 172.16.0.220:3260 {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 18:31:31 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-a4927dec-0172-44be-8e2a-11ff6e85b54b tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=72418) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 18:31:31 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-a4927dec-0172-44be-8e2a-11ff6e85b54b tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72418) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 18:31:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:31:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:31:31 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb84ed2d-0101-40ef-a88c-241399eaba77]: (4, ('- - 0', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:31:31 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-a4927dec-0172-44be-8e2a-11ff6e85b54b tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72418) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 18:31:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4927dec-0172-44be-8e2a-11ff6e85b54b tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eopkCrjK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 18:31:32 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:31:32 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-a4927dec-0172-44be-8e2a-11ff6e85b54b tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:31:32 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4927dec-0172-44be-8e2a-11ff6e85b54b tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23235363665356234', 'path': '/dev/sdc'} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:31:32 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4927dec-0172-44be-8e2a-11ff6e85b54b tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235363665356234', 'path': '/dev/sdc'} {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 18:31:32 user nova-compute[72418]: DEBUG nova.objects.instance [None req-a4927dec-0172-44be-8e2a-11ff6e85b54b tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lazy-loading 'flavor' on Instance uuid 046617cf-13e5-44cf-9981-c1ae4ffd3851 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:31:32 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-a4927dec-0172-44be-8e2a-11ff6e85b54b tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 18:31:32 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:31:32 user nova-compute[72418]:   <source dev="/dev/sdc"/>
Aug 09 18:31:32 user nova-compute[72418]:   <target dev="vdb" bus="virtio"/>
Aug 09 18:31:32 user nova-compute[72418]:   <serial>e4d55e80-cbbd-4d03-adea-0b3e54c32e82</serial>
Aug 09 18:31:32 user nova-compute[72418]: </disk>
Aug 09 18:31:32 user nova-compute[72418]:  {{(pid=72418) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 18:31:33 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-a4927dec-0172-44be-8e2a-11ff6e85b54b tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:31:33 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-a4927dec-0172-44be-8e2a-11ff6e85b54b tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:31:33 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-a4927dec-0172-44be-8e2a-11ff6e85b54b tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] No VIF found with MAC fa:16:3e:ef:ad:af, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:31:33 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-a4927dec-0172-44be-8e2a-11ff6e85b54b tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "046617cf-13e5-44cf-9981-c1ae4ffd3851" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.690s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:31:36 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:31:37 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:31:37 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:31:41 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:31:42 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:31:45 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:31:46 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:31:49 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:31:50 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:31:50 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:31:50 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:31:51 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:31:51 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:31:52 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:31:52 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:31:52 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:31:52 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72418) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 18:31:53 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:31:53 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:31:53 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:31:53 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:31:53 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:31:53 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:31:53 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:31:53 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Auditing locally available compute resources for user (node: user) {{(pid=72418) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 18:31:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:31:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:31:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:31:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:31:54 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:31:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c53f871-2be9-4119-b5c0-d5081e2f4388/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:31:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c53f871-2be9-4119-b5c0-d5081e2f4388/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:31:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c53f871-2be9-4119-b5c0-d5081e2f4388/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:31:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c53f871-2be9-4119-b5c0-d5081e2f4388/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:31:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/046617cf-13e5-44cf-9981-c1ae4ffd3851/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:31:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/046617cf-13e5-44cf-9981-c1ae4ffd3851/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:31:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/046617cf-13e5-44cf-9981-c1ae4ffd3851/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:31:55 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/046617cf-13e5-44cf-9981-c1ae4ffd3851/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:31:55 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:31:55 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:31:55 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:31:55 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:31:55 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:31:55 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:31:55 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json" returned: 0 in 0.163s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:31:55 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:31:55 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:31:55 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:31:55 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:31:55 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:31:56 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:31:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:31:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:31:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:31:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:31:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:31:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:31:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:31:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:31:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:31:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:31:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:31:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:31:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:31:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e582b61c-d998-4a3f-8392-a7f0e94a4dec/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:31:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e582b61c-d998-4a3f-8392-a7f0e94a4dec/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:31:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e582b61c-d998-4a3f-8392-a7f0e94a4dec/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:31:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e582b61c-d998-4a3f-8392-a7f0e94a4dec/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:31:57 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:31:58 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:31:58 user nova-compute[72418]: DEBUG nova.compute.manager [req-3b8a1096-290b-478c-ba74-a0a37c488d0b req-39b42dfc-1019-49ce-ab9f-a374b36a4b3d service nova] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Received event network-changed-ea92909f-40d7-48a8-be09-50439674945c {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:31:58 user nova-compute[72418]: DEBUG nova.compute.manager [req-3b8a1096-290b-478c-ba74-a0a37c488d0b req-39b42dfc-1019-49ce-ab9f-a374b36a4b3d service nova] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Refreshing instance network info cache due to event network-changed-ea92909f-40d7-48a8-be09-50439674945c. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:31:58 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-3b8a1096-290b-478c-ba74-a0a37c488d0b req-39b42dfc-1019-49ce-ab9f-a374b36a4b3d service nova] Acquiring lock "refresh_cache-03ad5bab-ab32-47fc-b7e8-b32282b9c20d" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:31:58 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-3b8a1096-290b-478c-ba74-a0a37c488d0b req-39b42dfc-1019-49ce-ab9f-a374b36a4b3d service nova] Acquired lock "refresh_cache-03ad5bab-ab32-47fc-b7e8-b32282b9c20d" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:31:58 user nova-compute[72418]: DEBUG nova.network.neutron [req-3b8a1096-290b-478c-ba74-a0a37c488d0b req-39b42dfc-1019-49ce-ab9f-a374b36a4b3d service nova] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Refreshing network info cache for port ea92909f-40d7-48a8-be09-50439674945c {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:31:58 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:31:58 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:31:58 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Hypervisor/Node resource view: name=user free_ram=7586MB free_disk=25.57074737548828GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72418) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 18:31:58 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:31:58 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:31:58 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 6af7918a-ce90-45ab-93d8-684e1489e891 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:31:58 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 8fe41968-a219-4a5a-afdb-32eb2082bb40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:31:58 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 01c46b33-6788-44a5-a43c-88ee4acc4d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:31:58 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance e019064c-955e-4f80-9b00-6b32b3835d58 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:31:58 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance e07beace-59d8-4c02-844b-1db1a6e81198 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:31:58 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance c46f2599-93f8-412e-9918-7ace8a9f19dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:31:58 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 046617cf-13e5-44cf-9981-c1ae4ffd3851 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:31:58 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 03ad5bab-ab32-47fc-b7e8-b32282b9c20d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:31:58 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 1c53f871-2be9-4119-b5c0-d5081e2f4388 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:31:58 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance e582b61c-d998-4a3f-8392-a7f0e94a4dec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:31:58 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 18:31:58 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 18:31:58 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:31:58 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:31:58 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Compute_service record updated for user:user {{(pid=72418) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 18:31:58 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.603s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:31:59 user nova-compute[72418]: DEBUG nova.network.neutron [req-3b8a1096-290b-478c-ba74-a0a37c488d0b req-39b42dfc-1019-49ce-ab9f-a374b36a4b3d service nova] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Updated VIF entry in instance network info cache for port ea92909f-40d7-48a8-be09-50439674945c. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:31:59 user nova-compute[72418]: DEBUG nova.network.neutron [req-3b8a1096-290b-478c-ba74-a0a37c488d0b req-39b42dfc-1019-49ce-ab9f-a374b36a4b3d service nova] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Updating instance_info_cache with network_info: [{"id": "ea92909f-40d7-48a8-be09-50439674945c", "address": "fa:16:3e:3e:5e:e7", "network": {"id": "8354f86b-1e91-42ca-9847-769bb0aadcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-664289957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405587d223d54c5ab4f72a1994ac2862", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea92909f-40", "ovs_interfaceid": "ea92909f-40d7-48a8-be09-50439674945c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:31:59 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-3b8a1096-290b-478c-ba74-a0a37c488d0b req-39b42dfc-1019-49ce-ab9f-a374b36a4b3d service nova] Releasing lock "refresh_cache-03ad5bab-ab32-47fc-b7e8-b32282b9c20d" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:32:00 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:32:00 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Starting heal instance info cache {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 18:32:00 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:32:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "refresh_cache-e019064c-955e-4f80-9b00-6b32b3835d58" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:32:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquired lock "refresh_cache-e019064c-955e-4f80-9b00-6b32b3835d58" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:32:01 user nova-compute[72418]: DEBUG nova.network.neutron [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Forcefully refreshing network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 18:32:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:32:01 user nova-compute[72418]: DEBUG nova.network.neutron [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Updating instance_info_cache with network_info: [{"id": "4c6c632a-142b-4cda-92c8-77026645af09", "address": "fa:16:3e:15:18:a4", "network": {"id": "beaefb5c-f5e4-47e7-ab68-60131f532ade", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e5863cda54487682a4edcc24202c91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c6c632a-14", "ovs_interfaceid": "4c6c632a-142b-4cda-92c8-77026645af09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:32:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Releasing lock "refresh_cache-e019064c-955e-4f80-9b00-6b32b3835d58" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:32:01 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Updated the network info_cache for instance {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 18:32:02 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:32:06 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:32:07 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:32:11 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:32:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-fdd0e821-4711-4845-b78f-ec8aa172af9d tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Acquiring lock "046617cf-13e5-44cf-9981-c1ae4ffd3851" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:32:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-fdd0e821-4711-4845-b78f-ec8aa172af9d tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "046617cf-13e5-44cf-9981-c1ae4ffd3851" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:32:12 user nova-compute[72418]: INFO nova.compute.manager [None req-fdd0e821-4711-4845-b78f-ec8aa172af9d tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Detaching volume e4d55e80-cbbd-4d03-adea-0b3e54c32e82
Aug 09 18:32:12 user nova-compute[72418]: INFO nova.virt.block_device [None req-fdd0e821-4711-4845-b78f-ec8aa172af9d tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Attempting to driver detach volume e4d55e80-cbbd-4d03-adea-0b3e54c32e82 from mountpoint /dev/vdb
Aug 09 18:32:12 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-fdd0e821-4711-4845-b78f-ec8aa172af9d tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Attempting to detach device vdb from instance 046617cf-13e5-44cf-9981-c1ae4ffd3851 from the persistent domain config. {{(pid=72418) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 18:32:12 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-fdd0e821-4711-4845-b78f-ec8aa172af9d tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 18:32:12 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:32:12 user nova-compute[72418]:   <source dev="/dev/sdc"/>
Aug 09 18:32:12 user nova-compute[72418]:   <target dev="vdb" bus="virtio"/>
Aug 09 18:32:12 user nova-compute[72418]:   <serial>e4d55e80-cbbd-4d03-adea-0b3e54c32e82</serial>
Aug 09 18:32:12 user nova-compute[72418]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 18:32:12 user nova-compute[72418]: </disk>
Aug 09 18:32:12 user nova-compute[72418]:  {{(pid=72418) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 18:32:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ff5c1625-3b4e-4a1c-acc5-9246fcd52c4c tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Acquiring lock "046617cf-13e5-44cf-9981-c1ae4ffd3851" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:32:12 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-fdd0e821-4711-4845-b78f-ec8aa172af9d tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Successfully detached device vdb from instance 046617cf-13e5-44cf-9981-c1ae4ffd3851 from the persistent domain config.
Aug 09 18:32:12 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-fdd0e821-4711-4845-b78f-ec8aa172af9d tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 046617cf-13e5-44cf-9981-c1ae4ffd3851 from the live domain config. {{(pid=72418) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 18:32:12 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-fdd0e821-4711-4845-b78f-ec8aa172af9d tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 18:32:12 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:32:12 user nova-compute[72418]:   <source dev="/dev/sdc"/>
Aug 09 18:32:12 user nova-compute[72418]:   <target dev="vdb" bus="virtio"/>
Aug 09 18:32:12 user nova-compute[72418]:   <serial>e4d55e80-cbbd-4d03-adea-0b3e54c32e82</serial>
Aug 09 18:32:12 user nova-compute[72418]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 18:32:12 user nova-compute[72418]: </disk>
Aug 09 18:32:12 user nova-compute[72418]:  {{(pid=72418) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 18:32:12 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:32:12 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Received event <DeviceRemovedEvent: 1691605932.8253582, 046617cf-13e5-44cf-9981-c1ae4ffd3851 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72418) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 18:32:12 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-fdd0e821-4711-4845-b78f-ec8aa172af9d tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 046617cf-13e5-44cf-9981-c1ae4ffd3851 {{(pid=72418) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 18:32:12 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-fdd0e821-4711-4845-b78f-ec8aa172af9d tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Successfully detached device vdb from instance 046617cf-13e5-44cf-9981-c1ae4ffd3851 from the live domain config.
Aug 09 18:32:12 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdd0e821-4711-4845-b78f-ec8aa172af9d tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] calling os-brick to detach iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 18:32:12 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd0e821-4711-4845-b78f-ec8aa172af9d tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, {'target_iqns': ['iqn.2010-10.org.openstack:e4d55e80-cbbd-4d03-adea-0b3e54c32e82'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eopkCrjK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:32:12 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-fdd0e821-4711-4845-b78f-ec8aa172af9d tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:32:12 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-fdd0e821-4711-4845-b78f-ec8aa172af9d tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:32:12 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-fdd0e821-4711-4845-b78f-ec8aa172af9d tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:32:12 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd0e821-4711-4845-b78f-ec8aa172af9d tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4d55e80-cbbd-4d03-adea-0b3e54c32e82', 0)] {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 18:32:12 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:12 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:12 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[69085cec-fcb1-4f97-8e43-6ee10f2cf1cd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4d55e80-cbbd-4d03-adea-0b3e54c32e82\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:32:12 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:12 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:12 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c335230-91b3-464a-b318-7d633c92e049]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4d55e80-cbbd-4d03-adea-0b3e54c32e82 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:32:12 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd0e821-4711-4845-b78f-ec8aa172af9d tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:32:12 user nova-compute[72418]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 (non-flash)
Aug 09 18:32:12 user nova-compute[72418]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4d55e80-cbbd-4d03-adea-0b3e54c32e82 (non-flash)
Aug 09 18:32:12 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:32:12 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd0e821-4711-4845-b78f-ec8aa172af9d tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:32:12 user nova-compute[72418]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 (non-flash)
Aug 09 18:32:12 user nova-compute[72418]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4d55e80-cbbd-4d03-adea-0b3e54c32e82 (non-flash)
Aug 09 18:32:12 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:32:12 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd0e821-4711-4845-b78f-ec8aa172af9d tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f43018e77f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4d55e80-cbbd-4d03-adea-0b3e54c32e82'): ({'sdc'}, set())}) {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 18:32:12 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-fdd0e821-4711-4845-b78f-ec8aa172af9d tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Removing single pathed devices sdc {{(pid=72418) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 18:32:12 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:12 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:12 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[b442e696-e591-4d8d-81b7-083e07c3fcf6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:32:12 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:12 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:12 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec739d1-9f9e-4725-b314-9cb1ae959f35]: (4, ('ok\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:32:12 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-fdd0e821-4711-4845-b78f-ec8aa172af9d tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Flushing IO for device /dev/sdc {{(pid=72418) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 18:32:12 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:12 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:12 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e81ba58-31ac-449d-a592-3de747ad66c2]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:32:12 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-fdd0e821-4711-4845-b78f-ec8aa172af9d tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72418) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 18:32:12 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:13 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:13 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2942008-9b1f-48f9-a9a6-17b2ba8fe94c]: (4, ('1', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:32:13 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-fdd0e821-4711-4845-b78f-ec8aa172af9d tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 18:32:13 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-fdd0e821-4711-4845-b78f-ec8aa172af9d tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] SCSI volumes sdc have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 18:32:13 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd0e821-4711-4845-b78f-ec8aa172af9d tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4d55e80-cbbd-4d03-adea-0b3e54c32e82')] {{(pid=72418) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 18:32:13 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4d55e80-cbbd-4d03-adea-0b3e54c32e82 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:13 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4d55e80-cbbd-4d03-adea-0b3e54c32e82 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:13 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[1915bd87-ed71-499d-a64c-512830b00170]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:32:13 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd0e821-4711-4845-b78f-ec8aa172af9d tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:32:13 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4d55e80-cbbd-4d03-adea-0b3e54c32e82 -p 172.16.0.220:3260 --logout {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:13 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4d55e80-cbbd-4d03-adea-0b3e54c32e82 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:13 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef10775-2427-488f-a6ac-de1433c79c03]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:e4d55e80-cbbd-4d03-adea-0b3e54c32e82, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:e4d55e80-cbbd-4d03-adea-0b3e54c32e82, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:32:13 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd0e821-4711-4845-b78f-ec8aa172af9d tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:e4d55e80-cbbd-4d03-adea-0b3e54c32e82, portal: 172.16.0.220,3260]
Aug 09 18:32:13 user nova-compute[72418]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:e4d55e80-cbbd-4d03-adea-0b3e54c32e82, portal: 172.16.0.220,3260] successful.
Aug 09 18:32:13 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:32:13 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4d55e80-cbbd-4d03-adea-0b3e54c32e82 -p 172.16.0.220:3260 --op delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:13 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4d55e80-cbbd-4d03-adea-0b3e54c32e82 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:13 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3acf98-3c18-43c9-b957-5afc450ab5e1]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:32:13 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd0e821-4711-4845-b78f-ec8aa172af9d tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:32:13 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-fdd0e821-4711-4845-b78f-ec8aa172af9d tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:32:13 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdd0e821-4711-4845-b78f-ec8aa172af9d tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] <== disconnect_volume: return (305ms) None {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:32:13 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdd0e821-4711-4845-b78f-ec8aa172af9d tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Disconnected iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 18:32:14 user nova-compute[72418]: DEBUG nova.objects.instance [None req-fdd0e821-4711-4845-b78f-ec8aa172af9d tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lazy-loading 'flavor' on Instance uuid 046617cf-13e5-44cf-9981-c1ae4ffd3851 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:32:14 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-fdd0e821-4711-4845-b78f-ec8aa172af9d tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "046617cf-13e5-44cf-9981-c1ae4ffd3851" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.807s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:32:14 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ff5c1625-3b4e-4a1c-acc5-9246fcd52c4c tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "046617cf-13e5-44cf-9981-c1ae4ffd3851" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.679s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:32:14 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ff5c1625-3b4e-4a1c-acc5-9246fcd52c4c tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Acquiring lock "046617cf-13e5-44cf-9981-c1ae4ffd3851-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:32:14 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ff5c1625-3b4e-4a1c-acc5-9246fcd52c4c tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "046617cf-13e5-44cf-9981-c1ae4ffd3851-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:32:14 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ff5c1625-3b4e-4a1c-acc5-9246fcd52c4c tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "046617cf-13e5-44cf-9981-c1ae4ffd3851-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:32:14 user nova-compute[72418]: INFO nova.compute.manager [None req-ff5c1625-3b4e-4a1c-acc5-9246fcd52c4c tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Terminating instance
Aug 09 18:32:14 user nova-compute[72418]: DEBUG nova.compute.manager [None req-ff5c1625-3b4e-4a1c-acc5-9246fcd52c4c tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Start destroying the instance on the hypervisor. {{(pid=72418) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 18:32:14 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:32:14 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:32:14 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:32:14 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:32:14 user nova-compute[72418]: DEBUG nova.compute.manager [req-493cfce3-7312-473f-b5e6-07d342db55b2 req-ea25ad69-edbc-4e5c-94a2-1a22a6d64064 service nova] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Received event network-vif-unplugged-3054c1b9-3a7c-4caa-ab24-f3ed0db15b64 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:32:14 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-493cfce3-7312-473f-b5e6-07d342db55b2 req-ea25ad69-edbc-4e5c-94a2-1a22a6d64064 service nova] Acquiring lock "046617cf-13e5-44cf-9981-c1ae4ffd3851-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:32:14 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-493cfce3-7312-473f-b5e6-07d342db55b2 req-ea25ad69-edbc-4e5c-94a2-1a22a6d64064 service nova] Lock "046617cf-13e5-44cf-9981-c1ae4ffd3851-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:32:14 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-493cfce3-7312-473f-b5e6-07d342db55b2 req-ea25ad69-edbc-4e5c-94a2-1a22a6d64064 service nova] Lock "046617cf-13e5-44cf-9981-c1ae4ffd3851-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:32:14 user nova-compute[72418]: DEBUG nova.compute.manager [req-493cfce3-7312-473f-b5e6-07d342db55b2 req-ea25ad69-edbc-4e5c-94a2-1a22a6d64064 service nova] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] No waiting events found dispatching network-vif-unplugged-3054c1b9-3a7c-4caa-ab24-f3ed0db15b64 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:32:14 user nova-compute[72418]: DEBUG nova.compute.manager [req-493cfce3-7312-473f-b5e6-07d342db55b2 req-ea25ad69-edbc-4e5c-94a2-1a22a6d64064 service nova] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Received event network-vif-unplugged-3054c1b9-3a7c-4caa-ab24-f3ed0db15b64 for instance with task_state deleting. {{(pid=72418) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 18:32:14 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Instance destroyed successfully.
Aug 09 18:32:14 user nova-compute[72418]: DEBUG nova.objects.instance [None req-ff5c1625-3b4e-4a1c-acc5-9246fcd52c4c tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lazy-loading 'resources' on Instance uuid 046617cf-13e5-44cf-9981-c1ae4ffd3851 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:32:14 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-ff5c1625-3b4e-4a1c-acc5-9246fcd52c4c tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:29:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-588253466',display_name='tempest-VolumesSnapshotTestJSON-instance-588253466',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-588253466',id=21,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMgDmybcWdT0fCyai+hta3TKdXHlkQSTuMms0ZJ6zrHtMj680vz4R0kkxkFjGAMm6CMUfnYqzor+36YijmElTc834NJPwrA6CS8uc+SGiYZsVZui+dGFZTPvBwXdVdYnBA==',key_name='tempest-keypair-543096935',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:29:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eee663228cbc483896e4fd409c4aa135',ramdisk_id='',reservation_id='r-r1t7ifog',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1926046841',owner_user_name='tempest-VolumesSnapshotTestJSON-1926046841-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:29:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93e127bc79ec49fa813408f36b639504',uuid=046617cf-13e5-44cf-9981-c1ae4ffd3851,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3054c1b9-3a7c-4caa-ab24-f3ed0db15b64", "address": "fa:16:3e:ef:ad:af", "network": {"id": "34f771ea-9846-4f27-94a0-c00494d053ab", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-973491744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eee663228cbc483896e4fd409c4aa135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3054c1b9-3a", "ovs_interfaceid": "3054c1b9-3a7c-4caa-ab24-f3ed0db15b64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 18:32:14 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-ff5c1625-3b4e-4a1c-acc5-9246fcd52c4c tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Converting VIF {"id": "3054c1b9-3a7c-4caa-ab24-f3ed0db15b64", "address": "fa:16:3e:ef:ad:af", "network": {"id": "34f771ea-9846-4f27-94a0-c00494d053ab", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-973491744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eee663228cbc483896e4fd409c4aa135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3054c1b9-3a", "ovs_interfaceid": "3054c1b9-3a7c-4caa-ab24-f3ed0db15b64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:32:14 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-ff5c1625-3b4e-4a1c-acc5-9246fcd52c4c tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:ad:af,bridge_name='br-int',has_traffic_filtering=True,id=3054c1b9-3a7c-4caa-ab24-f3ed0db15b64,network=Network(34f771ea-9846-4f27-94a0-c00494d053ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3054c1b9-3a') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:32:14 user nova-compute[72418]: DEBUG os_vif [None req-ff5c1625-3b4e-4a1c-acc5-9246fcd52c4c tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:ad:af,bridge_name='br-int',has_traffic_filtering=True,id=3054c1b9-3a7c-4caa-ab24-f3ed0db15b64,network=Network(34f771ea-9846-4f27-94a0-c00494d053ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3054c1b9-3a') {{(pid=72418) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 18:32:14 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:32:14 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3054c1b9-3a, bridge=br-int, if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:32:14 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:32:14 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:32:14 user nova-compute[72418]: INFO os_vif [None req-ff5c1625-3b4e-4a1c-acc5-9246fcd52c4c tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:ad:af,bridge_name='br-int',has_traffic_filtering=True,id=3054c1b9-3a7c-4caa-ab24-f3ed0db15b64,network=Network(34f771ea-9846-4f27-94a0-c00494d053ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3054c1b9-3a')
Aug 09 18:32:14 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff5c1625-3b4e-4a1c-acc5-9246fcd52c4c tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] calling os-brick to detach iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 18:32:14 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5c1625-3b4e-4a1c-acc5-9246fcd52c4c tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, {'target_iqns': ['iqn.2010-10.org.openstack:e4d55e80-cbbd-4d03-adea-0b3e54c32e82'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eopkCrjK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:32:14 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-ff5c1625-3b4e-4a1c-acc5-9246fcd52c4c tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:32:14 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-ff5c1625-3b4e-4a1c-acc5-9246fcd52c4c tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:32:14 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-ff5c1625-3b4e-4a1c-acc5-9246fcd52c4c tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:32:14 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5c1625-3b4e-4a1c-acc5-9246fcd52c4c tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4d55e80-cbbd-4d03-adea-0b3e54c32e82', 0)] {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 18:32:14 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:14 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:14 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c18d9ce-8801-45cd-90a5-020b2ad3c1e8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:32:14 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:14 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:14 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[2523ad52-f78b-4b6b-9604-1a300944cafc]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:32:14 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5c1625-3b4e-4a1c-acc5-9246fcd52c4c tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:32:14 user nova-compute[72418]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 (non-flash)
Aug 09 18:32:14 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:32:14 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5c1625-3b4e-4a1c-acc5-9246fcd52c4c tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:32:14 user nova-compute[72418]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 (non-flash)
Aug 09 18:32:14 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:32:14 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5c1625-3b4e-4a1c-acc5-9246fcd52c4c tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f42f81c0c10>, {}) {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 18:32:14 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5c1625-3b4e-4a1c-acc5-9246fcd52c4c tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Disconnecting from: [] {{(pid=72418) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 18:32:14 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-ff5c1625-3b4e-4a1c-acc5-9246fcd52c4c tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.050s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:32:14 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5c1625-3b4e-4a1c-acc5-9246fcd52c4c tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] <== disconnect_volume: return (51ms) None {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:32:14 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff5c1625-3b4e-4a1c-acc5-9246fcd52c4c tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Disconnected iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 18:32:14 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-ff5c1625-3b4e-4a1c-acc5-9246fcd52c4c tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Deleting instance files /opt/stack/data/nova/instances/046617cf-13e5-44cf-9981-c1ae4ffd3851_del
Aug 09 18:32:14 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-ff5c1625-3b4e-4a1c-acc5-9246fcd52c4c tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Deletion of /opt/stack/data/nova/instances/046617cf-13e5-44cf-9981-c1ae4ffd3851_del complete
Aug 09 18:32:15 user nova-compute[72418]: INFO nova.compute.manager [None req-ff5c1625-3b4e-4a1c-acc5-9246fcd52c4c tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 09 18:32:15 user nova-compute[72418]: DEBUG oslo.service.loopingcall [None req-ff5c1625-3b4e-4a1c-acc5-9246fcd52c4c tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72418) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 18:32:15 user nova-compute[72418]: DEBUG nova.compute.manager [-] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Deallocating network for instance {{(pid=72418) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 18:32:15 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] deallocate_for_instance() {{(pid=72418) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 18:32:15 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:32:15 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Took 0.91 seconds to deallocate network for instance.
Aug 09 18:32:15 user nova-compute[72418]: WARNING nova.volume.cinder [None req-ff5c1625-3b4e-4a1c-acc5-9246fcd52c4c tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Attachment b08a0492-e93a-4e20-adb1-aeee2676d282 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = b08a0492-e93a-4e20-adb1-aeee2676d282. (HTTP 404) (Request-ID: req-1c3ae0de-3655-46dc-abb8-076cfc23906d)
Aug 09 18:32:15 user nova-compute[72418]: INFO nova.compute.manager [None req-ff5c1625-3b4e-4a1c-acc5-9246fcd52c4c tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Took 0.02 seconds to detach 1 volumes for instance.
Aug 09 18:32:16 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ff5c1625-3b4e-4a1c-acc5-9246fcd52c4c tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:32:16 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ff5c1625-3b4e-4a1c-acc5-9246fcd52c4c tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:32:16 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-ff5c1625-3b4e-4a1c-acc5-9246fcd52c4c tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:32:16 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-ff5c1625-3b4e-4a1c-acc5-9246fcd52c4c tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:32:16 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ff5c1625-3b4e-4a1c-acc5-9246fcd52c4c tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.382s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:32:16 user nova-compute[72418]: INFO nova.scheduler.client.report [None req-ff5c1625-3b4e-4a1c-acc5-9246fcd52c4c tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Deleted allocations for instance 046617cf-13e5-44cf-9981-c1ae4ffd3851
Aug 09 18:32:16 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ff5c1625-3b4e-4a1c-acc5-9246fcd52c4c tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "046617cf-13e5-44cf-9981-c1ae4ffd3851" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.470s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:32:16 user nova-compute[72418]: DEBUG nova.compute.manager [req-0b3124dd-03b6-4937-ad69-4acffcf48bf6 req-6a5c3844-5540-4f20-aa20-86ca5207b8af service nova] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Received event network-vif-plugged-3054c1b9-3a7c-4caa-ab24-f3ed0db15b64 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:32:16 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-0b3124dd-03b6-4937-ad69-4acffcf48bf6 req-6a5c3844-5540-4f20-aa20-86ca5207b8af service nova] Acquiring lock "046617cf-13e5-44cf-9981-c1ae4ffd3851-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:32:16 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-0b3124dd-03b6-4937-ad69-4acffcf48bf6 req-6a5c3844-5540-4f20-aa20-86ca5207b8af service nova] Lock "046617cf-13e5-44cf-9981-c1ae4ffd3851-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:32:16 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-0b3124dd-03b6-4937-ad69-4acffcf48bf6 req-6a5c3844-5540-4f20-aa20-86ca5207b8af service nova] Lock "046617cf-13e5-44cf-9981-c1ae4ffd3851-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:32:16 user nova-compute[72418]: DEBUG nova.compute.manager [req-0b3124dd-03b6-4937-ad69-4acffcf48bf6 req-6a5c3844-5540-4f20-aa20-86ca5207b8af service nova] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] No waiting events found dispatching network-vif-plugged-3054c1b9-3a7c-4caa-ab24-f3ed0db15b64 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:32:16 user nova-compute[72418]: WARNING nova.compute.manager [req-0b3124dd-03b6-4937-ad69-4acffcf48bf6 req-6a5c3844-5540-4f20-aa20-86ca5207b8af service nova] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Received unexpected event network-vif-plugged-3054c1b9-3a7c-4caa-ab24-f3ed0db15b64 for instance with vm_state deleted and task_state None.
Aug 09 18:32:16 user nova-compute[72418]: DEBUG nova.compute.manager [req-0b3124dd-03b6-4937-ad69-4acffcf48bf6 req-6a5c3844-5540-4f20-aa20-86ca5207b8af service nova] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Received event network-vif-deleted-3054c1b9-3a7c-4caa-ab24-f3ed0db15b64 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:32:17 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:32:19 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:32:20 user nova-compute[72418]: DEBUG nova.compute.manager [None req-dbba6326-7671-4777-96f5-71c5656039ee tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:32:20 user nova-compute[72418]: INFO nova.compute.manager [None req-dbba6326-7671-4777-96f5-71c5656039ee tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] instance snapshotting
Aug 09 18:32:20 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-dbba6326-7671-4777-96f5-71c5656039ee tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Beginning live snapshot process
Aug 09 18:32:20 user nova-compute[72418]: DEBUG nova.compute.manager [req-43d94829-4837-43b8-8b8b-7b71cbe4ef7d req-9ce8dc42-bb57-4ef4-8523-f3a69d4a3a03 service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Received event network-changed-84eb2df4-6995-47c5-bf0f-387932ece66d {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:32:20 user nova-compute[72418]: DEBUG nova.compute.manager [req-43d94829-4837-43b8-8b8b-7b71cbe4ef7d req-9ce8dc42-bb57-4ef4-8523-f3a69d4a3a03 service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Refreshing instance network info cache due to event network-changed-84eb2df4-6995-47c5-bf0f-387932ece66d. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:32:20 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-43d94829-4837-43b8-8b8b-7b71cbe4ef7d req-9ce8dc42-bb57-4ef4-8523-f3a69d4a3a03 service nova] Acquiring lock "refresh_cache-1c53f871-2be9-4119-b5c0-d5081e2f4388" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:32:20 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-43d94829-4837-43b8-8b8b-7b71cbe4ef7d req-9ce8dc42-bb57-4ef4-8523-f3a69d4a3a03 service nova] Acquired lock "refresh_cache-1c53f871-2be9-4119-b5c0-d5081e2f4388" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:32:20 user nova-compute[72418]: DEBUG nova.network.neutron [req-43d94829-4837-43b8-8b8b-7b71cbe4ef7d req-9ce8dc42-bb57-4ef4-8523-f3a69d4a3a03 service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Refreshing network info cache for port 84eb2df4-6995-47c5-bf0f-387932ece66d {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:32:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-dbba6326-7671-4777-96f5-71c5656039ee tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e582b61c-d998-4a3f-8392-a7f0e94a4dec/disk --force-share --output=json -f qcow2 {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-dbba6326-7671-4777-96f5-71c5656039ee tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e582b61c-d998-4a3f-8392-a7f0e94a4dec/disk --force-share --output=json -f qcow2" returned: 0 in 0.152s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-dbba6326-7671-4777-96f5-71c5656039ee tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e582b61c-d998-4a3f-8392-a7f0e94a4dec/disk --force-share --output=json -f qcow2 {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:21 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-081d490a-576e-4e2d-9b04-1bf3e32d4c20 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Acquiring lock "1c53f871-2be9-4119-b5c0-d5081e2f4388" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:32:21 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-081d490a-576e-4e2d-9b04-1bf3e32d4c20 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "1c53f871-2be9-4119-b5c0-d5081e2f4388" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:32:21 user nova-compute[72418]: DEBUG nova.objects.instance [None req-081d490a-576e-4e2d-9b04-1bf3e32d4c20 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lazy-loading 'flavor' on Instance uuid 1c53f871-2be9-4119-b5c0-d5081e2f4388 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:32:21 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-081d490a-576e-4e2d-9b04-1bf3e32d4c20 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "1c53f871-2be9-4119-b5c0-d5081e2f4388" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:32:21 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-dbba6326-7671-4777-96f5-71c5656039ee tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e582b61c-d998-4a3f-8392-a7f0e94a4dec/disk --force-share --output=json -f qcow2" returned: 0 in 0.162s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:21 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-dbba6326-7671-4777-96f5-71c5656039ee tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:21 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-dbba6326-7671-4777-96f5-71c5656039ee tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.157s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:21 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-dbba6326-7671-4777-96f5-71c5656039ee tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp6ypocy2u/2b7a7c07556341ce871b602cc25773f4.delta 1073741824 {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:21 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-081d490a-576e-4e2d-9b04-1bf3e32d4c20 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Acquiring lock "1c53f871-2be9-4119-b5c0-d5081e2f4388" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:32:21 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-081d490a-576e-4e2d-9b04-1bf3e32d4c20 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "1c53f871-2be9-4119-b5c0-d5081e2f4388" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:32:21 user nova-compute[72418]: INFO nova.compute.manager [None req-081d490a-576e-4e2d-9b04-1bf3e32d4c20 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Attaching volume 0ac09942-714e-4c2a-a7ad-637d87d7d177 to /dev/vdb
Aug 09 18:32:21 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-dbba6326-7671-4777-96f5-71c5656039ee tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp6ypocy2u/2b7a7c07556341ce871b602cc25773f4.delta 1073741824" returned: 0 in 0.080s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:21 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-dbba6326-7671-4777-96f5-71c5656039ee tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 09 18:32:21 user nova-compute[72418]: DEBUG os_brick.utils [None req-081d490a-576e-4e2d-9b04-1bf3e32d4c20 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:32:21 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:21 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:21 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee047124-1dc6-448e-9c28-6ea01b12b96c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ad56b243ad71\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:32:21 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:21 user nova-compute[72418]: DEBUG nova.network.neutron [req-43d94829-4837-43b8-8b8b-7b71cbe4ef7d req-9ce8dc42-bb57-4ef4-8523-f3a69d4a3a03 service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Updated VIF entry in instance network info cache for port 84eb2df4-6995-47c5-bf0f-387932ece66d. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:32:21 user nova-compute[72418]: DEBUG nova.network.neutron [req-43d94829-4837-43b8-8b8b-7b71cbe4ef7d req-9ce8dc42-bb57-4ef4-8523-f3a69d4a3a03 service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Updating instance_info_cache with network_info: [{"id": "84eb2df4-6995-47c5-bf0f-387932ece66d", "address": "fa:16:3e:d2:b0:b4", "network": {"id": "15a49d9b-3c0d-449b-9473-29f219960e2c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c68622cd79472ba6ad14a6876aeaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84eb2df4-69", "ovs_interfaceid": "84eb2df4-6995-47c5-bf0f-387932ece66d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:32:21 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:21 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f435486-f387-48d9-877a-eb658eb5a043]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:32:21 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:21 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-43d94829-4837-43b8-8b8b-7b71cbe4ef7d req-9ce8dc42-bb57-4ef4-8523-f3a69d4a3a03 service nova] Releasing lock "refresh_cache-1c53f871-2be9-4119-b5c0-d5081e2f4388" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:32:21 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:21 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb48708-03b9-41d0-9b64-9dff716bd54a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:32:21 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[803286e7-b930-4838-b5a6-a53111df1ff1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:32:21 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-081d490a-576e-4e2d-9b04-1bf3e32d4c20 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Running cmd (subprocess): nvme version {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:21 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-081d490a-576e-4e2d-9b04-1bf3e32d4c20 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] 'nvme version' failed. Not Retrying. {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:32:21 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.nvmeof [None req-081d490a-576e-4e2d-9b04-1bf3e32d4c20 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] nvme not present on system {{(pid=72418) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 18:32:21 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:21 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:32:21 user nova-compute[72418]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 18:32:21 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[423a9e5a-6bc9-4a8e-8d70-ae268ae38b71]: (4, '') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:32:21 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-081d490a-576e-4e2d-9b04-1bf3e32d4c20 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72418) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 18:32:21 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-081d490a-576e-4e2d-9b04-1bf3e32d4c20 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 18:32:21 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-081d490a-576e-4e2d-9b04-1bf3e32d4c20 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] LIGHTOS: no hostnqn found. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 18:32:21 user nova-compute[72418]: DEBUG os_brick.utils [None req-081d490a-576e-4e2d-9b04-1bf3e32d4c20 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ad56b243ad71', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:32:21 user nova-compute[72418]: DEBUG nova.virt.block_device [None req-081d490a-576e-4e2d-9b04-1bf3e32d4c20 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Updating existing volume attachment record: 91c66495-cbcb-462d-a2a9-b7674e23b518 {{(pid=72418) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 18:32:22 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-dbba6326-7671-4777-96f5-71c5656039ee tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72418) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 18:32:22 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:32:23 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-dbba6326-7671-4777-96f5-71c5656039ee tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] COPY block job progress, current cursor: 17956864 final cursor: 75497472 {{(pid=72418) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 18:32:23 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-dbba6326-7671-4777-96f5-71c5656039ee tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72418) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 18:32:23 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-dbba6326-7671-4777-96f5-71c5656039ee tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 09 18:32:23 user nova-compute[72418]: DEBUG nova.privsep.utils [None req-dbba6326-7671-4777-96f5-71c5656039ee tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72418) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 18:32:23 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-dbba6326-7671-4777-96f5-71c5656039ee tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp6ypocy2u/2b7a7c07556341ce871b602cc25773f4.delta /opt/stack/data/nova/instances/snapshots/tmp6ypocy2u/2b7a7c07556341ce871b602cc25773f4 {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:24 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:32:24 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-dbba6326-7671-4777-96f5-71c5656039ee tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp6ypocy2u/2b7a7c07556341ce871b602cc25773f4.delta /opt/stack/data/nova/instances/snapshots/tmp6ypocy2u/2b7a7c07556341ce871b602cc25773f4" returned: 0 in 0.834s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:24 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-dbba6326-7671-4777-96f5-71c5656039ee tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Snapshot extracted, beginning image upload
Aug 09 18:32:24 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:32:27 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:32:27 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-dbba6326-7671-4777-96f5-71c5656039ee tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Snapshot image upload complete
Aug 09 18:32:27 user nova-compute[72418]: INFO nova.compute.manager [None req-dbba6326-7671-4777-96f5-71c5656039ee tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Took 7.30 seconds to snapshot the instance on the hypervisor.
Aug 09 18:32:27 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:32:28 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:32:29 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Acquiring lock "82d67874-5477-4554-bffc-2bf24eb28367" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:32:29 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Lock "82d67874-5477-4554-bffc-2bf24eb28367" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:32:29 user nova-compute[72418]: DEBUG nova.compute.manager [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Starting instance... {{(pid=72418) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 18:32:29 user nova-compute[72418]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691605934.8316803, 046617cf-13e5-44cf-9981-c1ae4ffd3851 => Stopped> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:32:29 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] VM Stopped (Lifecycle Event)
Aug 09 18:32:29 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:32:29 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:32:29 user nova-compute[72418]: DEBUG nova.compute.manager [None req-30a2b04a-c53c-44fe-8731-4a402e38dfff None None] [instance: 046617cf-13e5-44cf-9981-c1ae4ffd3851] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:32:29 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:32:29 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72418) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 18:32:29 user nova-compute[72418]: INFO nova.compute.claims [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Claim successful on node user
Aug 09 18:32:30 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:32:30 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:32:30 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.528s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:32:30 user nova-compute[72418]: DEBUG nova.compute.manager [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Start building networks asynchronously for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 18:32:30 user nova-compute[72418]: DEBUG nova.compute.manager [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Allocating IP information in the background. {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 18:32:30 user nova-compute[72418]: DEBUG nova.network.neutron [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] allocate_for_instance() {{(pid=72418) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 18:32:30 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 18:32:30 user nova-compute[72418]: DEBUG nova.compute.manager [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Start building block device mappings for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 18:32:30 user nova-compute[72418]: INFO nova.virt.block_device [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Booting with volume 4ef7ffde-331f-4d4a-868b-117c46dcdf81 at /dev/vda
Aug 09 18:32:30 user nova-compute[72418]: DEBUG os_brick.utils [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:32:30 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:30 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:30 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b11a50-13d6-4af9-8126-37ab91902fbd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ad56b243ad71\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:32:30 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:30 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:30 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc74928-1639-4bf3-9aad-33bfd72b6cf4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:32:30 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:30 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:30 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c7aa78-1286-4ac6-aa75-1e090046f2e0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:32:30 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0c1be8-817c-4731-8208-2ed103d5017c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:32:30 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Running cmd (subprocess): nvme version {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:30 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] 'nvme version' failed. Not Retrying. {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:32:30 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.nvmeof [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] nvme not present on system {{(pid=72418) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 18:32:30 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:30 user nova-compute[72418]: DEBUG nova.policy [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd01b87c4690c4a89949a5cce33bab9ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3f1359c67450181629511bf3d908a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72418) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 18:32:30 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:32:30 user nova-compute[72418]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 18:32:30 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a39396-2bfa-4e90-80c1-ccc8074cf25b]: (4, '') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:32:30 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72418) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 18:32:30 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 18:32:30 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] LIGHTOS: no hostnqn found. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 18:32:30 user nova-compute[72418]: DEBUG os_brick.utils [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ad56b243ad71', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:32:30 user nova-compute[72418]: DEBUG nova.virt.block_device [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Updating existing volume attachment record: 39de4c40-b2b2-4462-9bfd-791438ccb9ba {{(pid=72418) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 18:32:31 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-081d490a-576e-4e2d-9b04-1bf3e32d4c20 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Calling os-brick to attach iSCSI Volume {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 18:32:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-081d490a-576e-4e2d-9b04-1bf3e32d4c20 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ktoIFEGz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:32:31 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-081d490a-576e-4e2d-9b04-1bf3e32d4c20 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:32:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-081d490a-576e-4e2d-9b04-1bf3e32d4c20 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:32:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-081d490a-576e-4e2d-9b04-1bf3e32d4c20 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:32:31 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-081d490a-576e-4e2d-9b04-1bf3e32d4c20 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:32:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-081d490a-576e-4e2d-9b04-1bf3e32d4c20 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:32:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-081d490a-576e-4e2d-9b04-1bf3e32d4c20 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:32:31 user nova-compute[72418]: INFO os_brick.initiator.connectors.iscsi [None req-081d490a-576e-4e2d-9b04-1bf3e32d4c20 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 18:32:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 -p 172.16.0.220:3260 {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:31 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab3079b-2fb4-45f4-8b2d-893d02fc9710]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:32:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-081d490a-576e-4e2d-9b04-1bf3e32d4c20 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 18:32:31 user nova-compute[72418]:  {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:32:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 -p 172.16.0.220:3260 --interface default --op new {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:31 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce907cbc-e7d4-4ff5-8e42-0ac917ccc380]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177] added\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:32:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-081d490a-576e-4e2d-9b04-1bf3e32d4c20 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177] added
Aug 09 18:32:31 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:32:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:31 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee7fb45-a552-40e5-a8d0-1fc5f552883b]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:32:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-081d490a-576e-4e2d-9b04-1bf3e32d4c20 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:32:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:31 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cedb751-2c5d-4527-85da-2a791a9e350f]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:32:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-081d490a-576e-4e2d-9b04-1bf3e32d4c20 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:32:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ktoIFEGz {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ktoIFEGz" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:31 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc93ad91-3938-400f-beaa-6a4c270c3036]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:32:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-081d490a-576e-4e2d-9b04-1bf3e32d4c20 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ktoIFEGz'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:32:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:31 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca6dbfb-589e-4e79-b33c-b323219de859]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:32:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-081d490a-576e-4e2d-9b04-1bf3e32d4c20 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:32:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:31 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e243d64-a6af-42ec-ad74-1c84b562ce14]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:32:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-081d490a-576e-4e2d-9b04-1bf3e32d4c20 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:32:31 user nova-compute[72418]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 (non-flash)
Aug 09 18:32:31 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:32:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-081d490a-576e-4e2d-9b04-1bf3e32d4c20 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:32:31 user nova-compute[72418]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 (non-flash)
Aug 09 18:32:31 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:32:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 -p 172.16.0.220:3260 --login {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:31 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[700eecca-271b-4b4c-ae31-17cf6c560a66]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:32:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-081d490a-576e-4e2d-9b04-1bf3e32d4c20 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177, portal: 172.16.0.220,3260]
Aug 09 18:32:31 user nova-compute[72418]: Login to [iface: default, target: iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177, portal: 172.16.0.220,3260] successful.
Aug 09 18:32:31 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:32:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:31 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecfc597a-2c6a-4d1a-9491-24b23085ab67]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:32:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-081d490a-576e-4e2d-9b04-1bf3e32d4c20 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:32:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:31 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc232ab-35db-4891-9379-04c04bd0f519]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:32:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-081d490a-576e-4e2d-9b04-1bf3e32d4c20 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:32:31 user nova-compute[72418]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 (non-flash)
Aug 09 18:32:31 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:32:31 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:32:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-081d490a-576e-4e2d-9b04-1bf3e32d4c20 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:32:31 user nova-compute[72418]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 (non-flash)
Aug 09 18:32:31 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:32:31 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:32:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-081d490a-576e-4e2d-9b04-1bf3e32d4c20 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:32:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-081d490a-576e-4e2d-9b04-1bf3e32d4c20 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Connected to 172.16.0.220:3260 {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 18:32:31 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-081d490a-576e-4e2d-9b04-1bf3e32d4c20 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=72418) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 18:32:31 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-081d490a-576e-4e2d-9b04-1bf3e32d4c20 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72418) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 18:32:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:31 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87e81ae-4069-4a9f-9c88-6793bc5a575c]: (4, ('- - 0', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:32:31 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-081d490a-576e-4e2d-9b04-1bf3e32d4c20 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72418) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 18:32:31 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-081d490a-576e-4e2d-9b04-1bf3e32d4c20 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ktoIFEGz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 18:32:31 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:32:32 user nova-compute[72418]: DEBUG nova.network.neutron [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Successfully created port: b07016e4-a1a6-438c-86e0-9b29f347ece4 {{(pid=72418) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 18:32:32 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-081d490a-576e-4e2d-9b04-1bf3e32d4c20 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:32:32 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-081d490a-576e-4e2d-9b04-1bf3e32d4c20 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23438326266666138', 'path': '/dev/sdc'} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:32:32 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-081d490a-576e-4e2d-9b04-1bf3e32d4c20 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438326266666138', 'path': '/dev/sdc'} {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 18:32:32 user nova-compute[72418]: DEBUG nova.objects.instance [None req-081d490a-576e-4e2d-9b04-1bf3e32d4c20 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lazy-loading 'flavor' on Instance uuid 1c53f871-2be9-4119-b5c0-d5081e2f4388 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:32:32 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-081d490a-576e-4e2d-9b04-1bf3e32d4c20 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 18:32:32 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:32:32 user nova-compute[72418]:   <source dev="/dev/sdc"/>
Aug 09 18:32:32 user nova-compute[72418]:   <target dev="vdb" bus="virtio"/>
Aug 09 18:32:32 user nova-compute[72418]:   <serial>0ac09942-714e-4c2a-a7ad-637d87d7d177</serial>
Aug 09 18:32:32 user nova-compute[72418]: </disk>
Aug 09 18:32:32 user nova-compute[72418]:  {{(pid=72418) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 18:32:32 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:32:33 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-081d490a-576e-4e2d-9b04-1bf3e32d4c20 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:32:33 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-081d490a-576e-4e2d-9b04-1bf3e32d4c20 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:32:33 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-081d490a-576e-4e2d-9b04-1bf3e32d4c20 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] No VIF found with MAC fa:16:3e:d2:b0:b4, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:32:33 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-081d490a-576e-4e2d-9b04-1bf3e32d4c20 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "1c53f871-2be9-4119-b5c0-d5081e2f4388" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.042s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:32:33 user nova-compute[72418]: DEBUG nova.network.neutron [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Successfully created port: 6bc46fc5-0af5-4d39-8c6e-bbbfb093af14 {{(pid=72418) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 18:32:34 user nova-compute[72418]: INFO nova.compute.manager [None req-bafca438-d7fd-41e6-a472-12f13c203286 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Rescuing
Aug 09 18:32:34 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-bafca438-d7fd-41e6-a472-12f13c203286 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Acquiring lock "refresh_cache-1c53f871-2be9-4119-b5c0-d5081e2f4388" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:32:34 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-bafca438-d7fd-41e6-a472-12f13c203286 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Acquired lock "refresh_cache-1c53f871-2be9-4119-b5c0-d5081e2f4388" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:32:34 user nova-compute[72418]: DEBUG nova.network.neutron [None req-bafca438-d7fd-41e6-a472-12f13c203286 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:32:34 user nova-compute[72418]: DEBUG nova.network.neutron [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Successfully created port: bb529102-e1c1-4932-a2b2-8c411d29ca58 {{(pid=72418) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 18:32:34 user nova-compute[72418]: DEBUG nova.network.neutron [None req-bafca438-d7fd-41e6-a472-12f13c203286 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Updating instance_info_cache with network_info: [{"id": "84eb2df4-6995-47c5-bf0f-387932ece66d", "address": "fa:16:3e:d2:b0:b4", "network": {"id": "15a49d9b-3c0d-449b-9473-29f219960e2c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c68622cd79472ba6ad14a6876aeaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84eb2df4-69", "ovs_interfaceid": "84eb2df4-6995-47c5-bf0f-387932ece66d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:32:34 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-bafca438-d7fd-41e6-a472-12f13c203286 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Releasing lock "refresh_cache-1c53f871-2be9-4119-b5c0-d5081e2f4388" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:32:34 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:32:34 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:32:34 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:32:35 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:32:35 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:32:35 user nova-compute[72418]: DEBUG nova.compute.manager [req-481dbbf2-fa13-499e-bb2d-2050efd1866c req-53810cca-01fc-4a42-9108-c0e2f12d1531 service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Received event network-vif-unplugged-84eb2df4-6995-47c5-bf0f-387932ece66d {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:32:35 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-481dbbf2-fa13-499e-bb2d-2050efd1866c req-53810cca-01fc-4a42-9108-c0e2f12d1531 service nova] Acquiring lock "1c53f871-2be9-4119-b5c0-d5081e2f4388-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:32:35 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-481dbbf2-fa13-499e-bb2d-2050efd1866c req-53810cca-01fc-4a42-9108-c0e2f12d1531 service nova] Lock "1c53f871-2be9-4119-b5c0-d5081e2f4388-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:32:35 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-481dbbf2-fa13-499e-bb2d-2050efd1866c req-53810cca-01fc-4a42-9108-c0e2f12d1531 service nova] Lock "1c53f871-2be9-4119-b5c0-d5081e2f4388-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:32:35 user nova-compute[72418]: DEBUG nova.compute.manager [req-481dbbf2-fa13-499e-bb2d-2050efd1866c req-53810cca-01fc-4a42-9108-c0e2f12d1531 service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] No waiting events found dispatching network-vif-unplugged-84eb2df4-6995-47c5-bf0f-387932ece66d {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:32:35 user nova-compute[72418]: WARNING nova.compute.manager [req-481dbbf2-fa13-499e-bb2d-2050efd1866c req-53810cca-01fc-4a42-9108-c0e2f12d1531 service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Received unexpected event network-vif-unplugged-84eb2df4-6995-47c5-bf0f-387932ece66d for instance with vm_state active and task_state rescuing.
Aug 09 18:32:35 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:32:35 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Instance destroyed successfully.
Aug 09 18:32:35 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-bafca438-d7fd-41e6-a472-12f13c203286 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Attempting rescue
Aug 09 18:32:35 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-bafca438-d7fd-41e6-a472-12f13c203286 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72418) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 09 18:32:35 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-bafca438-d7fd-41e6-a472-12f13c203286 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Instance directory exists: not creating {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 18:32:35 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-bafca438-d7fd-41e6-a472-12f13c203286 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Creating image(s)
Aug 09 18:32:35 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-bafca438-d7fd-41e6-a472-12f13c203286 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Acquiring lock "/opt/stack/data/nova/instances/1c53f871-2be9-4119-b5c0-d5081e2f4388/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:32:35 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-bafca438-d7fd-41e6-a472-12f13c203286 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "/opt/stack/data/nova/instances/1c53f871-2be9-4119-b5c0-d5081e2f4388/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:32:35 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-bafca438-d7fd-41e6-a472-12f13c203286 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "/opt/stack/data/nova/instances/1c53f871-2be9-4119-b5c0-d5081e2f4388/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:32:35 user nova-compute[72418]: DEBUG nova.objects.instance [None req-bafca438-d7fd-41e6-a472-12f13c203286 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1c53f871-2be9-4119-b5c0-d5081e2f4388 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:32:35 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-bafca438-d7fd-41e6-a472-12f13c203286 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Acquiring lock "458773cfa7230b717e41c60277832e9f83806d71" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:32:35 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-bafca438-d7fd-41e6-a472-12f13c203286 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:32:35 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-bafca438-d7fd-41e6-a472-12f13c203286 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:35 user nova-compute[72418]: DEBUG nova.network.neutron [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Successfully created port: 3d432e6f-81b2-4c44-bb25-b3d35941a43c {{(pid=72418) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 18:32:35 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-bafca438-d7fd-41e6-a472-12f13c203286 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.150s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:35 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-bafca438-d7fd-41e6-a472-12f13c203286 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/1c53f871-2be9-4119-b5c0-d5081e2f4388/disk.rescue {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:35 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-bafca438-d7fd-41e6-a472-12f13c203286 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/1c53f871-2be9-4119-b5c0-d5081e2f4388/disk.rescue" returned: 0 in 0.060s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:35 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-bafca438-d7fd-41e6-a472-12f13c203286 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.216s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:32:35 user nova-compute[72418]: DEBUG nova.objects.instance [None req-bafca438-d7fd-41e6-a472-12f13c203286 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lazy-loading 'migration_context' on Instance uuid 1c53f871-2be9-4119-b5c0-d5081e2f4388 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:32:35 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-bafca438-d7fd-41e6-a472-12f13c203286 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Created local disks {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 18:32:35 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-bafca438-d7fd-41e6-a472-12f13c203286 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Start _get_guest_xml network_info=[{"id": "84eb2df4-6995-47c5-bf0f-387932ece66d", "address": "fa:16:3e:d2:b0:b4", "network": {"id": "15a49d9b-3c0d-449b-9473-29f219960e2c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "vif_mac": "fa:16:3e:d2:b0:b4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c68622cd79472ba6ad14a6876aeaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84eb2df4-69", "ovs_interfaceid": "84eb2df4-6995-47c5-bf0f-387932ece66d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 18:32:35 user nova-compute[72418]: DEBUG nova.objects.instance [None req-bafca438-d7fd-41e6-a472-12f13c203286 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lazy-loading 'resources' on Instance uuid 1c53f871-2be9-4119-b5c0-d5081e2f4388 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:32:35 user nova-compute[72418]: DEBUG nova.objects.instance [None req-bafca438-d7fd-41e6-a472-12f13c203286 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lazy-loading 'numa_topology' on Instance uuid 1c53f871-2be9-4119-b5c0-d5081e2f4388 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:32:35 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-bafca438-d7fd-41e6-a472-12f13c203286 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:32:35 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-bafca438-d7fd-41e6-a472-12f13c203286 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:32:35 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-bafca438-d7fd-41e6-a472-12f13c203286 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 18:32:35 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-bafca438-d7fd-41e6-a472-12f13c203286 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] CPU controller missing on host. {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 18:32:35 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-bafca438-d7fd-41e6-a472-12f13c203286 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 18:32:35 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-bafca438-d7fd-41e6-a472-12f13c203286 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] CPU controller found on host. {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 18:32:35 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-bafca438-d7fd-41e6-a472-12f13c203286 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72418) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 18:32:35 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-bafca438-d7fd-41e6-a472-12f13c203286 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T18:17:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 18:32:35 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-bafca438-d7fd-41e6-a472-12f13c203286 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Flavor limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 18:32:35 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-bafca438-d7fd-41e6-a472-12f13c203286 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Image limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 18:32:35 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-bafca438-d7fd-41e6-a472-12f13c203286 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Flavor pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 18:32:35 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-bafca438-d7fd-41e6-a472-12f13c203286 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Image pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 18:32:35 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-bafca438-d7fd-41e6-a472-12f13c203286 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 18:32:35 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-bafca438-d7fd-41e6-a472-12f13c203286 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 18:32:35 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-bafca438-d7fd-41e6-a472-12f13c203286 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 18:32:35 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-bafca438-d7fd-41e6-a472-12f13c203286 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Got 1 possible topologies {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 18:32:35 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-bafca438-d7fd-41e6-a472-12f13c203286 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 18:32:35 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-bafca438-d7fd-41e6-a472-12f13c203286 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 18:32:35 user nova-compute[72418]: DEBUG nova.objects.instance [None req-bafca438-d7fd-41e6-a472-12f13c203286 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1c53f871-2be9-4119-b5c0-d5081e2f4388 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:32:35 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-bafca438-d7fd-41e6-a472-12f13c203286 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:30:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-726518213',display_name='tempest-ServerRescueNegativeTestJSON-server-726518213',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-726518213',id=23,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYgqOVWyn0dFX4Ed9YyvsFFE+jrecgTvMY887w9viUNHXtdgFMObE/m2tkO2gGT++FsK404JHMmKjOtdQQqB+ock45M5UHDZsc/R8Qw31XfQ2breULNzs/hrNYbxNLAYg==',key_name='tempest-keypair-462614825',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:30:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5c68622cd79472ba6ad14a6876aeaea',ramdisk_id='',reservation_id='r-pyrt30fh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-326572915',owner_user_name='tempest-ServerRescueNegativeTestJSON-326572915-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:30:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3c4feb0a14841eeb757a79b6a05d1fa',uuid=1c53f871-2be9-4119-b5c0-d5081e2f4388,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84eb2df4-6995-47c5-bf0f-387932ece66d", "address": "fa:16:3e:d2:b0:b4", "network": {"id": "15a49d9b-3c0d-449b-9473-29f219960e2c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "vif_mac": "fa:16:3e:d2:b0:b4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c68622cd79472ba6ad14a6876aeaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84eb2df4-69", "ovs_interfaceid": "84eb2df4-6995-47c5-bf0f-387932ece66d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:32:35 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-bafca438-d7fd-41e6-a472-12f13c203286 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Converting VIF {"id": "84eb2df4-6995-47c5-bf0f-387932ece66d", "address": "fa:16:3e:d2:b0:b4", "network": {"id": "15a49d9b-3c0d-449b-9473-29f219960e2c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "vif_mac": "fa:16:3e:d2:b0:b4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c68622cd79472ba6ad14a6876aeaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84eb2df4-69", "ovs_interfaceid": "84eb2df4-6995-47c5-bf0f-387932ece66d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:32:35 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-bafca438-d7fd-41e6-a472-12f13c203286 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:b0:b4,bridge_name='br-int',has_traffic_filtering=True,id=84eb2df4-6995-47c5-bf0f-387932ece66d,network=Network(15a49d9b-3c0d-449b-9473-29f219960e2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84eb2df4-69') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:32:35 user nova-compute[72418]: DEBUG nova.objects.instance [None req-bafca438-d7fd-41e6-a472-12f13c203286 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lazy-loading 'pci_devices' on Instance uuid 1c53f871-2be9-4119-b5c0-d5081e2f4388 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:32:35 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-bafca438-d7fd-41e6-a472-12f13c203286 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] End _get_guest_xml xml=<domain type="kvm">
Aug 09 18:32:35 user nova-compute[72418]:   <uuid>1c53f871-2be9-4119-b5c0-d5081e2f4388</uuid>
Aug 09 18:32:35 user nova-compute[72418]:   <name>instance-00000017</name>
Aug 09 18:32:35 user nova-compute[72418]:   <memory>524288</memory>
Aug 09 18:32:35 user nova-compute[72418]:   <vcpu>1</vcpu>
Aug 09 18:32:35 user nova-compute[72418]:   <metadata>
Aug 09 18:32:35 user nova-compute[72418]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:32:35 user nova-compute[72418]:       <nova:package version="0.0.0"/>
Aug 09 18:32:35 user nova-compute[72418]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-726518213</nova:name>
Aug 09 18:32:35 user nova-compute[72418]:       <nova:creationTime>2023-08-09 18:32:35</nova:creationTime>
Aug 09 18:32:35 user nova-compute[72418]:       <nova:flavor name="m1.tiny">
Aug 09 18:32:35 user nova-compute[72418]:         <nova:memory>512</nova:memory>
Aug 09 18:32:35 user nova-compute[72418]:         <nova:disk>1</nova:disk>
Aug 09 18:32:35 user nova-compute[72418]:         <nova:swap>0</nova:swap>
Aug 09 18:32:35 user nova-compute[72418]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:32:35 user nova-compute[72418]:         <nova:vcpus>1</nova:vcpus>
Aug 09 18:32:35 user nova-compute[72418]:       </nova:flavor>
Aug 09 18:32:35 user nova-compute[72418]:       <nova:owner>
Aug 09 18:32:35 user nova-compute[72418]:         <nova:user uuid="b3c4feb0a14841eeb757a79b6a05d1fa">tempest-ServerRescueNegativeTestJSON-326572915-project-member</nova:user>
Aug 09 18:32:35 user nova-compute[72418]:         <nova:project uuid="b5c68622cd79472ba6ad14a6876aeaea">tempest-ServerRescueNegativeTestJSON-326572915</nova:project>
Aug 09 18:32:35 user nova-compute[72418]:       </nova:owner>
Aug 09 18:32:35 user nova-compute[72418]:       <nova:root type="image" uuid="8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e"/>
Aug 09 18:32:35 user nova-compute[72418]:       <nova:ports>
Aug 09 18:32:35 user nova-compute[72418]:         <nova:port uuid="84eb2df4-6995-47c5-bf0f-387932ece66d">
Aug 09 18:32:35 user nova-compute[72418]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 09 18:32:35 user nova-compute[72418]:         </nova:port>
Aug 09 18:32:35 user nova-compute[72418]:       </nova:ports>
Aug 09 18:32:35 user nova-compute[72418]:     </nova:instance>
Aug 09 18:32:35 user nova-compute[72418]:   </metadata>
Aug 09 18:32:35 user nova-compute[72418]:   <sysinfo type="smbios">
Aug 09 18:32:35 user nova-compute[72418]:     <system>
Aug 09 18:32:35 user nova-compute[72418]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 18:32:35 user nova-compute[72418]:       <entry name="product">OpenStack Nova</entry>
Aug 09 18:32:35 user nova-compute[72418]:       <entry name="version">0.0.0</entry>
Aug 09 18:32:35 user nova-compute[72418]:       <entry name="serial">1c53f871-2be9-4119-b5c0-d5081e2f4388</entry>
Aug 09 18:32:35 user nova-compute[72418]:       <entry name="uuid">1c53f871-2be9-4119-b5c0-d5081e2f4388</entry>
Aug 09 18:32:35 user nova-compute[72418]:       <entry name="family">Virtual Machine</entry>
Aug 09 18:32:35 user nova-compute[72418]:     </system>
Aug 09 18:32:35 user nova-compute[72418]:   </sysinfo>
Aug 09 18:32:35 user nova-compute[72418]:   <os>
Aug 09 18:32:35 user nova-compute[72418]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 18:32:35 user nova-compute[72418]:     <smbios mode="sysinfo"/>
Aug 09 18:32:35 user nova-compute[72418]:   </os>
Aug 09 18:32:35 user nova-compute[72418]:   <features>
Aug 09 18:32:35 user nova-compute[72418]:     <acpi/>
Aug 09 18:32:35 user nova-compute[72418]:     <apic/>
Aug 09 18:32:35 user nova-compute[72418]:     <vmcoreinfo/>
Aug 09 18:32:35 user nova-compute[72418]:   </features>
Aug 09 18:32:35 user nova-compute[72418]:   <clock offset="utc">
Aug 09 18:32:35 user nova-compute[72418]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 18:32:35 user nova-compute[72418]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 18:32:35 user nova-compute[72418]:     <timer name="hpet" present="no"/>
Aug 09 18:32:35 user nova-compute[72418]:   </clock>
Aug 09 18:32:35 user nova-compute[72418]:   <cpu mode="custom" match="exact">
Aug 09 18:32:35 user nova-compute[72418]:     <model>Nehalem</model>
Aug 09 18:32:35 user nova-compute[72418]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 18:32:35 user nova-compute[72418]:   </cpu>
Aug 09 18:32:35 user nova-compute[72418]:   <devices>
Aug 09 18:32:35 user nova-compute[72418]:     <disk type="file" device="disk">
Aug 09 18:32:35 user nova-compute[72418]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 18:32:35 user nova-compute[72418]:       <source file="/opt/stack/data/nova/instances/1c53f871-2be9-4119-b5c0-d5081e2f4388/disk.rescue"/>
Aug 09 18:32:35 user nova-compute[72418]:       <target dev="vda" bus="virtio"/>
Aug 09 18:32:35 user nova-compute[72418]:     </disk>
Aug 09 18:32:35 user nova-compute[72418]:     <disk type="file" device="disk">
Aug 09 18:32:35 user nova-compute[72418]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 18:32:35 user nova-compute[72418]:       <source file="/opt/stack/data/nova/instances/1c53f871-2be9-4119-b5c0-d5081e2f4388/disk"/>
Aug 09 18:32:35 user nova-compute[72418]:       <target dev="vdb" bus="virtio"/>
Aug 09 18:32:35 user nova-compute[72418]:     </disk>
Aug 09 18:32:35 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:32:35 user nova-compute[72418]:       <mac address="fa:16:3e:d2:b0:b4"/>
Aug 09 18:32:35 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:32:35 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:32:35 user nova-compute[72418]:       <target dev="tap84eb2df4-69"/>
Aug 09 18:32:35 user nova-compute[72418]:     </interface>
Aug 09 18:32:35 user nova-compute[72418]:     <serial type="pty">
Aug 09 18:32:35 user nova-compute[72418]:       <log file="/opt/stack/data/nova/instances/1c53f871-2be9-4119-b5c0-d5081e2f4388/console.log" append="off"/>
Aug 09 18:32:35 user nova-compute[72418]:     </serial>
Aug 09 18:32:35 user nova-compute[72418]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 18:32:35 user nova-compute[72418]:     <video>
Aug 09 18:32:35 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:32:35 user nova-compute[72418]:     </video>
Aug 09 18:32:35 user nova-compute[72418]:     <rng model="virtio">
Aug 09 18:32:35 user nova-compute[72418]:       <backend model="random">/dev/urandom</backend>
Aug 09 18:32:35 user nova-compute[72418]:     </rng>
Aug 09 18:32:35 user nova-compute[72418]:     <controller type="usb" index="0" model="none"/>
Aug 09 18:32:35 user nova-compute[72418]:     <memballoon model="virtio">
Aug 09 18:32:35 user nova-compute[72418]:       <stats period="10"/>
Aug 09 18:32:35 user nova-compute[72418]:     </memballoon>
Aug 09 18:32:35 user nova-compute[72418]:   </devices>
Aug 09 18:32:35 user nova-compute[72418]: </domain>
Aug 09 18:32:35 user nova-compute[72418]:  {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 18:32:36 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Instance destroyed successfully.
Aug 09 18:32:36 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-bafca438-d7fd-41e6-a472-12f13c203286 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:32:36 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-bafca438-d7fd-41e6-a472-12f13c203286 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:32:36 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-bafca438-d7fd-41e6-a472-12f13c203286 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] No VIF found with MAC fa:16:3e:d2:b0:b4, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:32:36 user nova-compute[72418]: DEBUG nova.network.neutron [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Successfully created port: 3cd5a4d7-5e70-42d3-b3bd-8d9262131f59 {{(pid=72418) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 18:32:37 user nova-compute[72418]: DEBUG nova.compute.manager [req-1858efb1-7f09-427d-9b10-cf60370f15d3 req-17b86b53-5b52-4cd3-9ed7-0b5e860a935a service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Received event network-vif-plugged-84eb2df4-6995-47c5-bf0f-387932ece66d {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:32:37 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-1858efb1-7f09-427d-9b10-cf60370f15d3 req-17b86b53-5b52-4cd3-9ed7-0b5e860a935a service nova] Acquiring lock "1c53f871-2be9-4119-b5c0-d5081e2f4388-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:32:37 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-1858efb1-7f09-427d-9b10-cf60370f15d3 req-17b86b53-5b52-4cd3-9ed7-0b5e860a935a service nova] Lock "1c53f871-2be9-4119-b5c0-d5081e2f4388-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:32:37 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-1858efb1-7f09-427d-9b10-cf60370f15d3 req-17b86b53-5b52-4cd3-9ed7-0b5e860a935a service nova] Lock "1c53f871-2be9-4119-b5c0-d5081e2f4388-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:32:37 user nova-compute[72418]: DEBUG nova.compute.manager [req-1858efb1-7f09-427d-9b10-cf60370f15d3 req-17b86b53-5b52-4cd3-9ed7-0b5e860a935a service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] No waiting events found dispatching network-vif-plugged-84eb2df4-6995-47c5-bf0f-387932ece66d {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:32:37 user nova-compute[72418]: WARNING nova.compute.manager [req-1858efb1-7f09-427d-9b10-cf60370f15d3 req-17b86b53-5b52-4cd3-9ed7-0b5e860a935a service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Received unexpected event network-vif-plugged-84eb2df4-6995-47c5-bf0f-387932ece66d for instance with vm_state active and task_state rescuing.
Aug 09 18:32:37 user nova-compute[72418]: DEBUG nova.network.neutron [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Successfully updated port: b07016e4-a1a6-438c-86e0-9b29f347ece4 {{(pid=72418) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 18:32:37 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:32:37 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:32:37 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:32:37 user nova-compute[72418]: DEBUG nova.compute.manager [req-ed7f60c8-f0e9-4a87-8e10-870d806bf978 req-3ed32153-8a0e-45c4-9a2b-274c3472e4ee service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received event network-changed-b07016e4-a1a6-438c-86e0-9b29f347ece4 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:32:37 user nova-compute[72418]: DEBUG nova.compute.manager [req-ed7f60c8-f0e9-4a87-8e10-870d806bf978 req-3ed32153-8a0e-45c4-9a2b-274c3472e4ee service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Refreshing instance network info cache due to event network-changed-b07016e4-a1a6-438c-86e0-9b29f347ece4. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:32:37 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-ed7f60c8-f0e9-4a87-8e10-870d806bf978 req-3ed32153-8a0e-45c4-9a2b-274c3472e4ee service nova] Acquiring lock "refresh_cache-82d67874-5477-4554-bffc-2bf24eb28367" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:32:37 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-ed7f60c8-f0e9-4a87-8e10-870d806bf978 req-3ed32153-8a0e-45c4-9a2b-274c3472e4ee service nova] Acquired lock "refresh_cache-82d67874-5477-4554-bffc-2bf24eb28367" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:32:37 user nova-compute[72418]: DEBUG nova.network.neutron [req-ed7f60c8-f0e9-4a87-8e10-870d806bf978 req-3ed32153-8a0e-45c4-9a2b-274c3472e4ee service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Refreshing network info cache for port b07016e4-a1a6-438c-86e0-9b29f347ece4 {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:32:37 user nova-compute[72418]: DEBUG nova.network.neutron [req-ed7f60c8-f0e9-4a87-8e10-870d806bf978 req-3ed32153-8a0e-45c4-9a2b-274c3472e4ee service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Instance cache missing network info. {{(pid=72418) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 18:32:37 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:32:37 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:32:37 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:32:37 user nova-compute[72418]: DEBUG nova.network.neutron [req-ed7f60c8-f0e9-4a87-8e10-870d806bf978 req-3ed32153-8a0e-45c4-9a2b-274c3472e4ee service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:32:38 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-ed7f60c8-f0e9-4a87-8e10-870d806bf978 req-3ed32153-8a0e-45c4-9a2b-274c3472e4ee service nova] Releasing lock "refresh_cache-82d67874-5477-4554-bffc-2bf24eb28367" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:32:38 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Acquiring lock "2c9e974b-b993-4f4e-9446-14941c39f109" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:32:38 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "2c9e974b-b993-4f4e-9446-14941c39f109" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:32:38 user nova-compute[72418]: DEBUG nova.compute.manager [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Starting instance... {{(pid=72418) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 18:32:38 user nova-compute[72418]: DEBUG nova.network.neutron [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Successfully updated port: a5c55350-ec71-4b02-90cc-ebc30e6211e5 {{(pid=72418) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 18:32:38 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:32:38 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:32:38 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72418) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 18:32:38 user nova-compute[72418]: INFO nova.compute.claims [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Claim successful on node user
Aug 09 18:32:39 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:32:39 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:32:39 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.582s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:32:39 user nova-compute[72418]: DEBUG nova.compute.manager [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Start building networks asynchronously for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 18:32:39 user nova-compute[72418]: DEBUG nova.compute.manager [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Allocating IP information in the background. {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 18:32:39 user nova-compute[72418]: DEBUG nova.network.neutron [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] allocate_for_instance() {{(pid=72418) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 18:32:39 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 18:32:39 user nova-compute[72418]: DEBUG nova.compute.manager [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Start building block device mappings for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 18:32:39 user nova-compute[72418]: DEBUG nova.compute.manager [req-7ba8f197-ea98-45c0-ab9c-d6ace2e56f57 req-2bb135c4-9c6d-4b37-b6aa-add357fda983 service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Received event network-vif-plugged-84eb2df4-6995-47c5-bf0f-387932ece66d {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:32:39 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-7ba8f197-ea98-45c0-ab9c-d6ace2e56f57 req-2bb135c4-9c6d-4b37-b6aa-add357fda983 service nova] Acquiring lock "1c53f871-2be9-4119-b5c0-d5081e2f4388-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:32:39 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-7ba8f197-ea98-45c0-ab9c-d6ace2e56f57 req-2bb135c4-9c6d-4b37-b6aa-add357fda983 service nova] Lock "1c53f871-2be9-4119-b5c0-d5081e2f4388-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:32:39 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-7ba8f197-ea98-45c0-ab9c-d6ace2e56f57 req-2bb135c4-9c6d-4b37-b6aa-add357fda983 service nova] Lock "1c53f871-2be9-4119-b5c0-d5081e2f4388-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:32:39 user nova-compute[72418]: DEBUG nova.compute.manager [req-7ba8f197-ea98-45c0-ab9c-d6ace2e56f57 req-2bb135c4-9c6d-4b37-b6aa-add357fda983 service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] No waiting events found dispatching network-vif-plugged-84eb2df4-6995-47c5-bf0f-387932ece66d {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:32:39 user nova-compute[72418]: WARNING nova.compute.manager [req-7ba8f197-ea98-45c0-ab9c-d6ace2e56f57 req-2bb135c4-9c6d-4b37-b6aa-add357fda983 service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Received unexpected event network-vif-plugged-84eb2df4-6995-47c5-bf0f-387932ece66d for instance with vm_state active and task_state rescuing.
Aug 09 18:32:39 user nova-compute[72418]: DEBUG nova.compute.manager [req-7ba8f197-ea98-45c0-ab9c-d6ace2e56f57 req-2bb135c4-9c6d-4b37-b6aa-add357fda983 service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Received event network-vif-plugged-84eb2df4-6995-47c5-bf0f-387932ece66d {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:32:39 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-7ba8f197-ea98-45c0-ab9c-d6ace2e56f57 req-2bb135c4-9c6d-4b37-b6aa-add357fda983 service nova] Acquiring lock "1c53f871-2be9-4119-b5c0-d5081e2f4388-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:32:39 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-7ba8f197-ea98-45c0-ab9c-d6ace2e56f57 req-2bb135c4-9c6d-4b37-b6aa-add357fda983 service nova] Lock "1c53f871-2be9-4119-b5c0-d5081e2f4388-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:32:39 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-7ba8f197-ea98-45c0-ab9c-d6ace2e56f57 req-2bb135c4-9c6d-4b37-b6aa-add357fda983 service nova] Lock "1c53f871-2be9-4119-b5c0-d5081e2f4388-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:32:39 user nova-compute[72418]: DEBUG nova.compute.manager [req-7ba8f197-ea98-45c0-ab9c-d6ace2e56f57 req-2bb135c4-9c6d-4b37-b6aa-add357fda983 service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] No waiting events found dispatching network-vif-plugged-84eb2df4-6995-47c5-bf0f-387932ece66d {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:32:39 user nova-compute[72418]: WARNING nova.compute.manager [req-7ba8f197-ea98-45c0-ab9c-d6ace2e56f57 req-2bb135c4-9c6d-4b37-b6aa-add357fda983 service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Received unexpected event network-vif-plugged-84eb2df4-6995-47c5-bf0f-387932ece66d for instance with vm_state active and task_state rescuing.
Aug 09 18:32:39 user nova-compute[72418]: DEBUG nova.policy [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2af66759bfa54ffba6174c4f95a83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce18df915bca48109597ad4aa8f1d116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72418) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 18:32:39 user nova-compute[72418]: DEBUG nova.compute.manager [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Start spawning the instance on the hypervisor. {{(pid=72418) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 18:32:39 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Creating instance directory {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 18:32:39 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Creating image(s)
Aug 09 18:32:39 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Acquiring lock "/opt/stack/data/nova/instances/2c9e974b-b993-4f4e-9446-14941c39f109/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:32:39 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "/opt/stack/data/nova/instances/2c9e974b-b993-4f4e-9446-14941c39f109/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:32:39 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "/opt/stack/data/nova/instances/2c9e974b-b993-4f4e-9446-14941c39f109/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:32:39 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:39 user nova-compute[72418]: DEBUG nova.network.neutron [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Successfully updated port: 4d58b14a-e8d0-4d9d-a712-8bfaa2b74bfc {{(pid=72418) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 18:32:39 user nova-compute[72418]: DEBUG nova.compute.manager [req-cfdecc91-b81d-4945-bdc3-17ab68347d76 req-8340cc2e-dbe9-42a9-bcf4-5ffc3815dce3 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received event network-changed-a5c55350-ec71-4b02-90cc-ebc30e6211e5 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:32:39 user nova-compute[72418]: DEBUG nova.compute.manager [req-cfdecc91-b81d-4945-bdc3-17ab68347d76 req-8340cc2e-dbe9-42a9-bcf4-5ffc3815dce3 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Refreshing instance network info cache due to event network-changed-a5c55350-ec71-4b02-90cc-ebc30e6211e5. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:32:39 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-cfdecc91-b81d-4945-bdc3-17ab68347d76 req-8340cc2e-dbe9-42a9-bcf4-5ffc3815dce3 service nova] Acquiring lock "refresh_cache-82d67874-5477-4554-bffc-2bf24eb28367" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:32:39 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-cfdecc91-b81d-4945-bdc3-17ab68347d76 req-8340cc2e-dbe9-42a9-bcf4-5ffc3815dce3 service nova] Acquired lock "refresh_cache-82d67874-5477-4554-bffc-2bf24eb28367" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:32:39 user nova-compute[72418]: DEBUG nova.network.neutron [req-cfdecc91-b81d-4945-bdc3-17ab68347d76 req-8340cc2e-dbe9-42a9-bcf4-5ffc3815dce3 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Refreshing network info cache for port a5c55350-ec71-4b02-90cc-ebc30e6211e5 {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:32:39 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.164s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:39 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Acquiring lock "458773cfa7230b717e41c60277832e9f83806d71" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:32:39 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:32:39 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:39 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.134s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:39 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/2c9e974b-b993-4f4e-9446-14941c39f109/disk 1073741824 {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:39 user nova-compute[72418]: DEBUG nova.network.neutron [req-cfdecc91-b81d-4945-bdc3-17ab68347d76 req-8340cc2e-dbe9-42a9-bcf4-5ffc3815dce3 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Instance cache missing network info. {{(pid=72418) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 18:32:39 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/2c9e974b-b993-4f4e-9446-14941c39f109/disk 1073741824" returned: 0 in 0.073s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:39 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:32:39 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:39 user nova-compute[72418]: DEBUG nova.compute.manager [None req-bafca438-d7fd-41e6-a472-12f13c203286 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:32:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:32:39 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Removed pending event for 1c53f871-2be9-4119-b5c0-d5081e2f4388 due to event {{(pid=72418) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 18:32:39 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605959.8675308, 1c53f871-2be9-4119-b5c0-d5081e2f4388 => Resumed> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:32:39 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] VM Resumed (Lifecycle Event)
Aug 09 18:32:39 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:32:39 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:32:40 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 09 18:32:40 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605959.8683193, 1c53f871-2be9-4119-b5c0-d5081e2f4388 => Started> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:32:40 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] VM Started (Lifecycle Event)
Aug 09 18:32:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.156s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:40 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2c9e974b-b993-4f4e-9446-14941c39f109/disk. size=1073741824 {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 18:32:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9e974b-b993-4f4e-9446-14941c39f109/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:40 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:32:40 user nova-compute[72418]: DEBUG nova.network.neutron [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Successfully created port: 1fa6e320-1b1b-41dc-8204-a7bed1172292 {{(pid=72418) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 18:32:40 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:32:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9e974b-b993-4f4e-9446-14941c39f109/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:40 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Cannot resize image /opt/stack/data/nova/instances/2c9e974b-b993-4f4e-9446-14941c39f109/disk to a smaller size. {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 18:32:40 user nova-compute[72418]: DEBUG nova.objects.instance [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lazy-loading 'migration_context' on Instance uuid 2c9e974b-b993-4f4e-9446-14941c39f109 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:32:40 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Created local disks {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 18:32:40 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Ensure instance console log exists: /opt/stack/data/nova/instances/2c9e974b-b993-4f4e-9446-14941c39f109/console.log {{(pid=72418) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 18:32:40 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:32:40 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:32:40 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:32:40 user nova-compute[72418]: DEBUG nova.network.neutron [req-cfdecc91-b81d-4945-bdc3-17ab68347d76 req-8340cc2e-dbe9-42a9-bcf4-5ffc3815dce3 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:32:40 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-cfdecc91-b81d-4945-bdc3-17ab68347d76 req-8340cc2e-dbe9-42a9-bcf4-5ffc3815dce3 service nova] Releasing lock "refresh_cache-82d67874-5477-4554-bffc-2bf24eb28367" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:32:40 user nova-compute[72418]: DEBUG nova.compute.manager [req-cfdecc91-b81d-4945-bdc3-17ab68347d76 req-8340cc2e-dbe9-42a9-bcf4-5ffc3815dce3 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received event network-changed-4d58b14a-e8d0-4d9d-a712-8bfaa2b74bfc {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:32:40 user nova-compute[72418]: DEBUG nova.compute.manager [req-cfdecc91-b81d-4945-bdc3-17ab68347d76 req-8340cc2e-dbe9-42a9-bcf4-5ffc3815dce3 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Refreshing instance network info cache due to event network-changed-4d58b14a-e8d0-4d9d-a712-8bfaa2b74bfc. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:32:40 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-cfdecc91-b81d-4945-bdc3-17ab68347d76 req-8340cc2e-dbe9-42a9-bcf4-5ffc3815dce3 service nova] Acquiring lock "refresh_cache-82d67874-5477-4554-bffc-2bf24eb28367" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:32:40 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-cfdecc91-b81d-4945-bdc3-17ab68347d76 req-8340cc2e-dbe9-42a9-bcf4-5ffc3815dce3 service nova] Acquired lock "refresh_cache-82d67874-5477-4554-bffc-2bf24eb28367" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:32:40 user nova-compute[72418]: DEBUG nova.network.neutron [req-cfdecc91-b81d-4945-bdc3-17ab68347d76 req-8340cc2e-dbe9-42a9-bcf4-5ffc3815dce3 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Refreshing network info cache for port 4d58b14a-e8d0-4d9d-a712-8bfaa2b74bfc {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:32:40 user nova-compute[72418]: INFO nova.virt.block_device [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Booting with volume c30415ea-87a0-40ae-8f0c-7f5fbec605ab at /dev/vdb
Aug 09 18:32:40 user nova-compute[72418]: DEBUG os_brick.utils [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:32:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:40 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b66370-a201-46d1-b085-89c39ee156e5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ad56b243ad71\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:32:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:40 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[3073399f-3154-45a5-a686-4de7f20144cb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:32:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[54cadcc8-79ac-4416-8351-83e2c04788d1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG nova.network.neutron [req-cfdecc91-b81d-4945-bdc3-17ab68347d76 req-8340cc2e-dbe9-42a9-bcf4-5ffc3815dce3 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Instance cache missing network info. {{(pid=72418) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[5271fcba-feb4-4479-bd6c-46bcf2585d04]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Running cmd (subprocess): nvme version {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] 'nvme version' failed. Not Retrying. {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.nvmeof [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] nvme not present on system {{(pid=72418) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:32:41 user nova-compute[72418]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 18:32:41 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[589df418-7928-4f40-9276-20e1a064c5e7]: (4, '') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72418) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] LIGHTOS: no hostnqn found. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG os_brick.utils [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] <== get_connector_properties: return (194ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ad56b243ad71', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG nova.virt.block_device [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Updating existing volume attachment record: cefd4745-22e0-4eb6-bc25-9c972e213d23 {{(pid=72418) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG nova.network.neutron [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Successfully updated port: 1fa6e320-1b1b-41dc-8204-a7bed1172292 {{(pid=72418) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Acquiring lock "refresh_cache-2c9e974b-b993-4f4e-9446-14941c39f109" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Acquired lock "refresh_cache-2c9e974b-b993-4f4e-9446-14941c39f109" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG nova.network.neutron [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG nova.network.neutron [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Instance cache missing network info. {{(pid=72418) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG nova.compute.manager [req-fc9b0723-dbbc-49c1-a713-384393586003 req-11fc7761-245e-437a-beeb-6151faf9db43 service nova] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Received event network-changed-1fa6e320-1b1b-41dc-8204-a7bed1172292 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG nova.compute.manager [req-fc9b0723-dbbc-49c1-a713-384393586003 req-11fc7761-245e-437a-beeb-6151faf9db43 service nova] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Refreshing instance network info cache due to event network-changed-1fa6e320-1b1b-41dc-8204-a7bed1172292. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-fc9b0723-dbbc-49c1-a713-384393586003 req-11fc7761-245e-437a-beeb-6151faf9db43 service nova] Acquiring lock "refresh_cache-2c9e974b-b993-4f4e-9446-14941c39f109" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG nova.network.neutron [req-cfdecc91-b81d-4945-bdc3-17ab68347d76 req-8340cc2e-dbe9-42a9-bcf4-5ffc3815dce3 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-cfdecc91-b81d-4945-bdc3-17ab68347d76 req-8340cc2e-dbe9-42a9-bcf4-5ffc3815dce3 service nova] Releasing lock "refresh_cache-82d67874-5477-4554-bffc-2bf24eb28367" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG nova.network.neutron [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Successfully updated port: 6bc46fc5-0af5-4d39-8c6e-bbbfb093af14 {{(pid=72418) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG nova.compute.manager [req-95607f1b-cd86-434d-9e95-667a16385aea req-ccd9e222-ebce-49c5-8bb1-78b1720ac983 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received event network-changed-6bc46fc5-0af5-4d39-8c6e-bbbfb093af14 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG nova.compute.manager [req-95607f1b-cd86-434d-9e95-667a16385aea req-ccd9e222-ebce-49c5-8bb1-78b1720ac983 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Refreshing instance network info cache due to event network-changed-6bc46fc5-0af5-4d39-8c6e-bbbfb093af14. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-95607f1b-cd86-434d-9e95-667a16385aea req-ccd9e222-ebce-49c5-8bb1-78b1720ac983 service nova] Acquiring lock "refresh_cache-82d67874-5477-4554-bffc-2bf24eb28367" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-95607f1b-cd86-434d-9e95-667a16385aea req-ccd9e222-ebce-49c5-8bb1-78b1720ac983 service nova] Acquired lock "refresh_cache-82d67874-5477-4554-bffc-2bf24eb28367" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG nova.network.neutron [req-95607f1b-cd86-434d-9e95-667a16385aea req-ccd9e222-ebce-49c5-8bb1-78b1720ac983 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Refreshing network info cache for port 6bc46fc5-0af5-4d39-8c6e-bbbfb093af14 {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG nova.network.neutron [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Updating instance_info_cache with network_info: [{"id": "1fa6e320-1b1b-41dc-8204-a7bed1172292", "address": "fa:16:3e:06:d3:3a", "network": {"id": "0fbd02ef-7c74-46c2-a09c-3b69be222ffa", "bridge": "br-int", "label": "tempest-TestStampPattern-85008345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce18df915bca48109597ad4aa8f1d116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fa6e320-1b", "ovs_interfaceid": "1fa6e320-1b1b-41dc-8204-a7bed1172292", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Releasing lock "refresh_cache-2c9e974b-b993-4f4e-9446-14941c39f109" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG nova.compute.manager [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Instance network_info: |[{"id": "1fa6e320-1b1b-41dc-8204-a7bed1172292", "address": "fa:16:3e:06:d3:3a", "network": {"id": "0fbd02ef-7c74-46c2-a09c-3b69be222ffa", "bridge": "br-int", "label": "tempest-TestStampPattern-85008345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce18df915bca48109597ad4aa8f1d116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fa6e320-1b", "ovs_interfaceid": "1fa6e320-1b1b-41dc-8204-a7bed1172292", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-fc9b0723-dbbc-49c1-a713-384393586003 req-11fc7761-245e-437a-beeb-6151faf9db43 service nova] Acquired lock "refresh_cache-2c9e974b-b993-4f4e-9446-14941c39f109" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG nova.network.neutron [req-fc9b0723-dbbc-49c1-a713-384393586003 req-11fc7761-245e-437a-beeb-6151faf9db43 service nova] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Refreshing network info cache for port 1fa6e320-1b1b-41dc-8204-a7bed1172292 {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Start _get_guest_xml network_info=[{"id": "1fa6e320-1b1b-41dc-8204-a7bed1172292", "address": "fa:16:3e:06:d3:3a", "network": {"id": "0fbd02ef-7c74-46c2-a09c-3b69be222ffa", "bridge": "br-int", "label": "tempest-TestStampPattern-85008345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce18df915bca48109597ad4aa8f1d116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fa6e320-1b", "ovs_interfaceid": "1fa6e320-1b1b-41dc-8204-a7bed1172292", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 18:32:41 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:32:41 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:32:41 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] CPU controller missing on host. {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] CPU controller found on host. {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72418) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T18:17:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Flavor limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Image limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Flavor pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Image pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Got 1 possible topologies {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:32:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-564523231',display_name='tempest-TestStampPattern-server-564523231',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-564523231',id=26,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyuC2STmNW21KgmVvu2UdySlXVI+0J2CQB6cC/06BFGS91M3K5pktxtEHOvDqMzVGj1CpM11aZmLQ8ny2sqKin/VSPS9fza7lm5UGhSckLWpV1uBCIlOPx80Bbo9A16oA==',key_name='tempest-TestStampPattern-872776389',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce18df915bca48109597ad4aa8f1d116',ramdisk_id='',reservation_id='r-9tx2gsbh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1349806997',owner_user_name='tempest-TestStampPattern-1349806997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:32:39Z,user_data=None,user_id='2af66759bfa54ffba6174c4f95a83789',uuid=2c9e974b-b993-4f4e-9446-14941c39f109,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1fa6e320-1b1b-41dc-8204-a7bed1172292", "address": "fa:16:3e:06:d3:3a", "network": {"id": "0fbd02ef-7c74-46c2-a09c-3b69be222ffa", "bridge": "br-int", "label": "tempest-TestStampPattern-85008345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce18df915bca48109597ad4aa8f1d116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fa6e320-1b", "ovs_interfaceid": "1fa6e320-1b1b-41dc-8204-a7bed1172292", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Converting VIF {"id": "1fa6e320-1b1b-41dc-8204-a7bed1172292", "address": "fa:16:3e:06:d3:3a", "network": {"id": "0fbd02ef-7c74-46c2-a09c-3b69be222ffa", "bridge": "br-int", "label": "tempest-TestStampPattern-85008345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce18df915bca48109597ad4aa8f1d116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fa6e320-1b", "ovs_interfaceid": "1fa6e320-1b1b-41dc-8204-a7bed1172292", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:d3:3a,bridge_name='br-int',has_traffic_filtering=True,id=1fa6e320-1b1b-41dc-8204-a7bed1172292,network=Network(0fbd02ef-7c74-46c2-a09c-3b69be222ffa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fa6e320-1b') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG nova.objects.instance [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lazy-loading 'pci_devices' on Instance uuid 2c9e974b-b993-4f4e-9446-14941c39f109 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG nova.network.neutron [req-95607f1b-cd86-434d-9e95-667a16385aea req-ccd9e222-ebce-49c5-8bb1-78b1720ac983 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Instance cache missing network info. {{(pid=72418) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] End _get_guest_xml xml=<domain type="kvm">
Aug 09 18:32:41 user nova-compute[72418]:   <uuid>2c9e974b-b993-4f4e-9446-14941c39f109</uuid>
Aug 09 18:32:41 user nova-compute[72418]:   <name>instance-0000001a</name>
Aug 09 18:32:41 user nova-compute[72418]:   <memory>524288</memory>
Aug 09 18:32:41 user nova-compute[72418]:   <vcpu>1</vcpu>
Aug 09 18:32:41 user nova-compute[72418]:   <metadata>
Aug 09 18:32:41 user nova-compute[72418]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:32:41 user nova-compute[72418]:       <nova:package version="0.0.0"/>
Aug 09 18:32:41 user nova-compute[72418]:       <nova:name>tempest-TestStampPattern-server-564523231</nova:name>
Aug 09 18:32:41 user nova-compute[72418]:       <nova:creationTime>2023-08-09 18:32:41</nova:creationTime>
Aug 09 18:32:41 user nova-compute[72418]:       <nova:flavor name="m1.tiny">
Aug 09 18:32:41 user nova-compute[72418]:         <nova:memory>512</nova:memory>
Aug 09 18:32:41 user nova-compute[72418]:         <nova:disk>1</nova:disk>
Aug 09 18:32:41 user nova-compute[72418]:         <nova:swap>0</nova:swap>
Aug 09 18:32:41 user nova-compute[72418]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:32:41 user nova-compute[72418]:         <nova:vcpus>1</nova:vcpus>
Aug 09 18:32:41 user nova-compute[72418]:       </nova:flavor>
Aug 09 18:32:41 user nova-compute[72418]:       <nova:owner>
Aug 09 18:32:41 user nova-compute[72418]:         <nova:user uuid="2af66759bfa54ffba6174c4f95a83789">tempest-TestStampPattern-1349806997-project-member</nova:user>
Aug 09 18:32:41 user nova-compute[72418]:         <nova:project uuid="ce18df915bca48109597ad4aa8f1d116">tempest-TestStampPattern-1349806997</nova:project>
Aug 09 18:32:41 user nova-compute[72418]:       </nova:owner>
Aug 09 18:32:41 user nova-compute[72418]:       <nova:root type="image" uuid="8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e"/>
Aug 09 18:32:41 user nova-compute[72418]:       <nova:ports>
Aug 09 18:32:41 user nova-compute[72418]:         <nova:port uuid="1fa6e320-1b1b-41dc-8204-a7bed1172292">
Aug 09 18:32:41 user nova-compute[72418]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 18:32:41 user nova-compute[72418]:         </nova:port>
Aug 09 18:32:41 user nova-compute[72418]:       </nova:ports>
Aug 09 18:32:41 user nova-compute[72418]:     </nova:instance>
Aug 09 18:32:41 user nova-compute[72418]:   </metadata>
Aug 09 18:32:41 user nova-compute[72418]:   <sysinfo type="smbios">
Aug 09 18:32:41 user nova-compute[72418]:     <system>
Aug 09 18:32:41 user nova-compute[72418]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 18:32:41 user nova-compute[72418]:       <entry name="product">OpenStack Nova</entry>
Aug 09 18:32:41 user nova-compute[72418]:       <entry name="version">0.0.0</entry>
Aug 09 18:32:41 user nova-compute[72418]:       <entry name="serial">2c9e974b-b993-4f4e-9446-14941c39f109</entry>
Aug 09 18:32:41 user nova-compute[72418]:       <entry name="uuid">2c9e974b-b993-4f4e-9446-14941c39f109</entry>
Aug 09 18:32:41 user nova-compute[72418]:       <entry name="family">Virtual Machine</entry>
Aug 09 18:32:41 user nova-compute[72418]:     </system>
Aug 09 18:32:41 user nova-compute[72418]:   </sysinfo>
Aug 09 18:32:41 user nova-compute[72418]:   <os>
Aug 09 18:32:41 user nova-compute[72418]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 18:32:41 user nova-compute[72418]:     <boot dev="hd"/>
Aug 09 18:32:41 user nova-compute[72418]:     <smbios mode="sysinfo"/>
Aug 09 18:32:41 user nova-compute[72418]:   </os>
Aug 09 18:32:41 user nova-compute[72418]:   <features>
Aug 09 18:32:41 user nova-compute[72418]:     <acpi/>
Aug 09 18:32:41 user nova-compute[72418]:     <apic/>
Aug 09 18:32:41 user nova-compute[72418]:     <vmcoreinfo/>
Aug 09 18:32:41 user nova-compute[72418]:   </features>
Aug 09 18:32:41 user nova-compute[72418]:   <clock offset="utc">
Aug 09 18:32:41 user nova-compute[72418]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 18:32:41 user nova-compute[72418]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 18:32:41 user nova-compute[72418]:     <timer name="hpet" present="no"/>
Aug 09 18:32:41 user nova-compute[72418]:   </clock>
Aug 09 18:32:41 user nova-compute[72418]:   <cpu mode="custom" match="exact">
Aug 09 18:32:41 user nova-compute[72418]:     <model>Nehalem</model>
Aug 09 18:32:41 user nova-compute[72418]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 18:32:41 user nova-compute[72418]:   </cpu>
Aug 09 18:32:41 user nova-compute[72418]:   <devices>
Aug 09 18:32:41 user nova-compute[72418]:     <disk type="file" device="disk">
Aug 09 18:32:41 user nova-compute[72418]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 18:32:41 user nova-compute[72418]:       <source file="/opt/stack/data/nova/instances/2c9e974b-b993-4f4e-9446-14941c39f109/disk"/>
Aug 09 18:32:41 user nova-compute[72418]:       <target dev="vda" bus="virtio"/>
Aug 09 18:32:41 user nova-compute[72418]:     </disk>
Aug 09 18:32:41 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:32:41 user nova-compute[72418]:       <mac address="fa:16:3e:06:d3:3a"/>
Aug 09 18:32:41 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:32:41 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:32:41 user nova-compute[72418]:       <target dev="tap1fa6e320-1b"/>
Aug 09 18:32:41 user nova-compute[72418]:     </interface>
Aug 09 18:32:41 user nova-compute[72418]:     <serial type="pty">
Aug 09 18:32:41 user nova-compute[72418]:       <log file="/opt/stack/data/nova/instances/2c9e974b-b993-4f4e-9446-14941c39f109/console.log" append="off"/>
Aug 09 18:32:41 user nova-compute[72418]:     </serial>
Aug 09 18:32:41 user nova-compute[72418]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 18:32:41 user nova-compute[72418]:     <video>
Aug 09 18:32:41 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:32:41 user nova-compute[72418]:     </video>
Aug 09 18:32:41 user nova-compute[72418]:     <rng model="virtio">
Aug 09 18:32:41 user nova-compute[72418]:       <backend model="random">/dev/urandom</backend>
Aug 09 18:32:41 user nova-compute[72418]:     </rng>
Aug 09 18:32:41 user nova-compute[72418]:     <controller type="usb" index="0" model="none"/>
Aug 09 18:32:41 user nova-compute[72418]:     <memballoon model="virtio">
Aug 09 18:32:41 user nova-compute[72418]:       <stats period="10"/>
Aug 09 18:32:41 user nova-compute[72418]:     </memballoon>
Aug 09 18:32:41 user nova-compute[72418]:   </devices>
Aug 09 18:32:41 user nova-compute[72418]: </domain>
Aug 09 18:32:41 user nova-compute[72418]:  {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:32:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-564523231',display_name='tempest-TestStampPattern-server-564523231',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-564523231',id=26,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyuC2STmNW21KgmVvu2UdySlXVI+0J2CQB6cC/06BFGS91M3K5pktxtEHOvDqMzVGj1CpM11aZmLQ8ny2sqKin/VSPS9fza7lm5UGhSckLWpV1uBCIlOPx80Bbo9A16oA==',key_name='tempest-TestStampPattern-872776389',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce18df915bca48109597ad4aa8f1d116',ramdisk_id='',reservation_id='r-9tx2gsbh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1349806997',owner_user_name='tempest-TestStampPattern-1349806997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:32:39Z,user_data=None,user_id='2af66759bfa54ffba6174c4f95a83789',uuid=2c9e974b-b993-4f4e-9446-14941c39f109,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1fa6e320-1b1b-41dc-8204-a7bed1172292", "address": "fa:16:3e:06:d3:3a", "network": {"id": "0fbd02ef-7c74-46c2-a09c-3b69be222ffa", "bridge": "br-int", "label": "tempest-TestStampPattern-85008345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce18df915bca48109597ad4aa8f1d116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fa6e320-1b", "ovs_interfaceid": "1fa6e320-1b1b-41dc-8204-a7bed1172292", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Converting VIF {"id": "1fa6e320-1b1b-41dc-8204-a7bed1172292", "address": "fa:16:3e:06:d3:3a", "network": {"id": "0fbd02ef-7c74-46c2-a09c-3b69be222ffa", "bridge": "br-int", "label": "tempest-TestStampPattern-85008345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce18df915bca48109597ad4aa8f1d116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fa6e320-1b", "ovs_interfaceid": "1fa6e320-1b1b-41dc-8204-a7bed1172292", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:d3:3a,bridge_name='br-int',has_traffic_filtering=True,id=1fa6e320-1b1b-41dc-8204-a7bed1172292,network=Network(0fbd02ef-7c74-46c2-a09c-3b69be222ffa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fa6e320-1b') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG os_vif [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:d3:3a,bridge_name='br-int',has_traffic_filtering=True,id=1fa6e320-1b1b-41dc-8204-a7bed1172292,network=Network(0fbd02ef-7c74-46c2-a09c-3b69be222ffa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fa6e320-1b') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1fa6e320-1b, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1fa6e320-1b, col_values=(('external_ids', {'iface-id': '1fa6e320-1b1b-41dc-8204-a7bed1172292', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:d3:3a', 'vm-uuid': '2c9e974b-b993-4f4e-9446-14941c39f109'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:32:41 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:32:42 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:32:42 user nova-compute[72418]: INFO os_vif [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:d3:3a,bridge_name='br-int',has_traffic_filtering=True,id=1fa6e320-1b1b-41dc-8204-a7bed1172292,network=Network(0fbd02ef-7c74-46c2-a09c-3b69be222ffa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fa6e320-1b')
Aug 09 18:32:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:32:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] No VIF found with MAC fa:16:3e:06:d3:3a, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:32:42 user nova-compute[72418]: DEBUG nova.network.neutron [req-95607f1b-cd86-434d-9e95-667a16385aea req-ccd9e222-ebce-49c5-8bb1-78b1720ac983 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:32:42 user nova-compute[72418]: DEBUG nova.network.neutron [req-fc9b0723-dbbc-49c1-a713-384393586003 req-11fc7761-245e-437a-beeb-6151faf9db43 service nova] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Updated VIF entry in instance network info cache for port 1fa6e320-1b1b-41dc-8204-a7bed1172292. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:32:42 user nova-compute[72418]: DEBUG nova.network.neutron [req-fc9b0723-dbbc-49c1-a713-384393586003 req-11fc7761-245e-437a-beeb-6151faf9db43 service nova] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Updating instance_info_cache with network_info: [{"id": "1fa6e320-1b1b-41dc-8204-a7bed1172292", "address": "fa:16:3e:06:d3:3a", "network": {"id": "0fbd02ef-7c74-46c2-a09c-3b69be222ffa", "bridge": "br-int", "label": "tempest-TestStampPattern-85008345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce18df915bca48109597ad4aa8f1d116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fa6e320-1b", "ovs_interfaceid": "1fa6e320-1b1b-41dc-8204-a7bed1172292", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:32:42 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-95607f1b-cd86-434d-9e95-667a16385aea req-ccd9e222-ebce-49c5-8bb1-78b1720ac983 service nova] Releasing lock "refresh_cache-82d67874-5477-4554-bffc-2bf24eb28367" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:32:42 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-fc9b0723-dbbc-49c1-a713-384393586003 req-11fc7761-245e-437a-beeb-6151faf9db43 service nova] Releasing lock "refresh_cache-2c9e974b-b993-4f4e-9446-14941c39f109" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:32:42 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:32:42 user nova-compute[72418]: DEBUG nova.network.neutron [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Successfully updated port: bb529102-e1c1-4932-a2b2-8c411d29ca58 {{(pid=72418) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 18:32:43 user nova-compute[72418]: DEBUG nova.compute.manager [req-01e3e8e4-d43d-4e79-9125-e2bb0cc09a24 req-7974ca65-679f-46df-a9ee-8c5e03537846 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received event network-changed-bb529102-e1c1-4932-a2b2-8c411d29ca58 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:32:43 user nova-compute[72418]: DEBUG nova.compute.manager [req-01e3e8e4-d43d-4e79-9125-e2bb0cc09a24 req-7974ca65-679f-46df-a9ee-8c5e03537846 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Refreshing instance network info cache due to event network-changed-bb529102-e1c1-4932-a2b2-8c411d29ca58. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:32:43 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-01e3e8e4-d43d-4e79-9125-e2bb0cc09a24 req-7974ca65-679f-46df-a9ee-8c5e03537846 service nova] Acquiring lock "refresh_cache-82d67874-5477-4554-bffc-2bf24eb28367" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:32:43 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-01e3e8e4-d43d-4e79-9125-e2bb0cc09a24 req-7974ca65-679f-46df-a9ee-8c5e03537846 service nova] Acquired lock "refresh_cache-82d67874-5477-4554-bffc-2bf24eb28367" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:32:43 user nova-compute[72418]: DEBUG nova.network.neutron [req-01e3e8e4-d43d-4e79-9125-e2bb0cc09a24 req-7974ca65-679f-46df-a9ee-8c5e03537846 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Refreshing network info cache for port bb529102-e1c1-4932-a2b2-8c411d29ca58 {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:32:43 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:32:43 user nova-compute[72418]: DEBUG nova.network.neutron [req-01e3e8e4-d43d-4e79-9125-e2bb0cc09a24 req-7974ca65-679f-46df-a9ee-8c5e03537846 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Instance cache missing network info. {{(pid=72418) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 18:32:43 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:32:43 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:32:44 user nova-compute[72418]: DEBUG nova.network.neutron [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Successfully updated port: 3d432e6f-81b2-4c44-bb25-b3d35941a43c {{(pid=72418) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 18:32:44 user nova-compute[72418]: DEBUG nova.network.neutron [req-01e3e8e4-d43d-4e79-9125-e2bb0cc09a24 req-7974ca65-679f-46df-a9ee-8c5e03537846 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:32:44 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-01e3e8e4-d43d-4e79-9125-e2bb0cc09a24 req-7974ca65-679f-46df-a9ee-8c5e03537846 service nova] Releasing lock "refresh_cache-82d67874-5477-4554-bffc-2bf24eb28367" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:32:44 user nova-compute[72418]: DEBUG nova.compute.manager [req-e0ba6c79-f89d-4548-aec7-c13ae8f7ce3b req-e57789e9-ec62-4a42-86e3-1cc839827d6c service nova] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Received event network-vif-plugged-1fa6e320-1b1b-41dc-8204-a7bed1172292 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:32:44 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-e0ba6c79-f89d-4548-aec7-c13ae8f7ce3b req-e57789e9-ec62-4a42-86e3-1cc839827d6c service nova] Acquiring lock "2c9e974b-b993-4f4e-9446-14941c39f109-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:32:44 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-e0ba6c79-f89d-4548-aec7-c13ae8f7ce3b req-e57789e9-ec62-4a42-86e3-1cc839827d6c service nova] Lock "2c9e974b-b993-4f4e-9446-14941c39f109-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:32:44 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-e0ba6c79-f89d-4548-aec7-c13ae8f7ce3b req-e57789e9-ec62-4a42-86e3-1cc839827d6c service nova] Lock "2c9e974b-b993-4f4e-9446-14941c39f109-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:32:44 user nova-compute[72418]: DEBUG nova.compute.manager [req-e0ba6c79-f89d-4548-aec7-c13ae8f7ce3b req-e57789e9-ec62-4a42-86e3-1cc839827d6c service nova] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] No waiting events found dispatching network-vif-plugged-1fa6e320-1b1b-41dc-8204-a7bed1172292 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:32:44 user nova-compute[72418]: WARNING nova.compute.manager [req-e0ba6c79-f89d-4548-aec7-c13ae8f7ce3b req-e57789e9-ec62-4a42-86e3-1cc839827d6c service nova] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Received unexpected event network-vif-plugged-1fa6e320-1b1b-41dc-8204-a7bed1172292 for instance with vm_state building and task_state spawning.
Aug 09 18:32:44 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:32:44 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:32:44 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:32:44 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:32:44 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:32:45 user nova-compute[72418]: DEBUG nova.network.neutron [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Successfully updated port: 3cd5a4d7-5e70-42d3-b3bd-8d9262131f59 {{(pid=72418) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 18:32:45 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Acquiring lock "refresh_cache-82d67874-5477-4554-bffc-2bf24eb28367" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:32:45 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Acquired lock "refresh_cache-82d67874-5477-4554-bffc-2bf24eb28367" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:32:45 user nova-compute[72418]: DEBUG nova.network.neutron [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:32:45 user nova-compute[72418]: DEBUG nova.network.neutron [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Instance cache missing network info. {{(pid=72418) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 18:32:45 user nova-compute[72418]: DEBUG nova.compute.manager [req-3b7a6d91-8699-43d6-b2f3-c3c68ebee9d7 req-af9cd157-6cd5-4011-8aa0-0632bb5fc348 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received event network-changed-3d432e6f-81b2-4c44-bb25-b3d35941a43c {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:32:45 user nova-compute[72418]: DEBUG nova.compute.manager [req-3b7a6d91-8699-43d6-b2f3-c3c68ebee9d7 req-af9cd157-6cd5-4011-8aa0-0632bb5fc348 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Refreshing instance network info cache due to event network-changed-3d432e6f-81b2-4c44-bb25-b3d35941a43c. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:32:45 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-3b7a6d91-8699-43d6-b2f3-c3c68ebee9d7 req-af9cd157-6cd5-4011-8aa0-0632bb5fc348 service nova] Acquiring lock "refresh_cache-82d67874-5477-4554-bffc-2bf24eb28367" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:32:46 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605966.3223882, 2c9e974b-b993-4f4e-9446-14941c39f109 => Resumed> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:32:46 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] VM Resumed (Lifecycle Event)
Aug 09 18:32:46 user nova-compute[72418]: DEBUG nova.compute.manager [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Instance event wait completed in 0 seconds for  {{(pid=72418) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 18:32:46 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Guest created on hypervisor {{(pid=72418) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 18:32:46 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Instance spawned successfully.
Aug 09 18:32:46 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 18:32:46 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:32:46 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:32:46 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Found default for hw_cdrom_bus of ide {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:32:46 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Found default for hw_disk_bus of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:32:46 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Found default for hw_input_bus of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:32:46 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Found default for hw_pointer_model of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:32:46 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Found default for hw_video_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:32:46 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Found default for hw_vif_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:32:46 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:32:46 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605966.324837, 2c9e974b-b993-4f4e-9446-14941c39f109 => Started> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:32:46 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] VM Started (Lifecycle Event)
Aug 09 18:32:46 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:32:46 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:32:46 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:32:46 user nova-compute[72418]: INFO nova.compute.manager [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Took 7.01 seconds to spawn the instance on the hypervisor.
Aug 09 18:32:46 user nova-compute[72418]: DEBUG nova.compute.manager [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:32:46 user nova-compute[72418]: DEBUG nova.compute.manager [req-35417ac9-6268-4d35-80fe-9688e1a1bab9 req-edb4e6db-c8c3-4e56-bea0-4b129982c2ed service nova] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Received event network-vif-plugged-1fa6e320-1b1b-41dc-8204-a7bed1172292 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:32:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-35417ac9-6268-4d35-80fe-9688e1a1bab9 req-edb4e6db-c8c3-4e56-bea0-4b129982c2ed service nova] Acquiring lock "2c9e974b-b993-4f4e-9446-14941c39f109-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:32:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-35417ac9-6268-4d35-80fe-9688e1a1bab9 req-edb4e6db-c8c3-4e56-bea0-4b129982c2ed service nova] Lock "2c9e974b-b993-4f4e-9446-14941c39f109-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:32:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-35417ac9-6268-4d35-80fe-9688e1a1bab9 req-edb4e6db-c8c3-4e56-bea0-4b129982c2ed service nova] Lock "2c9e974b-b993-4f4e-9446-14941c39f109-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:32:46 user nova-compute[72418]: DEBUG nova.compute.manager [req-35417ac9-6268-4d35-80fe-9688e1a1bab9 req-edb4e6db-c8c3-4e56-bea0-4b129982c2ed service nova] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] No waiting events found dispatching network-vif-plugged-1fa6e320-1b1b-41dc-8204-a7bed1172292 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:32:46 user nova-compute[72418]: WARNING nova.compute.manager [req-35417ac9-6268-4d35-80fe-9688e1a1bab9 req-edb4e6db-c8c3-4e56-bea0-4b129982c2ed service nova] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Received unexpected event network-vif-plugged-1fa6e320-1b1b-41dc-8204-a7bed1172292 for instance with vm_state building and task_state spawning.
Aug 09 18:32:46 user nova-compute[72418]: INFO nova.compute.manager [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Took 8.01 seconds to build instance.
Aug 09 18:32:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d0f1e9e5-bc89-4fcd-ab35-e606f12da03d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "2c9e974b-b993-4f4e-9446-14941c39f109" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.108s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:32:46 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:32:47 user nova-compute[72418]: DEBUG nova.network.neutron [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Updating instance_info_cache with network_info: [{"id": "b07016e4-a1a6-438c-86e0-9b29f347ece4", "address": "fa:16:3e:55:82:4c", "network": {"id": "962e505b-9e11-4c96-b339-e36363ab6ef6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1326388745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb07016e4-a1", "ovs_interfaceid": "b07016e4-a1a6-438c-86e0-9b29f347ece4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a5c55350-ec71-4b02-90cc-ebc30e6211e5", "address": "fa:16:3e:3a:4c:d7", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c55350-ec", "ovs_interfaceid": "a5c55350-ec71-4b02-90cc-ebc30e6211e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4d58b14a-e8d0-4d9d-a712-8bfaa2b74bfc", "address": "fa:16:3e:3e:b6:33", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d58b14a-e8", "ovs_interfaceid": "4d58b14a-e8d0-4d9d-a712-8bfaa2b74bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6bc46fc5-0af5-4d39-8c6e-bbbfb093af14", "address": "fa:16:3e:93:62:de", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bc46fc5-0a", "ovs_interfaceid": "6bc46fc5-0af5-4d39-8c6e-bbbfb093af14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bb529102-e1c1-4932-a2b2-8c411d29ca58", "address": "fa:16:3e:4a:b3:a4", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb529102-e1", "ovs_interfaceid": "bb529102-e1c1-4932-a2b2-8c411d29ca58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d432e6f-81b2-4c44-bb25-b3d35941a43c", "address": "fa:16:3e:ff:50:55", "network": {"id": "dc14bb1f-2228-427b-88a6-852777894bc3", "bridge": "br-int", "label": "tempest-device-tagging-net2-2080696379", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d432e6f-81", "ovs_interfaceid": "3d432e6f-81b2-4c44-bb25-b3d35941a43c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3cd5a4d7-5e70-42d3-b3bd-8d9262131f59", "address": "fa:16:3e:e8:1b:c1", "network": {"id": "dc14bb1f-2228-427b-88a6-852777894bc3", "bridge": "br-int", "label": "tempest-device-tagging-net2-2080696379", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cd5a4d7-5e", "ovs_interfaceid": "3cd5a4d7-5e70-42d3-b3bd-8d9262131f59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:32:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Releasing lock "refresh_cache-82d67874-5477-4554-bffc-2bf24eb28367" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:32:47 user nova-compute[72418]: DEBUG nova.compute.manager [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Instance network_info: |[{"id": "b07016e4-a1a6-438c-86e0-9b29f347ece4", "address": "fa:16:3e:55:82:4c", "network": {"id": "962e505b-9e11-4c96-b339-e36363ab6ef6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1326388745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb07016e4-a1", "ovs_interfaceid": "b07016e4-a1a6-438c-86e0-9b29f347ece4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a5c55350-ec71-4b02-90cc-ebc30e6211e5", "address": "fa:16:3e:3a:4c:d7", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c55350-ec", "ovs_interfaceid": "a5c55350-ec71-4b02-90cc-ebc30e6211e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4d58b14a-e8d0-4d9d-a712-8bfaa2b74bfc", "address": "fa:16:3e:3e:b6:33", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d58b14a-e8", "ovs_interfaceid": "4d58b14a-e8d0-4d9d-a712-8bfaa2b74bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6bc46fc5-0af5-4d39-8c6e-bbbfb093af14", "address": "fa:16:3e:93:62:de", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bc46fc5-0a", "ovs_interfaceid": "6bc46fc5-0af5-4d39-8c6e-bbbfb093af14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bb529102-e1c1-4932-a2b2-8c411d29ca58", "address": "fa:16:3e:4a:b3:a4", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb529102-e1", "ovs_interfaceid": "bb529102-e1c1-4932-a2b2-8c411d29ca58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d432e6f-81b2-4c44-bb25-b3d35941a43c", "address": "fa:16:3e:ff:50:55", "network": {"id": "dc14bb1f-2228-427b-88a6-852777894bc3", "bridge": "br-int", "label": "tempest-device-tagging-net2-2080696379", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d432e6f-81", "ovs_interfaceid": "3d432e6f-81b2-4c44-bb25-b3d35941a43c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3cd5a4d7-5e70-42d3-b3bd-8d9262131f59", "address": "fa:16:3e:e8:1b:c1", "network": {"id": "dc14bb1f-2228-427b-88a6-852777894bc3", "bridge": "br-int", "label": "tempest-device-tagging-net2-2080696379", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cd5a4d7-5e", "ovs_interfaceid": "3cd5a4d7-5e70-42d3-b3bd-8d9262131f59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 18:32:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-3b7a6d91-8699-43d6-b2f3-c3c68ebee9d7 req-af9cd157-6cd5-4011-8aa0-0632bb5fc348 service nova] Acquired lock "refresh_cache-82d67874-5477-4554-bffc-2bf24eb28367" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:32:47 user nova-compute[72418]: DEBUG nova.network.neutron [req-3b7a6d91-8699-43d6-b2f3-c3c68ebee9d7 req-af9cd157-6cd5-4011-8aa0-0632bb5fc348 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Refreshing network info cache for port 3d432e6f-81b2-4c44-bb25-b3d35941a43c {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:32:47 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:32:48 user nova-compute[72418]: DEBUG nova.network.neutron [req-3b7a6d91-8699-43d6-b2f3-c3c68ebee9d7 req-af9cd157-6cd5-4011-8aa0-0632bb5fc348 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Updated VIF entry in instance network info cache for port 3d432e6f-81b2-4c44-bb25-b3d35941a43c. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:32:48 user nova-compute[72418]: DEBUG nova.network.neutron [req-3b7a6d91-8699-43d6-b2f3-c3c68ebee9d7 req-af9cd157-6cd5-4011-8aa0-0632bb5fc348 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Updating instance_info_cache with network_info: [{"id": "b07016e4-a1a6-438c-86e0-9b29f347ece4", "address": "fa:16:3e:55:82:4c", "network": {"id": "962e505b-9e11-4c96-b339-e36363ab6ef6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1326388745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb07016e4-a1", "ovs_interfaceid": "b07016e4-a1a6-438c-86e0-9b29f347ece4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a5c55350-ec71-4b02-90cc-ebc30e6211e5", "address": "fa:16:3e:3a:4c:d7", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c55350-ec", "ovs_interfaceid": "a5c55350-ec71-4b02-90cc-ebc30e6211e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4d58b14a-e8d0-4d9d-a712-8bfaa2b74bfc", "address": "fa:16:3e:3e:b6:33", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d58b14a-e8", "ovs_interfaceid": "4d58b14a-e8d0-4d9d-a712-8bfaa2b74bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6bc46fc5-0af5-4d39-8c6e-bbbfb093af14", "address": "fa:16:3e:93:62:de", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bc46fc5-0a", "ovs_interfaceid": "6bc46fc5-0af5-4d39-8c6e-bbbfb093af14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bb529102-e1c1-4932-a2b2-8c411d29ca58", "address": "fa:16:3e:4a:b3:a4", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb529102-e1", "ovs_interfaceid": "bb529102-e1c1-4932-a2b2-8c411d29ca58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d432e6f-81b2-4c44-bb25-b3d35941a43c", "address": "fa:16:3e:ff:50:55", "network": {"id": "dc14bb1f-2228-427b-88a6-852777894bc3", "bridge": "br-int", "label": "tempest-device-tagging-net2-2080696379", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d432e6f-81", "ovs_interfaceid": "3d432e6f-81b2-4c44-bb25-b3d35941a43c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3cd5a4d7-5e70-42d3-b3bd-8d9262131f59", "address": "fa:16:3e:e8:1b:c1", "network": {"id": "dc14bb1f-2228-427b-88a6-852777894bc3", "bridge": "br-int", "label": "tempest-device-tagging-net2-2080696379", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cd5a4d7-5e", "ovs_interfaceid": "3cd5a4d7-5e70-42d3-b3bd-8d9262131f59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:32:48 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-3b7a6d91-8699-43d6-b2f3-c3c68ebee9d7 req-af9cd157-6cd5-4011-8aa0-0632bb5fc348 service nova] Releasing lock "refresh_cache-82d67874-5477-4554-bffc-2bf24eb28367" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:32:48 user nova-compute[72418]: DEBUG nova.compute.manager [req-3b7a6d91-8699-43d6-b2f3-c3c68ebee9d7 req-af9cd157-6cd5-4011-8aa0-0632bb5fc348 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received event network-changed-3cd5a4d7-5e70-42d3-b3bd-8d9262131f59 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:32:48 user nova-compute[72418]: DEBUG nova.compute.manager [req-3b7a6d91-8699-43d6-b2f3-c3c68ebee9d7 req-af9cd157-6cd5-4011-8aa0-0632bb5fc348 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Refreshing instance network info cache due to event network-changed-3cd5a4d7-5e70-42d3-b3bd-8d9262131f59. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:32:48 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-3b7a6d91-8699-43d6-b2f3-c3c68ebee9d7 req-af9cd157-6cd5-4011-8aa0-0632bb5fc348 service nova] Acquiring lock "refresh_cache-82d67874-5477-4554-bffc-2bf24eb28367" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:32:48 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-3b7a6d91-8699-43d6-b2f3-c3c68ebee9d7 req-af9cd157-6cd5-4011-8aa0-0632bb5fc348 service nova] Acquired lock "refresh_cache-82d67874-5477-4554-bffc-2bf24eb28367" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:32:48 user nova-compute[72418]: DEBUG nova.network.neutron [req-3b7a6d91-8699-43d6-b2f3-c3c68ebee9d7 req-af9cd157-6cd5-4011-8aa0-0632bb5fc348 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Refreshing network info cache for port 3cd5a4d7-5e70-42d3-b3bd-8d9262131f59 {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:32:48 user nova-compute[72418]: DEBUG nova.network.neutron [req-3b7a6d91-8699-43d6-b2f3-c3c68ebee9d7 req-af9cd157-6cd5-4011-8aa0-0632bb5fc348 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Updated VIF entry in instance network info cache for port 3cd5a4d7-5e70-42d3-b3bd-8d9262131f59. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:32:48 user nova-compute[72418]: DEBUG nova.network.neutron [req-3b7a6d91-8699-43d6-b2f3-c3c68ebee9d7 req-af9cd157-6cd5-4011-8aa0-0632bb5fc348 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Updating instance_info_cache with network_info: [{"id": "b07016e4-a1a6-438c-86e0-9b29f347ece4", "address": "fa:16:3e:55:82:4c", "network": {"id": "962e505b-9e11-4c96-b339-e36363ab6ef6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1326388745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb07016e4-a1", "ovs_interfaceid": "b07016e4-a1a6-438c-86e0-9b29f347ece4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a5c55350-ec71-4b02-90cc-ebc30e6211e5", "address": "fa:16:3e:3a:4c:d7", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c55350-ec", "ovs_interfaceid": "a5c55350-ec71-4b02-90cc-ebc30e6211e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4d58b14a-e8d0-4d9d-a712-8bfaa2b74bfc", "address": "fa:16:3e:3e:b6:33", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d58b14a-e8", "ovs_interfaceid": "4d58b14a-e8d0-4d9d-a712-8bfaa2b74bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6bc46fc5-0af5-4d39-8c6e-bbbfb093af14", "address": "fa:16:3e:93:62:de", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bc46fc5-0a", "ovs_interfaceid": "6bc46fc5-0af5-4d39-8c6e-bbbfb093af14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bb529102-e1c1-4932-a2b2-8c411d29ca58", "address": "fa:16:3e:4a:b3:a4", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb529102-e1", "ovs_interfaceid": "bb529102-e1c1-4932-a2b2-8c411d29ca58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d432e6f-81b2-4c44-bb25-b3d35941a43c", "address": "fa:16:3e:ff:50:55", "network": {"id": "dc14bb1f-2228-427b-88a6-852777894bc3", "bridge": "br-int", "label": "tempest-device-tagging-net2-2080696379", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d432e6f-81", "ovs_interfaceid": "3d432e6f-81b2-4c44-bb25-b3d35941a43c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3cd5a4d7-5e70-42d3-b3bd-8d9262131f59", "address": "fa:16:3e:e8:1b:c1", "network": {"id": "dc14bb1f-2228-427b-88a6-852777894bc3", "bridge": "br-int", "label": "tempest-device-tagging-net2-2080696379", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cd5a4d7-5e", "ovs_interfaceid": "3cd5a4d7-5e70-42d3-b3bd-8d9262131f59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:32:48 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:32:48 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72418) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 18:32:48 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-3b7a6d91-8699-43d6-b2f3-c3c68ebee9d7 req-af9cd157-6cd5-4011-8aa0-0632bb5fc348 service nova] Releasing lock "refresh_cache-82d67874-5477-4554-bffc-2bf24eb28367" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:32:49 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:32:50 user nova-compute[72418]: INFO nova.virt.block_device [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Booting with volume 8e54d078-d390-405c-bb4d-77b8f90cfa34 at /dev/vdc
Aug 09 18:32:51 user nova-compute[72418]: DEBUG os_brick.utils [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:32:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:51 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[2637b730-a784-4945-8e68-95fe85a4a501]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ad56b243ad71\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:32:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:51 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca2b840-7193-4650-89cf-e2864eff0a3a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:32:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:51 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[05460cb3-20ad-4489-a052-0f4b912f2b27]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:32:51 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6c9ba1-4e41-4c04-ad53-30202015c8d3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:32:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Running cmd (subprocess): nvme version {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] 'nvme version' failed. Not Retrying. {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:32:51 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.nvmeof [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] nvme not present on system {{(pid=72418) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 18:32:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:32:51 user nova-compute[72418]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 18:32:51 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff6be68-d0db-476d-b329-6f613a8eb1fa]: (4, '') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:32:51 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72418) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 18:32:51 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 18:32:51 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] LIGHTOS: no hostnqn found. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 18:32:51 user nova-compute[72418]: DEBUG os_brick.utils [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ad56b243ad71', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:32:51 user nova-compute[72418]: DEBUG nova.virt.block_device [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Updating existing volume attachment record: 21c91517-58af-414c-86ef-1f68d83f3e21 {{(pid=72418) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 18:32:51 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:32:51 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:32:51 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:32:52 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:32:52 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:32:53 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:32:53 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:32:53 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:32:53 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72418) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 18:32:54 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:32:55 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:32:55 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:32:55 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:32:55 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:32:55 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Auditing locally available compute resources for user (node: user) {{(pid=72418) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 18:32:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:56 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:32:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c53f871-2be9-4119-b5c0-d5081e2f4388/disk.rescue --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c53f871-2be9-4119-b5c0-d5081e2f4388/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c53f871-2be9-4119-b5c0-d5081e2f4388/disk.rescue --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c53f871-2be9-4119-b5c0-d5081e2f4388/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:56 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /opt/stack/data/nova/instances/1c53f871-2be9-4119-b5c0-d5081e2f4388/disk (vdb) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:32:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:56 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:56 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:32:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9e974b-b993-4f4e-9446-14941c39f109/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9e974b-b993-4f4e-9446-14941c39f109/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9e974b-b993-4f4e-9446-14941c39f109/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9e974b-b993-4f4e-9446-14941c39f109/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json" returned: 0 in 0.130s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:57 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:32:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e582b61c-d998-4a3f-8392-a7f0e94a4dec/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e582b61c-d998-4a3f-8392-a7f0e94a4dec/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e582b61c-d998-4a3f-8392-a7f0e94a4dec/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:32:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e582b61c-d998-4a3f-8392-a7f0e94a4dec/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:32:59 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:32:59 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:32:59 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:32:59 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Hypervisor/Node resource view: name=user free_ram=7619MB free_disk=25.52426528930664GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72418) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 18:32:59 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:32:59 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 6af7918a-ce90-45ab-93d8-684e1489e891 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 8fe41968-a219-4a5a-afdb-32eb2082bb40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 01c46b33-6788-44a5-a43c-88ee4acc4d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance e019064c-955e-4f80-9b00-6b32b3835d58 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance e07beace-59d8-4c02-844b-1db1a6e81198 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance c46f2599-93f8-412e-9918-7ace8a9f19dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 03ad5bab-ab32-47fc-b7e8-b32282b9c20d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 1c53f871-2be9-4119-b5c0-d5081e2f4388 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance e582b61c-d998-4a3f-8392-a7f0e94a4dec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 82d67874-5477-4554-bffc-2bf24eb28367 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 2c9e974b-b993-4f4e-9446-14941c39f109 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Refreshing inventories for resource provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Updating ProviderTree inventory for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Updating inventory in ProviderTree for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Refreshing aggregate associations for resource provider 50628e48-0a01-4c3f-9ff5-2a66453cd194, aggregates: None {{(pid=72418) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Refreshing trait associations for resource provider 50628e48-0a01-4c3f-9ff5-2a66453cd194, traits: HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=72418) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG nova.compute.manager [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Start spawning the instance on the hypervisor. {{(pid=72418) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Creating instance directory {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 18:33:00 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Creating image(s)
Aug 09 18:33:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Did not create local disks {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Ensure instance console log exists: /opt/stack/data/nova/instances/82d67874-5477-4554-bffc-2bf24eb28367/console.log {{(pid=72418) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Start _get_guest_xml network_info=[{"id": "b07016e4-a1a6-438c-86e0-9b29f347ece4", "address": "fa:16:3e:55:82:4c", "network": {"id": "962e505b-9e11-4c96-b339-e36363ab6ef6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1326388745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb07016e4-a1", "ovs_interfaceid": "b07016e4-a1a6-438c-86e0-9b29f347ece4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a5c55350-ec71-4b02-90cc-ebc30e6211e5", "address": "fa:16:3e:3a:4c:d7", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c55350-ec", "ovs_interfaceid": "a5c55350-ec71-4b02-90cc-ebc30e6211e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4d58b14a-e8d0-4d9d-a712-8bfaa2b74bfc", "address": "fa:16:3e:3e:b6:33", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d58b14a-e8", "ovs_interfaceid": "4d58b14a-e8d0-4d9d-a712-8bfaa2b74bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6bc46fc5-0af5-4d39-8c6e-bbbfb093af14", "address": "fa:16:3e:93:62:de", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bc46fc5-0a", "ovs_interfaceid": "6bc46fc5-0af5-4d39-8c6e-bbbfb093af14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bb529102-e1c1-4932-a2b2-8c411d29ca58", "address": "fa:16:3e:4a:b3:a4", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb529102-e1", "ovs_interfaceid": "bb529102-e1c1-4932-a2b2-8c411d29ca58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d432e6f-81b2-4c44-bb25-b3d35941a43c", "address": "fa:16:3e:ff:50:55", "network": {"id": "dc14bb1f-2228-427b-88a6-852777894bc3", "bridge": "br-int", "label": "tempest-device-tagging-net2-2080696379", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d432e6f-81", "ovs_interfaceid": "3d432e6f-81b2-4c44-bb25-b3d35941a43c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3cd5a4d7-5e70-42d3-b3bd-8d9262131f59", "address": "fa:16:3e:e8:1b:c1", "network": {"id": "dc14bb1f-2228-427b-88a6-852777894bc3", "bridge": "br-int", "label": "tempest-device-tagging-net2-2080696379", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cd5a4d7-5e", "ovs_interfaceid": "3cd5a4d7-5e70-42d3-b3bd-8d9262131f59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '39de4c40-b2b2-4462-9bfd-791438ccb9ba', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'npwACEMt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '82d67874-5477-4554-bffc-2bf24eb28367', 'attached_at': '', 'detached_at': '', 'volume_id': '4ef7ffde-331f-4d4a-868b-117c46dcdf81', 'serial': '4ef7ffde-331f-4d4a-868b-117c46dcdf81'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None}, {'mount_device': '/dev/vdb', 'attachment_id': 'cefd4745-22e0-4eb6-bc25-9c972e213d23', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EwtpMDLH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '82d67874-5477-4554-bffc-2bf24eb28367', 'attached_at': '', 'detached_at': '', 'volume_id': 'c30415ea-87a0-40ae-8f0c-7f5fbec605ab', 'serial': 'c30415ea-87a0-40ae-8f0c-7f5fbec605ab'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 1, 'device_type': 'disk', 'volume_type': None}, {'mount_device': '/dev/vdc', 'attachment_id': '21c91517-58af-414c-86ef-1f68d83f3e21', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wmGxjntp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '82d67874-5477-4554-bffc-2bf24eb28367', 'attached_at': '', 'detached_at': '', 'volume_id': '8e54d078-d390-405c-bb4d-77b8f90cfa34', 'serial': '8e54d078-d390-405c-bb4d-77b8f90cfa34'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 2, 'device_type': 'disk', 'volume_type': None} {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 18:33:00 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:33:00 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:33:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] CPU controller missing on host. {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] CPU controller found on host. {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72418) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T18:17:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Flavor limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Image limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Flavor pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Image pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Got 1 possible topologies {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Calling os-brick to attach iSCSI Volume {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'npwACEMt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:33:00 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:33:00 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:33:00 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:33:00 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:33:00 user nova-compute[72418]: INFO os_brick.initiator.connectors.iscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 18:33:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 -p 172.16.0.220:3260 {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65f0b84-6ba2-45a9-8791-5ec3da8e58cb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 18:33:00 user nova-compute[72418]:  {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 -p 172.16.0.220:3260 --interface default --op new {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f4a911-9016-449a-af18-7656e38098b1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81] added\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81] added
Aug 09 18:33:00 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca183035-2245-4757-9a7d-12386f7fc494]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f204df-b07f-4387-9a8c-2f853a7cf817]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v npwACEMt {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v npwACEMt" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[8777049a-c121-4568-a7af-4af62206e091]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'npwACEMt'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04b8013-bdfb-4b1a-8eed-01b51109b60e]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[642c2ca0-03ff-4789-9714-a92c14997442]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:33:00 user nova-compute[72418]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 (non-flash)
Aug 09 18:33:00 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:33:00 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:33:00 user nova-compute[72418]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 (non-flash)
Aug 09 18:33:00 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:33:00 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 -p 172.16.0.220:3260 --login {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[02034798-99f4-40db-8cf7-b81fc9fd2c54]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81, portal: 172.16.0.220,3260]
Aug 09 18:33:00 user nova-compute[72418]: Login to [iface: default, target: iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81, portal: 172.16.0.220,3260] successful.
Aug 09 18:33:00 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c2dfee-c0e6-460d-a9d2-85676aa5409d]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a1c65e-a3a6-4b2c-a134-16532b43b067]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:33:00 user nova-compute[72418]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 (non-flash)
Aug 09 18:33:00 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:33:00 user nova-compute[72418]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 (non-flash)
Aug 09 18:33:00 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:33:00 user nova-compute[72418]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 (non-flash)
Aug 09 18:33:00 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:33:00 user nova-compute[72418]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 (non-flash)
Aug 09 18:33:00 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Connected to 172.16.0.220:3260 {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] HCTL ('36', '-', '-', 0) found on session 25 with lun 0 {{(pid=72418) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72418) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b86e9f-ee1d-4ad7-a1f8-4ab3f3243bfa]: (4, ('- - 0', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72418) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'npwACEMt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Compute_service record updated for user:user {{(pid=72418) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 18:33:00 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.081s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:33:01 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:33:01 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] <== connect_volume: return (1387ms) {'type': 'block', 'scsi_wwn': '26363303337356362', 'path': '/dev/sde'} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:33:01 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363303337356362', 'path': '/dev/sde'} {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Calling os-brick to attach iSCSI Volume {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EwtpMDLH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:33:02 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:33:02 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:33:02 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:33:02 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:33:02 user nova-compute[72418]: INFO os_brick.initiator.connectors.iscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 18:33:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab -p 172.16.0.220:3260 {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a268ff-3e79-4025-a325-ee88192015e3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 18:33:02 user nova-compute[72418]:  {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab -p 172.16.0.220:3260 --interface default --op new {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[872a5dfe-b94b-4178-b022-0fcdcc5fbd40]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab] added\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab] added
Aug 09 18:33:02 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[d034f668-100b-4771-a7c9-058409c7f379]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed95693-ef05-4b6c-b33b-d0ef1d61ddea]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EwtpMDLH {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EwtpMDLH" returned: 0 in 0.023s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[567b6551-3a5b-40f0-912f-b353dfafe878]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EwtpMDLH'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a38e3c-951c-4a4f-ad15-2c2352eb8bb0]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb75f8ed-c042-4ec6-b8ef-c145d510451e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:33:02 user nova-compute[72418]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 (non-flash)
Aug 09 18:33:02 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:33:02 user nova-compute[72418]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 (non-flash)
Aug 09 18:33:02 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:33:02 user nova-compute[72418]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 (non-flash)
Aug 09 18:33:02 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:33:02 user nova-compute[72418]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 (non-flash)
Aug 09 18:33:02 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab -p 172.16.0.220:3260 --login {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[b782d131-5ad5-403e-9432-8ce9252c6355]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab, portal: 172.16.0.220,3260]
Aug 09 18:33:02 user nova-compute[72418]: Login to [iface: default, target: iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab, portal: 172.16.0.220,3260] successful.
Aug 09 18:33:02 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e50f46a-8ec0-415a-b15f-0fdc25aa6e88]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa795bdd-b588-4746-ad78-45f86e93b6a0]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:33:02 user nova-compute[72418]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 (non-flash)
Aug 09 18:33:02 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:33:02 user nova-compute[72418]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 (non-flash)
Aug 09 18:33:02 user nova-compute[72418]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab (non-flash)
Aug 09 18:33:02 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:33:02 user nova-compute[72418]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 (non-flash)
Aug 09 18:33:02 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:33:02 user nova-compute[72418]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 (non-flash)
Aug 09 18:33:02 user nova-compute[72418]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab (non-flash)
Aug 09 18:33:02 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.404s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Connected to 172.16.0.220:3260 {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] HCTL ('37', '-', '-', 0) found on session 26 with lun 0 {{(pid=72418) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72418) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e08b7a7-4d41-45e6-bbdf-3e5d24366cc7]: (4, ('- - 0', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Searching for a device in session 26 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72418) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EwtpMDLH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Starting heal instance info cache {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 18:33:02 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "refresh_cache-e07beace-59d8-4c02-844b-1db1a6e81198" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquired lock "refresh_cache-e07beace-59d8-4c02-844b-1db1a6e81198" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG nova.network.neutron [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Forcefully refreshing network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.440s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] <== connect_volume: return (1442ms) {'type': 'block', 'scsi_wwn': '23838623762323035', 'path': '/dev/sdf'} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838623762323035', 'path': '/dev/sdf'} {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Calling os-brick to attach iSCSI Volume {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wmGxjntp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:33:03 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:33:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:33:03 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:33:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:33:03 user nova-compute[72418]: INFO os_brick.initiator.connectors.iscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 18:33:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34 -p 172.16.0.220:3260 {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4f8162-4319-41bf-b0c7-439568595128]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 18:33:03 user nova-compute[72418]:  {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34 -p 172.16.0.220:3260 --interface default --op new {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[d877858e-48dc-4e05-a73f-a48509a2073f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34] added\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34] added
Aug 09 18:33:03 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[e149f756-8ce1-44c3-8adf-66cf770a325b]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5320e01-70bb-449c-890c-a59c67414a98]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wmGxjntp {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wmGxjntp" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae397aa-652f-47bc-91f0-ff1f0e35a1d6]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wmGxjntp'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d783f4c-4282-4262-892c-c13d89197173]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7e1605-b004-4ce0-9070-be6de0145c37]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:33:03 user nova-compute[72418]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 (non-flash)
Aug 09 18:33:03 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:33:03 user nova-compute[72418]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 (non-flash)
Aug 09 18:33:03 user nova-compute[72418]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab (non-flash)
Aug 09 18:33:03 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:33:03 user nova-compute[72418]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 (non-flash)
Aug 09 18:33:03 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:33:03 user nova-compute[72418]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 (non-flash)
Aug 09 18:33:03 user nova-compute[72418]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab (non-flash)
Aug 09 18:33:03 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34 -p 172.16.0.220:3260 --login {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[791eeb7a-28d9-4af7-bae2-6e25b8ac635c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34, portal: 172.16.0.220,3260]
Aug 09 18:33:03 user nova-compute[72418]: Login to [iface: default, target: iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34, portal: 172.16.0.220,3260] successful.
Aug 09 18:33:03 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[6746bb45-cc70-4ecc-8601-da42984a5d97]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG nova.network.neutron [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Updating instance_info_cache with network_info: [{"id": "301d9f8c-022d-4c02-90dd-374ead3daa23", "address": "fa:16:3e:a6:38:d9", "network": {"id": "7621f03d-76ac-49da-89a8-0753bb11e329", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596253708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5242fb37f9664dbf9a8b50449f8dd129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap301d9f8c-02", "ovs_interfaceid": "301d9f8c-022d-4c02-90dd-374ead3daa23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Releasing lock "refresh_cache-e07beace-59d8-4c02-844b-1db1a6e81198" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Updated the network info_cache for instance {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Cleaning up deleted instances {{(pid=72418) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2efb061-0956-42ec-b30f-218ecbfe0a3f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:33:03 user nova-compute[72418]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 (non-flash)
Aug 09 18:33:03 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:33:03 user nova-compute[72418]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 (non-flash)
Aug 09 18:33:03 user nova-compute[72418]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab (non-flash)
Aug 09 18:33:03 user nova-compute[72418]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34 (non-flash)
Aug 09 18:33:03 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:33:03 user nova-compute[72418]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 (non-flash)
Aug 09 18:33:03 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:33:03 user nova-compute[72418]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 (non-flash)
Aug 09 18:33:03 user nova-compute[72418]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab (non-flash)
Aug 09 18:33:03 user nova-compute[72418]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34 (non-flash)
Aug 09 18:33:03 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Connected to 172.16.0.220:3260 {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] HCTL ('38', '-', '-', 0) found on session 27 with lun 0 {{(pid=72418) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72418) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] There are 0 instances to clean {{(pid=72418) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.028s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f14c69c-07f9-4be5-bbed-8603a723e728]: (4, ('- - 0', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Searching for a device in session 27 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72418) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 18:33:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wmGxjntp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 18:33:04 user nova-compute[72418]: DEBUG nova.objects.instance [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lazy-loading 'flavor' on Instance uuid e07beace-59d8-4c02-844b-1db1a6e81198 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:33:04 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Acquiring lock "refresh_cache-e07beace-59d8-4c02-844b-1db1a6e81198" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:33:04 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Acquired lock "refresh_cache-e07beace-59d8-4c02-844b-1db1a6e81198" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:33:04 user nova-compute[72418]: DEBUG nova.network.neutron [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:33:04 user nova-compute[72418]: DEBUG nova.objects.instance [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lazy-loading 'info_cache' on Instance uuid e07beace-59d8-4c02-844b-1db1a6e81198 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:33:04 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:33:04 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '23133303038373964', 'path': '/dev/sdg'} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:33:04 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133303038373964', 'path': '/dev/sdg'} {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 18:33:04 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T18:32:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-146038463',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-146038463',id=25,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLps7yz57S0cIqR+MidwubY3t7R2RCfbKmFUaZqcNb3jNuX4gOm5W/yhnM5SBZCJ2tBUdjMn9fHMYC8hq7ApchMsnyGU/gHVDL3/vQu07w/5OZ4oZIZxy/3huqoinWmsg==',key_name='tempest-keypair-1256803026',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32d3f1359c67450181629511bf3d908a',ramdisk_id='',reservation_id='r-tl1bs9bx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1910102697',owner_user_name='tempest-TaggedBootDevicesTest_v242-1910102697-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:32:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d01b87c4690c4a89949a5cce33bab9ab',uuid=82d67874-5477-4554-bffc-2bf24eb28367,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b07016e4-a1a6-438c-86e0-9b29f347ece4", "address": "fa:16:3e:55:82:4c", "network": {"id": "962e505b-9e11-4c96-b339-e36363ab6ef6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1326388745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb07016e4-a1", "ovs_interfaceid": "b07016e4-a1a6-438c-86e0-9b29f347ece4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:33:04 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Converting VIF {"id": "b07016e4-a1a6-438c-86e0-9b29f347ece4", "address": "fa:16:3e:55:82:4c", "network": {"id": "962e505b-9e11-4c96-b339-e36363ab6ef6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1326388745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb07016e4-a1", "ovs_interfaceid": "b07016e4-a1a6-438c-86e0-9b29f347ece4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:33:04 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:82:4c,bridge_name='br-int',has_traffic_filtering=True,id=b07016e4-a1a6-438c-86e0-9b29f347ece4,network=Network(962e505b-9e11-4c96-b339-e36363ab6ef6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb07016e4-a1') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:33:04 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T18:32:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-146038463',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-146038463',id=25,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLps7yz57S0cIqR+MidwubY3t7R2RCfbKmFUaZqcNb3jNuX4gOm5W/yhnM5SBZCJ2tBUdjMn9fHMYC8hq7ApchMsnyGU/gHVDL3/vQu07w/5OZ4oZIZxy/3huqoinWmsg==',key_name='tempest-keypair-1256803026',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32d3f1359c67450181629511bf3d908a',ramdisk_id='',reservation_id='r-tl1bs9bx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1910102697',owner_user_name='tempest-TaggedBootDevicesTest_v242-1910102697-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:32:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d01b87c4690c4a89949a5cce33bab9ab',uuid=82d67874-5477-4554-bffc-2bf24eb28367,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5c55350-ec71-4b02-90cc-ebc30e6211e5", "address": "fa:16:3e:3a:4c:d7", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c55350-ec", "ovs_interfaceid": "a5c55350-ec71-4b02-90cc-ebc30e6211e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:33:04 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Converting VIF {"id": "a5c55350-ec71-4b02-90cc-ebc30e6211e5", "address": "fa:16:3e:3a:4c:d7", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c55350-ec", "ovs_interfaceid": "a5c55350-ec71-4b02-90cc-ebc30e6211e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:33:04 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:4c:d7,bridge_name='br-int',has_traffic_filtering=True,id=a5c55350-ec71-4b02-90cc-ebc30e6211e5,network=Network(1607c003-cf2e-4a0f-9261-e0cac426786b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa5c55350-ec') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:33:04 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T18:32:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-146038463',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-146038463',id=25,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLps7yz57S0cIqR+MidwubY3t7R2RCfbKmFUaZqcNb3jNuX4gOm5W/yhnM5SBZCJ2tBUdjMn9fHMYC8hq7ApchMsnyGU/gHVDL3/vQu07w/5OZ4oZIZxy/3huqoinWmsg==',key_name='tempest-keypair-1256803026',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32d3f1359c67450181629511bf3d908a',ramdisk_id='',reservation_id='r-tl1bs9bx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1910102697',owner_user_name='tempest-TaggedBootDevicesTest_v242-1910102697-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:32:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d01b87c4690c4a89949a5cce33bab9ab',uuid=82d67874-5477-4554-bffc-2bf24eb28367,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d58b14a-e8d0-4d9d-a712-8bfaa2b74bfc", "address": "fa:16:3e:3e:b6:33", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d58b14a-e8", "ovs_interfaceid": "4d58b14a-e8d0-4d9d-a712-8bfaa2b74bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:33:04 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Converting VIF {"id": "4d58b14a-e8d0-4d9d-a712-8bfaa2b74bfc", "address": "fa:16:3e:3e:b6:33", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d58b14a-e8", "ovs_interfaceid": "4d58b14a-e8d0-4d9d-a712-8bfaa2b74bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:33:04 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:b6:33,bridge_name='br-int',has_traffic_filtering=True,id=4d58b14a-e8d0-4d9d-a712-8bfaa2b74bfc,network=Network(1607c003-cf2e-4a0f-9261-e0cac426786b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4d58b14a-e8') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:33:04 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T18:32:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-146038463',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-146038463',id=25,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLps7yz57S0cIqR+MidwubY3t7R2RCfbKmFUaZqcNb3jNuX4gOm5W/yhnM5SBZCJ2tBUdjMn9fHMYC8hq7ApchMsnyGU/gHVDL3/vQu07w/5OZ4oZIZxy/3huqoinWmsg==',key_name='tempest-keypair-1256803026',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32d3f1359c67450181629511bf3d908a',ramdisk_id='',reservation_id='r-tl1bs9bx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1910102697',owner_user_name='tempest-TaggedBootDevicesTest_v242-1910102697-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:32:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d01b87c4690c4a89949a5cce33bab9ab',uuid=82d67874-5477-4554-bffc-2bf24eb28367,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6bc46fc5-0af5-4d39-8c6e-bbbfb093af14", "address": "fa:16:3e:93:62:de", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bc46fc5-0a", "ovs_interfaceid": "6bc46fc5-0af5-4d39-8c6e-bbbfb093af14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:33:04 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Converting VIF {"id": "6bc46fc5-0af5-4d39-8c6e-bbbfb093af14", "address": "fa:16:3e:93:62:de", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bc46fc5-0a", "ovs_interfaceid": "6bc46fc5-0af5-4d39-8c6e-bbbfb093af14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:33:04 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:62:de,bridge_name='br-int',has_traffic_filtering=True,id=6bc46fc5-0af5-4d39-8c6e-bbbfb093af14,network=Network(1607c003-cf2e-4a0f-9261-e0cac426786b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bc46fc5-0a') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:33:04 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T18:32:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-146038463',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-146038463',id=25,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLps7yz57S0cIqR+MidwubY3t7R2RCfbKmFUaZqcNb3jNuX4gOm5W/yhnM5SBZCJ2tBUdjMn9fHMYC8hq7ApchMsnyGU/gHVDL3/vQu07w/5OZ4oZIZxy/3huqoinWmsg==',key_name='tempest-keypair-1256803026',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32d3f1359c67450181629511bf3d908a',ramdisk_id='',reservation_id='r-tl1bs9bx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1910102697',owner_user_name='tempest-TaggedBootDevicesTest_v242-1910102697-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:32:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d01b87c4690c4a89949a5cce33bab9ab',uuid=82d67874-5477-4554-bffc-2bf24eb28367,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb529102-e1c1-4932-a2b2-8c411d29ca58", "address": "fa:16:3e:4a:b3:a4", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb529102-e1", "ovs_interfaceid": "bb529102-e1c1-4932-a2b2-8c411d29ca58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:33:04 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Converting VIF {"id": "bb529102-e1c1-4932-a2b2-8c411d29ca58", "address": "fa:16:3e:4a:b3:a4", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb529102-e1", "ovs_interfaceid": "bb529102-e1c1-4932-a2b2-8c411d29ca58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:33:04 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:b3:a4,bridge_name='br-int',has_traffic_filtering=True,id=bb529102-e1c1-4932-a2b2-8c411d29ca58,network=Network(1607c003-cf2e-4a0f-9261-e0cac426786b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb529102-e1') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:33:04 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T18:32:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-146038463',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-146038463',id=25,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLps7yz57S0cIqR+MidwubY3t7R2RCfbKmFUaZqcNb3jNuX4gOm5W/yhnM5SBZCJ2tBUdjMn9fHMYC8hq7ApchMsnyGU/gHVDL3/vQu07w/5OZ4oZIZxy/3huqoinWmsg==',key_name='tempest-keypair-1256803026',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32d3f1359c67450181629511bf3d908a',ramdisk_id='',reservation_id='r-tl1bs9bx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1910102697',owner_user_name='tempest-TaggedBootDevicesTest_v242-1910102697-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:32:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d01b87c4690c4a89949a5cce33bab9ab',uuid=82d67874-5477-4554-bffc-2bf24eb28367,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d432e6f-81b2-4c44-bb25-b3d35941a43c", "address": "fa:16:3e:ff:50:55", "network": {"id": "dc14bb1f-2228-427b-88a6-852777894bc3", "bridge": "br-int", "label": "tempest-device-tagging-net2-2080696379", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d432e6f-81", "ovs_interfaceid": "3d432e6f-81b2-4c44-bb25-b3d35941a43c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:33:04 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Converting VIF {"id": "3d432e6f-81b2-4c44-bb25-b3d35941a43c", "address": "fa:16:3e:ff:50:55", "network": {"id": "dc14bb1f-2228-427b-88a6-852777894bc3", "bridge": "br-int", "label": "tempest-device-tagging-net2-2080696379", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d432e6f-81", "ovs_interfaceid": "3d432e6f-81b2-4c44-bb25-b3d35941a43c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:33:04 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:50:55,bridge_name='br-int',has_traffic_filtering=True,id=3d432e6f-81b2-4c44-bb25-b3d35941a43c,network=Network(dc14bb1f-2228-427b-88a6-852777894bc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d432e6f-81') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:33:04 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T18:32:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-146038463',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-146038463',id=25,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLps7yz57S0cIqR+MidwubY3t7R2RCfbKmFUaZqcNb3jNuX4gOm5W/yhnM5SBZCJ2tBUdjMn9fHMYC8hq7ApchMsnyGU/gHVDL3/vQu07w/5OZ4oZIZxy/3huqoinWmsg==',key_name='tempest-keypair-1256803026',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32d3f1359c67450181629511bf3d908a',ramdisk_id='',reservation_id='r-tl1bs9bx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1910102697',owner_user_name='tempest-TaggedBootDevicesTest_v242-1910102697-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:32:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d01b87c4690c4a89949a5cce33bab9ab',uuid=82d67874-5477-4554-bffc-2bf24eb28367,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3cd5a4d7-5e70-42d3-b3bd-8d9262131f59", "address": "fa:16:3e:e8:1b:c1", "network": {"id": "dc14bb1f-2228-427b-88a6-852777894bc3", "bridge": "br-int", "label": "tempest-device-tagging-net2-2080696379", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cd5a4d7-5e", "ovs_interfaceid": "3cd5a4d7-5e70-42d3-b3bd-8d9262131f59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:33:04 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Converting VIF {"id": "3cd5a4d7-5e70-42d3-b3bd-8d9262131f59", "address": "fa:16:3e:e8:1b:c1", "network": {"id": "dc14bb1f-2228-427b-88a6-852777894bc3", "bridge": "br-int", "label": "tempest-device-tagging-net2-2080696379", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cd5a4d7-5e", "ovs_interfaceid": "3cd5a4d7-5e70-42d3-b3bd-8d9262131f59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:33:04 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:1b:c1,bridge_name='br-int',has_traffic_filtering=True,id=3cd5a4d7-5e70-42d3-b3bd-8d9262131f59,network=Network(dc14bb1f-2228-427b-88a6-852777894bc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cd5a4d7-5e') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:33:04 user nova-compute[72418]: DEBUG nova.objects.instance [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Lazy-loading 'pci_devices' on Instance uuid 82d67874-5477-4554-bffc-2bf24eb28367 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:33:04 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] End _get_guest_xml xml=<domain type="kvm">
Aug 09 18:33:04 user nova-compute[72418]:   <uuid>82d67874-5477-4554-bffc-2bf24eb28367</uuid>
Aug 09 18:33:04 user nova-compute[72418]:   <name>instance-00000019</name>
Aug 09 18:33:04 user nova-compute[72418]:   <memory>524288</memory>
Aug 09 18:33:04 user nova-compute[72418]:   <vcpu>1</vcpu>
Aug 09 18:33:04 user nova-compute[72418]:   <metadata>
Aug 09 18:33:04 user nova-compute[72418]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:33:04 user nova-compute[72418]:       <nova:package version="0.0.0"/>
Aug 09 18:33:04 user nova-compute[72418]:       <nova:name>tempest-device-tagging-server-146038463</nova:name>
Aug 09 18:33:04 user nova-compute[72418]:       <nova:creationTime>2023-08-09 18:33:00</nova:creationTime>
Aug 09 18:33:04 user nova-compute[72418]:       <nova:flavor name="m1.tiny">
Aug 09 18:33:04 user nova-compute[72418]:         <nova:memory>512</nova:memory>
Aug 09 18:33:04 user nova-compute[72418]:         <nova:disk>1</nova:disk>
Aug 09 18:33:04 user nova-compute[72418]:         <nova:swap>0</nova:swap>
Aug 09 18:33:04 user nova-compute[72418]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:33:04 user nova-compute[72418]:         <nova:vcpus>1</nova:vcpus>
Aug 09 18:33:04 user nova-compute[72418]:       </nova:flavor>
Aug 09 18:33:04 user nova-compute[72418]:       <nova:owner>
Aug 09 18:33:04 user nova-compute[72418]:         <nova:user uuid="d01b87c4690c4a89949a5cce33bab9ab">tempest-TaggedBootDevicesTest_v242-1910102697-project-member</nova:user>
Aug 09 18:33:04 user nova-compute[72418]:         <nova:project uuid="32d3f1359c67450181629511bf3d908a">tempest-TaggedBootDevicesTest_v242-1910102697</nova:project>
Aug 09 18:33:04 user nova-compute[72418]:       </nova:owner>
Aug 09 18:33:04 user nova-compute[72418]:       <nova:root type="image" uuid="8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e"/>
Aug 09 18:33:04 user nova-compute[72418]:       <nova:ports>
Aug 09 18:33:04 user nova-compute[72418]:         <nova:port uuid="b07016e4-a1a6-438c-86e0-9b29f347ece4">
Aug 09 18:33:04 user nova-compute[72418]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 18:33:04 user nova-compute[72418]:         </nova:port>
Aug 09 18:33:04 user nova-compute[72418]:         <nova:port uuid="a5c55350-ec71-4b02-90cc-ebc30e6211e5">
Aug 09 18:33:04 user nova-compute[72418]:           <nova:ip type="fixed" address="10.1.1.188" ipVersion="4"/>
Aug 09 18:33:04 user nova-compute[72418]:         </nova:port>
Aug 09 18:33:04 user nova-compute[72418]:         <nova:port uuid="4d58b14a-e8d0-4d9d-a712-8bfaa2b74bfc">
Aug 09 18:33:04 user nova-compute[72418]:           <nova:ip type="fixed" address="10.1.1.146" ipVersion="4"/>
Aug 09 18:33:04 user nova-compute[72418]:         </nova:port>
Aug 09 18:33:04 user nova-compute[72418]:         <nova:port uuid="6bc46fc5-0af5-4d39-8c6e-bbbfb093af14">
Aug 09 18:33:04 user nova-compute[72418]:           <nova:ip type="fixed" address="10.1.1.61" ipVersion="4"/>
Aug 09 18:33:04 user nova-compute[72418]:         </nova:port>
Aug 09 18:33:04 user nova-compute[72418]:         <nova:port uuid="bb529102-e1c1-4932-a2b2-8c411d29ca58">
Aug 09 18:33:04 user nova-compute[72418]:           <nova:ip type="fixed" address="10.1.1.79" ipVersion="4"/>
Aug 09 18:33:04 user nova-compute[72418]:         </nova:port>
Aug 09 18:33:04 user nova-compute[72418]:         <nova:port uuid="3d432e6f-81b2-4c44-bb25-b3d35941a43c">
Aug 09 18:33:04 user nova-compute[72418]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 09 18:33:04 user nova-compute[72418]:         </nova:port>
Aug 09 18:33:04 user nova-compute[72418]:         <nova:port uuid="3cd5a4d7-5e70-42d3-b3bd-8d9262131f59">
Aug 09 18:33:04 user nova-compute[72418]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 09 18:33:04 user nova-compute[72418]:         </nova:port>
Aug 09 18:33:04 user nova-compute[72418]:       </nova:ports>
Aug 09 18:33:04 user nova-compute[72418]:     </nova:instance>
Aug 09 18:33:04 user nova-compute[72418]:   </metadata>
Aug 09 18:33:04 user nova-compute[72418]:   <sysinfo type="smbios">
Aug 09 18:33:04 user nova-compute[72418]:     <system>
Aug 09 18:33:04 user nova-compute[72418]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 18:33:04 user nova-compute[72418]:       <entry name="product">OpenStack Nova</entry>
Aug 09 18:33:04 user nova-compute[72418]:       <entry name="version">0.0.0</entry>
Aug 09 18:33:04 user nova-compute[72418]:       <entry name="serial">82d67874-5477-4554-bffc-2bf24eb28367</entry>
Aug 09 18:33:04 user nova-compute[72418]:       <entry name="uuid">82d67874-5477-4554-bffc-2bf24eb28367</entry>
Aug 09 18:33:04 user nova-compute[72418]:       <entry name="family">Virtual Machine</entry>
Aug 09 18:33:04 user nova-compute[72418]:     </system>
Aug 09 18:33:04 user nova-compute[72418]:   </sysinfo>
Aug 09 18:33:04 user nova-compute[72418]:   <os>
Aug 09 18:33:04 user nova-compute[72418]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 18:33:04 user nova-compute[72418]:     <boot dev="hd"/>
Aug 09 18:33:04 user nova-compute[72418]:     <smbios mode="sysinfo"/>
Aug 09 18:33:04 user nova-compute[72418]:   </os>
Aug 09 18:33:04 user nova-compute[72418]:   <features>
Aug 09 18:33:04 user nova-compute[72418]:     <acpi/>
Aug 09 18:33:04 user nova-compute[72418]:     <apic/>
Aug 09 18:33:04 user nova-compute[72418]:     <vmcoreinfo/>
Aug 09 18:33:04 user nova-compute[72418]:   </features>
Aug 09 18:33:04 user nova-compute[72418]:   <clock offset="utc">
Aug 09 18:33:04 user nova-compute[72418]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 18:33:04 user nova-compute[72418]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 18:33:04 user nova-compute[72418]:     <timer name="hpet" present="no"/>
Aug 09 18:33:04 user nova-compute[72418]:   </clock>
Aug 09 18:33:04 user nova-compute[72418]:   <cpu mode="custom" match="exact">
Aug 09 18:33:04 user nova-compute[72418]:     <model>Nehalem</model>
Aug 09 18:33:04 user nova-compute[72418]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 18:33:04 user nova-compute[72418]:   </cpu>
Aug 09 18:33:04 user nova-compute[72418]:   <devices>
Aug 09 18:33:04 user nova-compute[72418]:     <disk type="file" device="cdrom">
Aug 09 18:33:04 user nova-compute[72418]:       <driver name="qemu" type="raw" cache="none"/>
Aug 09 18:33:04 user nova-compute[72418]:       <source file="/opt/stack/data/nova/instances/82d67874-5477-4554-bffc-2bf24eb28367/disk.config"/>
Aug 09 18:33:04 user nova-compute[72418]:       <target dev="hda" bus="ide"/>
Aug 09 18:33:04 user nova-compute[72418]:     </disk>
Aug 09 18:33:04 user nova-compute[72418]:     <disk type="block" device="disk">
Aug 09 18:33:04 user nova-compute[72418]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:33:04 user nova-compute[72418]:       <source dev="/dev/sde"/>
Aug 09 18:33:04 user nova-compute[72418]:       <target dev="vda" bus="virtio"/>
Aug 09 18:33:04 user nova-compute[72418]:       <serial>4ef7ffde-331f-4d4a-868b-117c46dcdf81</serial>
Aug 09 18:33:04 user nova-compute[72418]:     </disk>
Aug 09 18:33:04 user nova-compute[72418]:     <disk type="block" device="disk">
Aug 09 18:33:04 user nova-compute[72418]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:33:04 user nova-compute[72418]:       <source dev="/dev/sdf"/>
Aug 09 18:33:04 user nova-compute[72418]:       <target dev="vdb" bus="virtio"/>
Aug 09 18:33:04 user nova-compute[72418]:       <serial>c30415ea-87a0-40ae-8f0c-7f5fbec605ab</serial>
Aug 09 18:33:04 user nova-compute[72418]:     </disk>
Aug 09 18:33:04 user nova-compute[72418]:     <disk type="block" device="disk">
Aug 09 18:33:04 user nova-compute[72418]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:33:04 user nova-compute[72418]:       <source dev="/dev/sdg"/>
Aug 09 18:33:04 user nova-compute[72418]:       <target dev="vdc" bus="virtio"/>
Aug 09 18:33:04 user nova-compute[72418]:       <serial>8e54d078-d390-405c-bb4d-77b8f90cfa34</serial>
Aug 09 18:33:04 user nova-compute[72418]:     </disk>
Aug 09 18:33:04 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:33:04 user nova-compute[72418]:       <mac address="fa:16:3e:55:82:4c"/>
Aug 09 18:33:04 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:33:04 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:33:04 user nova-compute[72418]:       <target dev="tapb07016e4-a1"/>
Aug 09 18:33:04 user nova-compute[72418]:     </interface>
Aug 09 18:33:04 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:33:04 user nova-compute[72418]:       <mac address="fa:16:3e:3a:4c:d7"/>
Aug 09 18:33:04 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:33:04 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:33:04 user nova-compute[72418]:       <target dev="tapa5c55350-ec"/>
Aug 09 18:33:04 user nova-compute[72418]:     </interface>
Aug 09 18:33:04 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:33:04 user nova-compute[72418]:       <mac address="fa:16:3e:3e:b6:33"/>
Aug 09 18:33:04 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:33:04 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:33:04 user nova-compute[72418]:       <target dev="tap4d58b14a-e8"/>
Aug 09 18:33:04 user nova-compute[72418]:     </interface>
Aug 09 18:33:04 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:33:04 user nova-compute[72418]:       <mac address="fa:16:3e:93:62:de"/>
Aug 09 18:33:04 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:33:04 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:33:04 user nova-compute[72418]:       <target dev="tap6bc46fc5-0a"/>
Aug 09 18:33:04 user nova-compute[72418]:     </interface>
Aug 09 18:33:04 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:33:04 user nova-compute[72418]:       <mac address="fa:16:3e:4a:b3:a4"/>
Aug 09 18:33:04 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:33:04 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:33:04 user nova-compute[72418]:       <target dev="tapbb529102-e1"/>
Aug 09 18:33:04 user nova-compute[72418]:     </interface>
Aug 09 18:33:04 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:33:04 user nova-compute[72418]:       <mac address="fa:16:3e:ff:50:55"/>
Aug 09 18:33:04 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:33:04 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:33:04 user nova-compute[72418]:       <target dev="tap3d432e6f-81"/>
Aug 09 18:33:04 user nova-compute[72418]:     </interface>
Aug 09 18:33:04 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:33:04 user nova-compute[72418]:       <mac address="fa:16:3e:e8:1b:c1"/>
Aug 09 18:33:04 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:33:04 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:33:04 user nova-compute[72418]:       <target dev="tap3cd5a4d7-5e"/>
Aug 09 18:33:04 user nova-compute[72418]:     </interface>
Aug 09 18:33:04 user nova-compute[72418]:     <serial type="pty">
Aug 09 18:33:04 user nova-compute[72418]:       <log file="/opt/stack/data/nova/instances/82d67874-5477-4554-bffc-2bf24eb28367/console.log" append="off"/>
Aug 09 18:33:04 user nova-compute[72418]:     </serial>
Aug 09 18:33:04 user nova-compute[72418]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 18:33:04 user nova-compute[72418]:     <video>
Aug 09 18:33:04 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:33:04 user nova-compute[72418]:     </video>
Aug 09 18:33:04 user nova-compute[72418]:     <rng model="virtio">
Aug 09 18:33:04 user nova-compute[72418]:       <backend model="random">/dev/urandom</backend>
Aug 09 18:33:04 user nova-compute[72418]:     </rng>
Aug 09 18:33:04 user nova-compute[72418]:     <controller type="usb" index="0" model="none"/>
Aug 09 18:33:04 user nova-compute[72418]:     <memballoon model="virtio">
Aug 09 18:33:04 user nova-compute[72418]:       <stats period="10"/>
Aug 09 18:33:04 user nova-compute[72418]:     </memballoon>
Aug 09 18:33:04 user nova-compute[72418]:   </devices>
Aug 09 18:33:04 user nova-compute[72418]: </domain>
Aug 09 18:33:04 user nova-compute[72418]:  {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 18:33:04 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T18:32:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-146038463',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-146038463',id=25,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLps7yz57S0cIqR+MidwubY3t7R2RCfbKmFUaZqcNb3jNuX4gOm5W/yhnM5SBZCJ2tBUdjMn9fHMYC8hq7ApchMsnyGU/gHVDL3/vQu07w/5OZ4oZIZxy/3huqoinWmsg==',key_name='tempest-keypair-1256803026',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32d3f1359c67450181629511bf3d908a',ramdisk_id='',reservation_id='r-tl1bs9bx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1910102697',owner_user_name='tempest-TaggedBootDevicesTest_v242-1910102697-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:32:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d01b87c4690c4a89949a5cce33bab9ab',uuid=82d67874-5477-4554-bffc-2bf24eb28367,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b07016e4-a1a6-438c-86e0-9b29f347ece4", "address": "fa:16:3e:55:82:4c", "network": {"id": "962e505b-9e11-4c96-b339-e36363ab6ef6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1326388745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb07016e4-a1", "ovs_interfaceid": "b07016e4-a1a6-438c-86e0-9b29f347ece4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:33:04 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Converting VIF {"id": "b07016e4-a1a6-438c-86e0-9b29f347ece4", "address": "fa:16:3e:55:82:4c", "network": {"id": "962e505b-9e11-4c96-b339-e36363ab6ef6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1326388745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb07016e4-a1", "ovs_interfaceid": "b07016e4-a1a6-438c-86e0-9b29f347ece4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:33:04 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:82:4c,bridge_name='br-int',has_traffic_filtering=True,id=b07016e4-a1a6-438c-86e0-9b29f347ece4,network=Network(962e505b-9e11-4c96-b339-e36363ab6ef6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb07016e4-a1') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:33:04 user nova-compute[72418]: DEBUG os_vif [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:82:4c,bridge_name='br-int',has_traffic_filtering=True,id=b07016e4-a1a6-438c-86e0-9b29f347ece4,network=Network(962e505b-9e11-4c96-b339-e36363ab6ef6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb07016e4-a1') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:33:04 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:04 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:33:04 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:33:04 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:04 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb07016e4-a1, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:33:04 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb07016e4-a1, col_values=(('external_ids', {'iface-id': 'b07016e4-a1a6-438c-86e0-9b29f347ece4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:82:4c', 'vm-uuid': '82d67874-5477-4554-bffc-2bf24eb28367'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:33:04 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:04 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:33:04 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:04 user nova-compute[72418]: INFO os_vif [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:82:4c,bridge_name='br-int',has_traffic_filtering=True,id=b07016e4-a1a6-438c-86e0-9b29f347ece4,network=Network(962e505b-9e11-4c96-b339-e36363ab6ef6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb07016e4-a1')
Aug 09 18:33:04 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T18:32:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-146038463',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-146038463',id=25,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLps7yz57S0cIqR+MidwubY3t7R2RCfbKmFUaZqcNb3jNuX4gOm5W/yhnM5SBZCJ2tBUdjMn9fHMYC8hq7ApchMsnyGU/gHVDL3/vQu07w/5OZ4oZIZxy/3huqoinWmsg==',key_name='tempest-keypair-1256803026',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32d3f1359c67450181629511bf3d908a',ramdisk_id='',reservation_id='r-tl1bs9bx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1910102697',owner_user_name='tempest-TaggedBootDevicesTest_v242-1910102697-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:32:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d01b87c4690c4a89949a5cce33bab9ab',uuid=82d67874-5477-4554-bffc-2bf24eb28367,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5c55350-ec71-4b02-90cc-ebc30e6211e5", "address": "fa:16:3e:3a:4c:d7", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c55350-ec", "ovs_interfaceid": "a5c55350-ec71-4b02-90cc-ebc30e6211e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:33:04 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Converting VIF {"id": "a5c55350-ec71-4b02-90cc-ebc30e6211e5", "address": "fa:16:3e:3a:4c:d7", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c55350-ec", "ovs_interfaceid": "a5c55350-ec71-4b02-90cc-ebc30e6211e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:33:04 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:4c:d7,bridge_name='br-int',has_traffic_filtering=True,id=a5c55350-ec71-4b02-90cc-ebc30e6211e5,network=Network(1607c003-cf2e-4a0f-9261-e0cac426786b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa5c55350-ec') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:33:04 user nova-compute[72418]: DEBUG os_vif [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:4c:d7,bridge_name='br-int',has_traffic_filtering=True,id=a5c55350-ec71-4b02-90cc-ebc30e6211e5,network=Network(1607c003-cf2e-4a0f-9261-e0cac426786b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa5c55350-ec') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:33:04 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:04 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa5c55350-ec, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa5c55350-ec, col_values=(('external_ids', {'iface-id': 'a5c55350-ec71-4b02-90cc-ebc30e6211e5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:4c:d7', 'vm-uuid': '82d67874-5477-4554-bffc-2bf24eb28367'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:05 user nova-compute[72418]: INFO os_vif [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:4c:d7,bridge_name='br-int',has_traffic_filtering=True,id=a5c55350-ec71-4b02-90cc-ebc30e6211e5,network=Network(1607c003-cf2e-4a0f-9261-e0cac426786b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa5c55350-ec')
Aug 09 18:33:05 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T18:32:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-146038463',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-146038463',id=25,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLps7yz57S0cIqR+MidwubY3t7R2RCfbKmFUaZqcNb3jNuX4gOm5W/yhnM5SBZCJ2tBUdjMn9fHMYC8hq7ApchMsnyGU/gHVDL3/vQu07w/5OZ4oZIZxy/3huqoinWmsg==',key_name='tempest-keypair-1256803026',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32d3f1359c67450181629511bf3d908a',ramdisk_id='',reservation_id='r-tl1bs9bx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1910102697',owner_user_name='tempest-TaggedBootDevicesTest_v242-1910102697-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:32:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d01b87c4690c4a89949a5cce33bab9ab',uuid=82d67874-5477-4554-bffc-2bf24eb28367,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d58b14a-e8d0-4d9d-a712-8bfaa2b74bfc", "address": "fa:16:3e:3e:b6:33", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d58b14a-e8", "ovs_interfaceid": "4d58b14a-e8d0-4d9d-a712-8bfaa2b74bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Converting VIF {"id": "4d58b14a-e8d0-4d9d-a712-8bfaa2b74bfc", "address": "fa:16:3e:3e:b6:33", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d58b14a-e8", "ovs_interfaceid": "4d58b14a-e8d0-4d9d-a712-8bfaa2b74bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:b6:33,bridge_name='br-int',has_traffic_filtering=True,id=4d58b14a-e8d0-4d9d-a712-8bfaa2b74bfc,network=Network(1607c003-cf2e-4a0f-9261-e0cac426786b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4d58b14a-e8') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG os_vif [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:b6:33,bridge_name='br-int',has_traffic_filtering=True,id=4d58b14a-e8d0-4d9d-a712-8bfaa2b74bfc,network=Network(1607c003-cf2e-4a0f-9261-e0cac426786b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4d58b14a-e8') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d58b14a-e8, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4d58b14a-e8, col_values=(('external_ids', {'iface-id': '4d58b14a-e8d0-4d9d-a712-8bfaa2b74bfc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:b6:33', 'vm-uuid': '82d67874-5477-4554-bffc-2bf24eb28367'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG nova.network.neutron [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Updating instance_info_cache with network_info: [{"id": "301d9f8c-022d-4c02-90dd-374ead3daa23", "address": "fa:16:3e:a6:38:d9", "network": {"id": "7621f03d-76ac-49da-89a8-0753bb11e329", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596253708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5242fb37f9664dbf9a8b50449f8dd129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap301d9f8c-02", "ovs_interfaceid": "301d9f8c-022d-4c02-90dd-374ead3daa23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:05 user nova-compute[72418]: INFO os_vif [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:b6:33,bridge_name='br-int',has_traffic_filtering=True,id=4d58b14a-e8d0-4d9d-a712-8bfaa2b74bfc,network=Network(1607c003-cf2e-4a0f-9261-e0cac426786b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4d58b14a-e8')
Aug 09 18:33:05 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T18:32:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-146038463',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-146038463',id=25,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLps7yz57S0cIqR+MidwubY3t7R2RCfbKmFUaZqcNb3jNuX4gOm5W/yhnM5SBZCJ2tBUdjMn9fHMYC8hq7ApchMsnyGU/gHVDL3/vQu07w/5OZ4oZIZxy/3huqoinWmsg==',key_name='tempest-keypair-1256803026',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32d3f1359c67450181629511bf3d908a',ramdisk_id='',reservation_id='r-tl1bs9bx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1910102697',owner_user_name='tempest-TaggedBootDevicesTest_v242-1910102697-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:32:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d01b87c4690c4a89949a5cce33bab9ab',uuid=82d67874-5477-4554-bffc-2bf24eb28367,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6bc46fc5-0af5-4d39-8c6e-bbbfb093af14", "address": "fa:16:3e:93:62:de", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bc46fc5-0a", "ovs_interfaceid": "6bc46fc5-0af5-4d39-8c6e-bbbfb093af14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Converting VIF {"id": "6bc46fc5-0af5-4d39-8c6e-bbbfb093af14", "address": "fa:16:3e:93:62:de", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bc46fc5-0a", "ovs_interfaceid": "6bc46fc5-0af5-4d39-8c6e-bbbfb093af14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:62:de,bridge_name='br-int',has_traffic_filtering=True,id=6bc46fc5-0af5-4d39-8c6e-bbbfb093af14,network=Network(1607c003-cf2e-4a0f-9261-e0cac426786b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bc46fc5-0a') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG os_vif [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:62:de,bridge_name='br-int',has_traffic_filtering=True,id=6bc46fc5-0af5-4d39-8c6e-bbbfb093af14,network=Network(1607c003-cf2e-4a0f-9261-e0cac426786b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bc46fc5-0a') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Releasing lock "refresh_cache-e07beace-59d8-4c02-844b-1db1a6e81198" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6bc46fc5-0a, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6bc46fc5-0a, col_values=(('external_ids', {'iface-id': '6bc46fc5-0af5-4d39-8c6e-bbbfb093af14', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:62:de', 'vm-uuid': '82d67874-5477-4554-bffc-2bf24eb28367'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:33:05 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Instance destroyed successfully.
Aug 09 18:33:05 user nova-compute[72418]: DEBUG nova.objects.instance [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lazy-loading 'resources' on Instance uuid e07beace-59d8-4c02-844b-1db1a6e81198 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:25:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-115156542',display_name='tempest-AttachVolumeTestJSON-server-115156542',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-115156542',id=16,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKIZ6czeitZd68FtX30D3PEurZKgjyFnUFrxFwHkysLhaffrzQKQu80qXZZAnkUayD+bRR0naGJJ9tbYqVXNcVqacPFRuWh7mU4dCbsXBHxDBemAgqD4XDp+3Jf6xUihXw==',key_name='tempest-keypair-957533556',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:25:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5242fb37f9664dbf9a8b50449f8dd129',ramdisk_id='',reservation_id='r-8u61z3zg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1480837700',owner_user_name='tempest-AttachVolumeTestJSON-1480837700-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:31:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='236307357ebf43bc8150f86f832260ba',uuid=e07beace-59d8-4c02-844b-1db1a6e81198,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "301d9f8c-022d-4c02-90dd-374ead3daa23", "address": "fa:16:3e:a6:38:d9", "network": {"id": "7621f03d-76ac-49da-89a8-0753bb11e329", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596253708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5242fb37f9664dbf9a8b50449f8dd129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap301d9f8c-02", "ovs_interfaceid": "301d9f8c-022d-4c02-90dd-374ead3daa23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Converting VIF {"id": "301d9f8c-022d-4c02-90dd-374ead3daa23", "address": "fa:16:3e:a6:38:d9", "network": {"id": "7621f03d-76ac-49da-89a8-0753bb11e329", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596253708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5242fb37f9664dbf9a8b50449f8dd129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap301d9f8c-02", "ovs_interfaceid": "301d9f8c-022d-4c02-90dd-374ead3daa23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:38:d9,bridge_name='br-int',has_traffic_filtering=True,id=301d9f8c-022d-4c02-90dd-374ead3daa23,network=Network(7621f03d-76ac-49da-89a8-0753bb11e329),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap301d9f8c-02') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG os_vif [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:38:d9,bridge_name='br-int',has_traffic_filtering=True,id=301d9f8c-022d-4c02-90dd-374ead3daa23,network=Network(7621f03d-76ac-49da-89a8-0753bb11e329),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap301d9f8c-02') {{(pid=72418) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:05 user nova-compute[72418]: INFO os_vif [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:62:de,bridge_name='br-int',has_traffic_filtering=True,id=6bc46fc5-0af5-4d39-8c6e-bbbfb093af14,network=Network(1607c003-cf2e-4a0f-9261-e0cac426786b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bc46fc5-0a')
Aug 09 18:33:05 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T18:32:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-146038463',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-146038463',id=25,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLps7yz57S0cIqR+MidwubY3t7R2RCfbKmFUaZqcNb3jNuX4gOm5W/yhnM5SBZCJ2tBUdjMn9fHMYC8hq7ApchMsnyGU/gHVDL3/vQu07w/5OZ4oZIZxy/3huqoinWmsg==',key_name='tempest-keypair-1256803026',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32d3f1359c67450181629511bf3d908a',ramdisk_id='',reservation_id='r-tl1bs9bx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1910102697',owner_user_name='tempest-TaggedBootDevicesTest_v242-1910102697-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:32:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d01b87c4690c4a89949a5cce33bab9ab',uuid=82d67874-5477-4554-bffc-2bf24eb28367,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb529102-e1c1-4932-a2b2-8c411d29ca58", "address": "fa:16:3e:4a:b3:a4", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb529102-e1", "ovs_interfaceid": "bb529102-e1c1-4932-a2b2-8c411d29ca58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Converting VIF {"id": "bb529102-e1c1-4932-a2b2-8c411d29ca58", "address": "fa:16:3e:4a:b3:a4", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb529102-e1", "ovs_interfaceid": "bb529102-e1c1-4932-a2b2-8c411d29ca58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:b3:a4,bridge_name='br-int',has_traffic_filtering=True,id=bb529102-e1c1-4932-a2b2-8c411d29ca58,network=Network(1607c003-cf2e-4a0f-9261-e0cac426786b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb529102-e1') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG os_vif [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:b3:a4,bridge_name='br-int',has_traffic_filtering=True,id=bb529102-e1c1-4932-a2b2-8c411d29ca58,network=Network(1607c003-cf2e-4a0f-9261-e0cac426786b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb529102-e1') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap301d9f8c-02, bridge=br-int, if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:33:05 user nova-compute[72418]: INFO os_vif [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:38:d9,bridge_name='br-int',has_traffic_filtering=True,id=301d9f8c-022d-4c02-90dd-374ead3daa23,network=Network(7621f03d-76ac-49da-89a8-0753bb11e329),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap301d9f8c-02')
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbb529102-e1, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbb529102-e1, col_values=(('external_ids', {'iface-id': 'bb529102-e1c1-4932-a2b2-8c411d29ca58', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:b3:a4', 'vm-uuid': '82d67874-5477-4554-bffc-2bf24eb28367'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Start _get_guest_xml network_info=[{"id": "301d9f8c-022d-4c02-90dd-374ead3daa23", "address": "fa:16:3e:a6:38:d9", "network": {"id": "7621f03d-76ac-49da-89a8-0753bb11e329", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596253708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5242fb37f9664dbf9a8b50449f8dd129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap301d9f8c-02", "ovs_interfaceid": "301d9f8c-022d-4c02-90dd-374ead3daa23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG nova.objects.instance [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lazy-loading 'numa_topology' on Instance uuid e07beace-59d8-4c02-844b-1db1a6e81198 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:33:05 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:33:05 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:33:05 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] CPU controller missing on host. {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] CPU controller found on host. {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72418) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T18:17:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Flavor limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Image limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Flavor pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Image pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Got 1 possible topologies {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG nova.objects.instance [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lazy-loading 'vcpu_model' on Instance uuid e07beace-59d8-4c02-844b-1db1a6e81198 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:05 user nova-compute[72418]: INFO os_vif [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:b3:a4,bridge_name='br-int',has_traffic_filtering=True,id=bb529102-e1c1-4932-a2b2-8c411d29ca58,network=Network(1607c003-cf2e-4a0f-9261-e0cac426786b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb529102-e1')
Aug 09 18:33:05 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T18:32:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-146038463',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-146038463',id=25,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLps7yz57S0cIqR+MidwubY3t7R2RCfbKmFUaZqcNb3jNuX4gOm5W/yhnM5SBZCJ2tBUdjMn9fHMYC8hq7ApchMsnyGU/gHVDL3/vQu07w/5OZ4oZIZxy/3huqoinWmsg==',key_name='tempest-keypair-1256803026',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32d3f1359c67450181629511bf3d908a',ramdisk_id='',reservation_id='r-tl1bs9bx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1910102697',owner_user_name='tempest-TaggedBootDevicesTest_v242-1910102697-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:32:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d01b87c4690c4a89949a5cce33bab9ab',uuid=82d67874-5477-4554-bffc-2bf24eb28367,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d432e6f-81b2-4c44-bb25-b3d35941a43c", "address": "fa:16:3e:ff:50:55", "network": {"id": "dc14bb1f-2228-427b-88a6-852777894bc3", "bridge": "br-int", "label": "tempest-device-tagging-net2-2080696379", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d432e6f-81", "ovs_interfaceid": "3d432e6f-81b2-4c44-bb25-b3d35941a43c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Converting VIF {"id": "3d432e6f-81b2-4c44-bb25-b3d35941a43c", "address": "fa:16:3e:ff:50:55", "network": {"id": "dc14bb1f-2228-427b-88a6-852777894bc3", "bridge": "br-int", "label": "tempest-device-tagging-net2-2080696379", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d432e6f-81", "ovs_interfaceid": "3d432e6f-81b2-4c44-bb25-b3d35941a43c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:50:55,bridge_name='br-int',has_traffic_filtering=True,id=3d432e6f-81b2-4c44-bb25-b3d35941a43c,network=Network(dc14bb1f-2228-427b-88a6-852777894bc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d432e6f-81') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG os_vif [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:50:55,bridge_name='br-int',has_traffic_filtering=True,id=3d432e6f-81b2-4c44-bb25-b3d35941a43c,network=Network(dc14bb1f-2228-427b-88a6-852777894bc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d432e6f-81') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:25:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-115156542',display_name='tempest-AttachVolumeTestJSON-server-115156542',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-115156542',id=16,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKIZ6czeitZd68FtX30D3PEurZKgjyFnUFrxFwHkysLhaffrzQKQu80qXZZAnkUayD+bRR0naGJJ9tbYqVXNcVqacPFRuWh7mU4dCbsXBHxDBemAgqD4XDp+3Jf6xUihXw==',key_name='tempest-keypair-957533556',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:25:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5242fb37f9664dbf9a8b50449f8dd129',ramdisk_id='',reservation_id='r-8u61z3zg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1480837700',owner_user_name='tempest-AttachVolumeTestJSON-1480837700-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:31:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='236307357ebf43bc8150f86f832260ba',uuid=e07beace-59d8-4c02-844b-1db1a6e81198,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "301d9f8c-022d-4c02-90dd-374ead3daa23", "address": "fa:16:3e:a6:38:d9", "network": {"id": "7621f03d-76ac-49da-89a8-0753bb11e329", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596253708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5242fb37f9664dbf9a8b50449f8dd129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap301d9f8c-02", "ovs_interfaceid": "301d9f8c-022d-4c02-90dd-374ead3daa23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Converting VIF {"id": "301d9f8c-022d-4c02-90dd-374ead3daa23", "address": "fa:16:3e:a6:38:d9", "network": {"id": "7621f03d-76ac-49da-89a8-0753bb11e329", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596253708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5242fb37f9664dbf9a8b50449f8dd129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap301d9f8c-02", "ovs_interfaceid": "301d9f8c-022d-4c02-90dd-374ead3daa23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:38:d9,bridge_name='br-int',has_traffic_filtering=True,id=301d9f8c-022d-4c02-90dd-374ead3daa23,network=Network(7621f03d-76ac-49da-89a8-0753bb11e329),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap301d9f8c-02') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG nova.objects.instance [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lazy-loading 'pci_devices' on Instance uuid e07beace-59d8-4c02-844b-1db1a6e81198 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d432e6f-81, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3d432e6f-81, col_values=(('external_ids', {'iface-id': '3d432e6f-81b2-4c44-bb25-b3d35941a43c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:50:55', 'vm-uuid': '82d67874-5477-4554-bffc-2bf24eb28367'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] End _get_guest_xml xml=<domain type="kvm">
Aug 09 18:33:05 user nova-compute[72418]:   <uuid>e07beace-59d8-4c02-844b-1db1a6e81198</uuid>
Aug 09 18:33:05 user nova-compute[72418]:   <name>instance-00000010</name>
Aug 09 18:33:05 user nova-compute[72418]:   <memory>524288</memory>
Aug 09 18:33:05 user nova-compute[72418]:   <vcpu>1</vcpu>
Aug 09 18:33:05 user nova-compute[72418]:   <metadata>
Aug 09 18:33:05 user nova-compute[72418]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:33:05 user nova-compute[72418]:       <nova:package version="0.0.0"/>
Aug 09 18:33:05 user nova-compute[72418]:       <nova:name>tempest-AttachVolumeTestJSON-server-115156542</nova:name>
Aug 09 18:33:05 user nova-compute[72418]:       <nova:creationTime>2023-08-09 18:33:05</nova:creationTime>
Aug 09 18:33:05 user nova-compute[72418]:       <nova:flavor name="m1.tiny">
Aug 09 18:33:05 user nova-compute[72418]:         <nova:memory>512</nova:memory>
Aug 09 18:33:05 user nova-compute[72418]:         <nova:disk>1</nova:disk>
Aug 09 18:33:05 user nova-compute[72418]:         <nova:swap>0</nova:swap>
Aug 09 18:33:05 user nova-compute[72418]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:33:05 user nova-compute[72418]:         <nova:vcpus>1</nova:vcpus>
Aug 09 18:33:05 user nova-compute[72418]:       </nova:flavor>
Aug 09 18:33:05 user nova-compute[72418]:       <nova:owner>
Aug 09 18:33:05 user nova-compute[72418]:         <nova:user uuid="236307357ebf43bc8150f86f832260ba">tempest-AttachVolumeTestJSON-1480837700-project-member</nova:user>
Aug 09 18:33:05 user nova-compute[72418]:         <nova:project uuid="5242fb37f9664dbf9a8b50449f8dd129">tempest-AttachVolumeTestJSON-1480837700</nova:project>
Aug 09 18:33:05 user nova-compute[72418]:       </nova:owner>
Aug 09 18:33:05 user nova-compute[72418]:       <nova:root type="image" uuid="8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e"/>
Aug 09 18:33:05 user nova-compute[72418]:       <nova:ports>
Aug 09 18:33:05 user nova-compute[72418]:         <nova:port uuid="301d9f8c-022d-4c02-90dd-374ead3daa23">
Aug 09 18:33:05 user nova-compute[72418]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 09 18:33:05 user nova-compute[72418]:         </nova:port>
Aug 09 18:33:05 user nova-compute[72418]:       </nova:ports>
Aug 09 18:33:05 user nova-compute[72418]:     </nova:instance>
Aug 09 18:33:05 user nova-compute[72418]:   </metadata>
Aug 09 18:33:05 user nova-compute[72418]:   <sysinfo type="smbios">
Aug 09 18:33:05 user nova-compute[72418]:     <system>
Aug 09 18:33:05 user nova-compute[72418]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 18:33:05 user nova-compute[72418]:       <entry name="product">OpenStack Nova</entry>
Aug 09 18:33:05 user nova-compute[72418]:       <entry name="version">0.0.0</entry>
Aug 09 18:33:05 user nova-compute[72418]:       <entry name="serial">e07beace-59d8-4c02-844b-1db1a6e81198</entry>
Aug 09 18:33:05 user nova-compute[72418]:       <entry name="uuid">e07beace-59d8-4c02-844b-1db1a6e81198</entry>
Aug 09 18:33:05 user nova-compute[72418]:       <entry name="family">Virtual Machine</entry>
Aug 09 18:33:05 user nova-compute[72418]:     </system>
Aug 09 18:33:05 user nova-compute[72418]:   </sysinfo>
Aug 09 18:33:05 user nova-compute[72418]:   <os>
Aug 09 18:33:05 user nova-compute[72418]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 18:33:05 user nova-compute[72418]:     <boot dev="hd"/>
Aug 09 18:33:05 user nova-compute[72418]:     <smbios mode="sysinfo"/>
Aug 09 18:33:05 user nova-compute[72418]:   </os>
Aug 09 18:33:05 user nova-compute[72418]:   <features>
Aug 09 18:33:05 user nova-compute[72418]:     <acpi/>
Aug 09 18:33:05 user nova-compute[72418]:     <apic/>
Aug 09 18:33:05 user nova-compute[72418]:     <vmcoreinfo/>
Aug 09 18:33:05 user nova-compute[72418]:   </features>
Aug 09 18:33:05 user nova-compute[72418]:   <clock offset="utc">
Aug 09 18:33:05 user nova-compute[72418]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 18:33:05 user nova-compute[72418]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 18:33:05 user nova-compute[72418]:     <timer name="hpet" present="no"/>
Aug 09 18:33:05 user nova-compute[72418]:   </clock>
Aug 09 18:33:05 user nova-compute[72418]:   <cpu mode="custom" match="exact">
Aug 09 18:33:05 user nova-compute[72418]:     <model>Nehalem</model>
Aug 09 18:33:05 user nova-compute[72418]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 18:33:05 user nova-compute[72418]:   </cpu>
Aug 09 18:33:05 user nova-compute[72418]:   <devices>
Aug 09 18:33:05 user nova-compute[72418]:     <disk type="file" device="disk">
Aug 09 18:33:05 user nova-compute[72418]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 18:33:05 user nova-compute[72418]:       <source file="/opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk"/>
Aug 09 18:33:05 user nova-compute[72418]:       <target dev="vda" bus="virtio"/>
Aug 09 18:33:05 user nova-compute[72418]:     </disk>
Aug 09 18:33:05 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:33:05 user nova-compute[72418]:       <mac address="fa:16:3e:a6:38:d9"/>
Aug 09 18:33:05 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:33:05 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:33:05 user nova-compute[72418]:       <target dev="tap301d9f8c-02"/>
Aug 09 18:33:05 user nova-compute[72418]:     </interface>
Aug 09 18:33:05 user nova-compute[72418]:     <serial type="pty">
Aug 09 18:33:05 user nova-compute[72418]:       <log file="/opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/console.log" append="off"/>
Aug 09 18:33:05 user nova-compute[72418]:     </serial>
Aug 09 18:33:05 user nova-compute[72418]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 18:33:05 user nova-compute[72418]:     <video>
Aug 09 18:33:05 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:33:05 user nova-compute[72418]:     </video>
Aug 09 18:33:05 user nova-compute[72418]:     <rng model="virtio">
Aug 09 18:33:05 user nova-compute[72418]:       <backend model="random">/dev/urandom</backend>
Aug 09 18:33:05 user nova-compute[72418]:     </rng>
Aug 09 18:33:05 user nova-compute[72418]:     <controller type="usb" index="0" model="none"/>
Aug 09 18:33:05 user nova-compute[72418]:     <memballoon model="virtio">
Aug 09 18:33:05 user nova-compute[72418]:       <stats period="10"/>
Aug 09 18:33:05 user nova-compute[72418]:     </memballoon>
Aug 09 18:33:05 user nova-compute[72418]:   </devices>
Aug 09 18:33:05 user nova-compute[72418]: </domain>
Aug 09 18:33:05 user nova-compute[72418]:  {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:05 user nova-compute[72418]: INFO os_vif [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:50:55,bridge_name='br-int',has_traffic_filtering=True,id=3d432e6f-81b2-4c44-bb25-b3d35941a43c,network=Network(dc14bb1f-2228-427b-88a6-852777894bc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d432e6f-81')
Aug 09 18:33:05 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T18:32:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-146038463',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-146038463',id=25,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLps7yz57S0cIqR+MidwubY3t7R2RCfbKmFUaZqcNb3jNuX4gOm5W/yhnM5SBZCJ2tBUdjMn9fHMYC8hq7ApchMsnyGU/gHVDL3/vQu07w/5OZ4oZIZxy/3huqoinWmsg==',key_name='tempest-keypair-1256803026',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32d3f1359c67450181629511bf3d908a',ramdisk_id='',reservation_id='r-tl1bs9bx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1910102697',owner_user_name='tempest-TaggedBootDevicesTest_v242-1910102697-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:32:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d01b87c4690c4a89949a5cce33bab9ab',uuid=82d67874-5477-4554-bffc-2bf24eb28367,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3cd5a4d7-5e70-42d3-b3bd-8d9262131f59", "address": "fa:16:3e:e8:1b:c1", "network": {"id": "dc14bb1f-2228-427b-88a6-852777894bc3", "bridge": "br-int", "label": "tempest-device-tagging-net2-2080696379", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cd5a4d7-5e", "ovs_interfaceid": "3cd5a4d7-5e70-42d3-b3bd-8d9262131f59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Converting VIF {"id": "3cd5a4d7-5e70-42d3-b3bd-8d9262131f59", "address": "fa:16:3e:e8:1b:c1", "network": {"id": "dc14bb1f-2228-427b-88a6-852777894bc3", "bridge": "br-int", "label": "tempest-device-tagging-net2-2080696379", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cd5a4d7-5e", "ovs_interfaceid": "3cd5a4d7-5e70-42d3-b3bd-8d9262131f59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:1b:c1,bridge_name='br-int',has_traffic_filtering=True,id=3cd5a4d7-5e70-42d3-b3bd-8d9262131f59,network=Network(dc14bb1f-2228-427b-88a6-852777894bc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cd5a4d7-5e') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG os_vif [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:1b:c1,bridge_name='br-int',has_traffic_filtering=True,id=3cd5a4d7-5e70-42d3-b3bd-8d9262131f59,network=Network(dc14bb1f-2228-427b-88a6-852777894bc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cd5a4d7-5e') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3cd5a4d7-5e, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3cd5a4d7-5e, col_values=(('external_ids', {'iface-id': '3cd5a4d7-5e70-42d3-b3bd-8d9262131f59', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:1b:c1', 'vm-uuid': '82d67874-5477-4554-bffc-2bf24eb28367'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:05 user nova-compute[72418]: INFO os_vif [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:1b:c1,bridge_name='br-int',has_traffic_filtering=True,id=3cd5a4d7-5e70-42d3-b3bd-8d9262131f59,network=Network(dc14bb1f-2228-427b-88a6-852777894bc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cd5a4d7-5e')
Aug 09 18:33:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] No BDM found with device name hda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] No VIF found with MAC fa:16:3e:55:82:4c, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] No VIF found with MAC fa:16:3e:4a:b3:a4, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:33:05 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Using config drive
Aug 09 18:33:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG nova.objects.instance [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lazy-loading 'trusted_certs' on Instance uuid e07beace-59d8-4c02-844b-1db1a6e81198 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:05 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Creating config drive at /opt/stack/data/nova/instances/82d67874-5477-4554-bffc-2bf24eb28367/disk.config
Aug 09 18:33:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/82d67874-5477-4554-bffc-2bf24eb28367/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp8ock6dj7 {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.175s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk. size=1073741824 {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/82d67874-5477-4554-bffc-2bf24eb28367/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp8ock6dj7" returned: 0 in 0.081s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Cannot resize image /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk to a smaller size. {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG nova.objects.instance [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lazy-loading 'migration_context' on Instance uuid e07beace-59d8-4c02-844b-1db1a6e81198 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:25:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-115156542',display_name='tempest-AttachVolumeTestJSON-server-115156542',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-115156542',id=16,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKIZ6czeitZd68FtX30D3PEurZKgjyFnUFrxFwHkysLhaffrzQKQu80qXZZAnkUayD+bRR0naGJJ9tbYqVXNcVqacPFRuWh7mU4dCbsXBHxDBemAgqD4XDp+3Jf6xUihXw==',key_name='tempest-keypair-957533556',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:25:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='5242fb37f9664dbf9a8b50449f8dd129',ramdisk_id='',reservation_id='r-8u61z3zg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1480837700',owner_user_name='tempest-AttachVolumeTestJSON-1480837700-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:31:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='236307357ebf43bc8150f86f832260ba',uuid=e07beace-59d8-4c02-844b-1db1a6e81198,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "301d9f8c-022d-4c02-90dd-374ead3daa23", "address": "fa:16:3e:a6:38:d9", "network": {"id": "7621f03d-76ac-49da-89a8-0753bb11e329", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596253708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5242fb37f9664dbf9a8b50449f8dd129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap301d9f8c-02", "ovs_interfaceid": "301d9f8c-022d-4c02-90dd-374ead3daa23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Converting VIF {"id": "301d9f8c-022d-4c02-90dd-374ead3daa23", "address": "fa:16:3e:a6:38:d9", "network": {"id": "7621f03d-76ac-49da-89a8-0753bb11e329", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596253708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5242fb37f9664dbf9a8b50449f8dd129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap301d9f8c-02", "ovs_interfaceid": "301d9f8c-022d-4c02-90dd-374ead3daa23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:38:d9,bridge_name='br-int',has_traffic_filtering=True,id=301d9f8c-022d-4c02-90dd-374ead3daa23,network=Network(7621f03d-76ac-49da-89a8-0753bb11e329),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap301d9f8c-02') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG os_vif [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:38:d9,bridge_name='br-int',has_traffic_filtering=True,id=301d9f8c-022d-4c02-90dd-374ead3daa23,network=Network(7621f03d-76ac-49da-89a8-0753bb11e329),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap301d9f8c-02') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:33:06 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:33:06 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:06 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap301d9f8c-02, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:33:06 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap301d9f8c-02, col_values=(('external_ids', {'iface-id': '301d9f8c-022d-4c02-90dd-374ead3daa23', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:38:d9', 'vm-uuid': 'e07beace-59d8-4c02-844b-1db1a6e81198'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:33:06 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:06 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:33:06 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:06 user nova-compute[72418]: INFO os_vif [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:38:d9,bridge_name='br-int',has_traffic_filtering=True,id=301d9f8c-022d-4c02-90dd-374ead3daa23,network=Network(7621f03d-76ac-49da-89a8-0753bb11e329),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap301d9f8c-02')
Aug 09 18:33:07 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:08 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:08 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:08 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:08 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:08 user nova-compute[72418]: DEBUG nova.compute.manager [req-6b25295c-2d8d-4250-a561-53b7e277f0da req-fda6c336-fc51-4575-8473-2901c837698a service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received event network-vif-plugged-b07016e4-a1a6-438c-86e0-9b29f347ece4 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:33:08 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-6b25295c-2d8d-4250-a561-53b7e277f0da req-fda6c336-fc51-4575-8473-2901c837698a service nova] Acquiring lock "82d67874-5477-4554-bffc-2bf24eb28367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:33:08 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-6b25295c-2d8d-4250-a561-53b7e277f0da req-fda6c336-fc51-4575-8473-2901c837698a service nova] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:33:08 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-6b25295c-2d8d-4250-a561-53b7e277f0da req-fda6c336-fc51-4575-8473-2901c837698a service nova] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:33:08 user nova-compute[72418]: DEBUG nova.compute.manager [req-6b25295c-2d8d-4250-a561-53b7e277f0da req-fda6c336-fc51-4575-8473-2901c837698a service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] No waiting events found dispatching network-vif-plugged-b07016e4-a1a6-438c-86e0-9b29f347ece4 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:33:08 user nova-compute[72418]: WARNING nova.compute.manager [req-6b25295c-2d8d-4250-a561-53b7e277f0da req-fda6c336-fc51-4575-8473-2901c837698a service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received unexpected event network-vif-plugged-b07016e4-a1a6-438c-86e0-9b29f347ece4 for instance with vm_state building and task_state spawning.
Aug 09 18:33:08 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:08 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:08 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:08 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:08 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:08 user nova-compute[72418]: DEBUG nova.compute.manager [req-1adb8bdb-cf82-43ab-a494-ebce0ed67bbe req-9026b37a-0467-4df6-a405-c8b7f442bdf8 service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Received event network-vif-plugged-301d9f8c-022d-4c02-90dd-374ead3daa23 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:33:08 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-1adb8bdb-cf82-43ab-a494-ebce0ed67bbe req-9026b37a-0467-4df6-a405-c8b7f442bdf8 service nova] Acquiring lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:33:08 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-1adb8bdb-cf82-43ab-a494-ebce0ed67bbe req-9026b37a-0467-4df6-a405-c8b7f442bdf8 service nova] Lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:33:08 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-1adb8bdb-cf82-43ab-a494-ebce0ed67bbe req-9026b37a-0467-4df6-a405-c8b7f442bdf8 service nova] Lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:33:08 user nova-compute[72418]: DEBUG nova.compute.manager [req-1adb8bdb-cf82-43ab-a494-ebce0ed67bbe req-9026b37a-0467-4df6-a405-c8b7f442bdf8 service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] No waiting events found dispatching network-vif-plugged-301d9f8c-022d-4c02-90dd-374ead3daa23 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:33:08 user nova-compute[72418]: WARNING nova.compute.manager [req-1adb8bdb-cf82-43ab-a494-ebce0ed67bbe req-9026b37a-0467-4df6-a405-c8b7f442bdf8 service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Received unexpected event network-vif-plugged-301d9f8c-022d-4c02-90dd-374ead3daa23 for instance with vm_state stopped and task_state powering-on.
Aug 09 18:33:09 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:09 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:09 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:09 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:09 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:09 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:09 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:09 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:09 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:09 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:10 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:10 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:10 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:10 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:10 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:10 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:10 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:10 user nova-compute[72418]: DEBUG nova.compute.manager [req-d08b09ec-fa31-4fee-80f3-4158bbc8a091 req-48335635-abf0-4d25-ac94-9794cbef0e44 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received event network-vif-plugged-b07016e4-a1a6-438c-86e0-9b29f347ece4 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:33:10 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-d08b09ec-fa31-4fee-80f3-4158bbc8a091 req-48335635-abf0-4d25-ac94-9794cbef0e44 service nova] Acquiring lock "82d67874-5477-4554-bffc-2bf24eb28367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:33:10 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-d08b09ec-fa31-4fee-80f3-4158bbc8a091 req-48335635-abf0-4d25-ac94-9794cbef0e44 service nova] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:33:10 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-d08b09ec-fa31-4fee-80f3-4158bbc8a091 req-48335635-abf0-4d25-ac94-9794cbef0e44 service nova] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:33:10 user nova-compute[72418]: DEBUG nova.compute.manager [req-d08b09ec-fa31-4fee-80f3-4158bbc8a091 req-48335635-abf0-4d25-ac94-9794cbef0e44 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] No waiting events found dispatching network-vif-plugged-b07016e4-a1a6-438c-86e0-9b29f347ece4 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:33:10 user nova-compute[72418]: WARNING nova.compute.manager [req-d08b09ec-fa31-4fee-80f3-4158bbc8a091 req-48335635-abf0-4d25-ac94-9794cbef0e44 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received unexpected event network-vif-plugged-b07016e4-a1a6-438c-86e0-9b29f347ece4 for instance with vm_state building and task_state spawning.
Aug 09 18:33:10 user nova-compute[72418]: DEBUG nova.compute.manager [req-d08b09ec-fa31-4fee-80f3-4158bbc8a091 req-48335635-abf0-4d25-ac94-9794cbef0e44 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received event network-vif-plugged-4d58b14a-e8d0-4d9d-a712-8bfaa2b74bfc {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:33:10 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-d08b09ec-fa31-4fee-80f3-4158bbc8a091 req-48335635-abf0-4d25-ac94-9794cbef0e44 service nova] Acquiring lock "82d67874-5477-4554-bffc-2bf24eb28367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:33:10 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-d08b09ec-fa31-4fee-80f3-4158bbc8a091 req-48335635-abf0-4d25-ac94-9794cbef0e44 service nova] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:33:10 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-d08b09ec-fa31-4fee-80f3-4158bbc8a091 req-48335635-abf0-4d25-ac94-9794cbef0e44 service nova] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:33:10 user nova-compute[72418]: DEBUG nova.compute.manager [req-d08b09ec-fa31-4fee-80f3-4158bbc8a091 req-48335635-abf0-4d25-ac94-9794cbef0e44 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] No waiting events found dispatching network-vif-plugged-4d58b14a-e8d0-4d9d-a712-8bfaa2b74bfc {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:33:10 user nova-compute[72418]: WARNING nova.compute.manager [req-d08b09ec-fa31-4fee-80f3-4158bbc8a091 req-48335635-abf0-4d25-ac94-9794cbef0e44 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received unexpected event network-vif-plugged-4d58b14a-e8d0-4d9d-a712-8bfaa2b74bfc for instance with vm_state building and task_state spawning.
Aug 09 18:33:10 user nova-compute[72418]: DEBUG nova.compute.manager [req-d08b09ec-fa31-4fee-80f3-4158bbc8a091 req-48335635-abf0-4d25-ac94-9794cbef0e44 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received event network-vif-plugged-4d58b14a-e8d0-4d9d-a712-8bfaa2b74bfc {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:33:10 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-d08b09ec-fa31-4fee-80f3-4158bbc8a091 req-48335635-abf0-4d25-ac94-9794cbef0e44 service nova] Acquiring lock "82d67874-5477-4554-bffc-2bf24eb28367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:33:10 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-d08b09ec-fa31-4fee-80f3-4158bbc8a091 req-48335635-abf0-4d25-ac94-9794cbef0e44 service nova] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:33:10 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-d08b09ec-fa31-4fee-80f3-4158bbc8a091 req-48335635-abf0-4d25-ac94-9794cbef0e44 service nova] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:33:10 user nova-compute[72418]: DEBUG nova.compute.manager [req-d08b09ec-fa31-4fee-80f3-4158bbc8a091 req-48335635-abf0-4d25-ac94-9794cbef0e44 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] No waiting events found dispatching network-vif-plugged-4d58b14a-e8d0-4d9d-a712-8bfaa2b74bfc {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:33:10 user nova-compute[72418]: WARNING nova.compute.manager [req-d08b09ec-fa31-4fee-80f3-4158bbc8a091 req-48335635-abf0-4d25-ac94-9794cbef0e44 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received unexpected event network-vif-plugged-4d58b14a-e8d0-4d9d-a712-8bfaa2b74bfc for instance with vm_state building and task_state spawning.
Aug 09 18:33:10 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:10 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:10 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:11 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:11 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:11 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:11 user nova-compute[72418]: DEBUG nova.compute.manager [req-c1685357-0300-4f05-b2f8-9513581c2ad0 req-bf69ef96-6807-4a54-a034-cea8a44b2807 service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Received event network-vif-plugged-301d9f8c-022d-4c02-90dd-374ead3daa23 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:33:11 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-c1685357-0300-4f05-b2f8-9513581c2ad0 req-bf69ef96-6807-4a54-a034-cea8a44b2807 service nova] Acquiring lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:33:11 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-c1685357-0300-4f05-b2f8-9513581c2ad0 req-bf69ef96-6807-4a54-a034-cea8a44b2807 service nova] Lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:33:11 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-c1685357-0300-4f05-b2f8-9513581c2ad0 req-bf69ef96-6807-4a54-a034-cea8a44b2807 service nova] Lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:33:11 user nova-compute[72418]: DEBUG nova.compute.manager [req-c1685357-0300-4f05-b2f8-9513581c2ad0 req-bf69ef96-6807-4a54-a034-cea8a44b2807 service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] No waiting events found dispatching network-vif-plugged-301d9f8c-022d-4c02-90dd-374ead3daa23 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:33:11 user nova-compute[72418]: WARNING nova.compute.manager [req-c1685357-0300-4f05-b2f8-9513581c2ad0 req-bf69ef96-6807-4a54-a034-cea8a44b2807 service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Received unexpected event network-vif-plugged-301d9f8c-022d-4c02-90dd-374ead3daa23 for instance with vm_state stopped and task_state powering-on.
Aug 09 18:33:11 user nova-compute[72418]: DEBUG nova.compute.manager [req-c1685357-0300-4f05-b2f8-9513581c2ad0 req-bf69ef96-6807-4a54-a034-cea8a44b2807 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received event network-vif-plugged-a5c55350-ec71-4b02-90cc-ebc30e6211e5 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:33:11 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-c1685357-0300-4f05-b2f8-9513581c2ad0 req-bf69ef96-6807-4a54-a034-cea8a44b2807 service nova] Acquiring lock "82d67874-5477-4554-bffc-2bf24eb28367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:33:11 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-c1685357-0300-4f05-b2f8-9513581c2ad0 req-bf69ef96-6807-4a54-a034-cea8a44b2807 service nova] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:33:11 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-c1685357-0300-4f05-b2f8-9513581c2ad0 req-bf69ef96-6807-4a54-a034-cea8a44b2807 service nova] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:33:11 user nova-compute[72418]: DEBUG nova.compute.manager [req-c1685357-0300-4f05-b2f8-9513581c2ad0 req-bf69ef96-6807-4a54-a034-cea8a44b2807 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] No waiting events found dispatching network-vif-plugged-a5c55350-ec71-4b02-90cc-ebc30e6211e5 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:33:11 user nova-compute[72418]: WARNING nova.compute.manager [req-c1685357-0300-4f05-b2f8-9513581c2ad0 req-bf69ef96-6807-4a54-a034-cea8a44b2807 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received unexpected event network-vif-plugged-a5c55350-ec71-4b02-90cc-ebc30e6211e5 for instance with vm_state building and task_state spawning.
Aug 09 18:33:11 user nova-compute[72418]: DEBUG nova.compute.manager [req-c1685357-0300-4f05-b2f8-9513581c2ad0 req-bf69ef96-6807-4a54-a034-cea8a44b2807 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received event network-vif-plugged-a5c55350-ec71-4b02-90cc-ebc30e6211e5 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:33:11 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-c1685357-0300-4f05-b2f8-9513581c2ad0 req-bf69ef96-6807-4a54-a034-cea8a44b2807 service nova] Acquiring lock "82d67874-5477-4554-bffc-2bf24eb28367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:33:11 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-c1685357-0300-4f05-b2f8-9513581c2ad0 req-bf69ef96-6807-4a54-a034-cea8a44b2807 service nova] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:33:11 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-c1685357-0300-4f05-b2f8-9513581c2ad0 req-bf69ef96-6807-4a54-a034-cea8a44b2807 service nova] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:33:11 user nova-compute[72418]: DEBUG nova.compute.manager [req-c1685357-0300-4f05-b2f8-9513581c2ad0 req-bf69ef96-6807-4a54-a034-cea8a44b2807 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] No waiting events found dispatching network-vif-plugged-a5c55350-ec71-4b02-90cc-ebc30e6211e5 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:33:11 user nova-compute[72418]: WARNING nova.compute.manager [req-c1685357-0300-4f05-b2f8-9513581c2ad0 req-bf69ef96-6807-4a54-a034-cea8a44b2807 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received unexpected event network-vif-plugged-a5c55350-ec71-4b02-90cc-ebc30e6211e5 for instance with vm_state building and task_state spawning.
Aug 09 18:33:11 user nova-compute[72418]: DEBUG nova.compute.manager [req-c1685357-0300-4f05-b2f8-9513581c2ad0 req-bf69ef96-6807-4a54-a034-cea8a44b2807 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received event network-vif-plugged-6bc46fc5-0af5-4d39-8c6e-bbbfb093af14 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:33:11 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-c1685357-0300-4f05-b2f8-9513581c2ad0 req-bf69ef96-6807-4a54-a034-cea8a44b2807 service nova] Acquiring lock "82d67874-5477-4554-bffc-2bf24eb28367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:33:11 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-c1685357-0300-4f05-b2f8-9513581c2ad0 req-bf69ef96-6807-4a54-a034-cea8a44b2807 service nova] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:33:11 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-c1685357-0300-4f05-b2f8-9513581c2ad0 req-bf69ef96-6807-4a54-a034-cea8a44b2807 service nova] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:33:11 user nova-compute[72418]: DEBUG nova.compute.manager [req-c1685357-0300-4f05-b2f8-9513581c2ad0 req-bf69ef96-6807-4a54-a034-cea8a44b2807 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] No waiting events found dispatching network-vif-plugged-6bc46fc5-0af5-4d39-8c6e-bbbfb093af14 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:33:11 user nova-compute[72418]: WARNING nova.compute.manager [req-c1685357-0300-4f05-b2f8-9513581c2ad0 req-bf69ef96-6807-4a54-a034-cea8a44b2807 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received unexpected event network-vif-plugged-6bc46fc5-0af5-4d39-8c6e-bbbfb093af14 for instance with vm_state building and task_state spawning.
Aug 09 18:33:11 user nova-compute[72418]: DEBUG nova.compute.manager [req-c1685357-0300-4f05-b2f8-9513581c2ad0 req-bf69ef96-6807-4a54-a034-cea8a44b2807 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received event network-vif-plugged-6bc46fc5-0af5-4d39-8c6e-bbbfb093af14 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:33:11 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-c1685357-0300-4f05-b2f8-9513581c2ad0 req-bf69ef96-6807-4a54-a034-cea8a44b2807 service nova] Acquiring lock "82d67874-5477-4554-bffc-2bf24eb28367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:33:11 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-c1685357-0300-4f05-b2f8-9513581c2ad0 req-bf69ef96-6807-4a54-a034-cea8a44b2807 service nova] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:33:11 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-c1685357-0300-4f05-b2f8-9513581c2ad0 req-bf69ef96-6807-4a54-a034-cea8a44b2807 service nova] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:33:11 user nova-compute[72418]: DEBUG nova.compute.manager [req-c1685357-0300-4f05-b2f8-9513581c2ad0 req-bf69ef96-6807-4a54-a034-cea8a44b2807 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] No waiting events found dispatching network-vif-plugged-6bc46fc5-0af5-4d39-8c6e-bbbfb093af14 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:33:11 user nova-compute[72418]: WARNING nova.compute.manager [req-c1685357-0300-4f05-b2f8-9513581c2ad0 req-bf69ef96-6807-4a54-a034-cea8a44b2807 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received unexpected event network-vif-plugged-6bc46fc5-0af5-4d39-8c6e-bbbfb093af14 for instance with vm_state building and task_state spawning.
Aug 09 18:33:11 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:11 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:11 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:11 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:11 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:11 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:11 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:11 user nova-compute[72418]: DEBUG nova.compute.manager [req-d6e832e7-2d1a-48fe-b03b-eaf77c65c92d req-27cf2aed-90c0-403b-a37a-1f9da143b547 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received event network-vif-plugged-3d432e6f-81b2-4c44-bb25-b3d35941a43c {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:33:11 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-d6e832e7-2d1a-48fe-b03b-eaf77c65c92d req-27cf2aed-90c0-403b-a37a-1f9da143b547 service nova] Acquiring lock "82d67874-5477-4554-bffc-2bf24eb28367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:33:11 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-d6e832e7-2d1a-48fe-b03b-eaf77c65c92d req-27cf2aed-90c0-403b-a37a-1f9da143b547 service nova] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:33:11 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-d6e832e7-2d1a-48fe-b03b-eaf77c65c92d req-27cf2aed-90c0-403b-a37a-1f9da143b547 service nova] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:33:11 user nova-compute[72418]: DEBUG nova.compute.manager [req-d6e832e7-2d1a-48fe-b03b-eaf77c65c92d req-27cf2aed-90c0-403b-a37a-1f9da143b547 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] No waiting events found dispatching network-vif-plugged-3d432e6f-81b2-4c44-bb25-b3d35941a43c {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:33:11 user nova-compute[72418]: WARNING nova.compute.manager [req-d6e832e7-2d1a-48fe-b03b-eaf77c65c92d req-27cf2aed-90c0-403b-a37a-1f9da143b547 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received unexpected event network-vif-plugged-3d432e6f-81b2-4c44-bb25-b3d35941a43c for instance with vm_state building and task_state spawning.
Aug 09 18:33:11 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:11 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:12 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:12 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:12 user nova-compute[72418]: DEBUG nova.compute.manager [req-e51f7409-e99c-4cd0-8ec3-8c1da353cfd0 req-f7b8e174-cac9-428d-887f-0329651dfd67 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received event network-vif-plugged-bb529102-e1c1-4932-a2b2-8c411d29ca58 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:33:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-e51f7409-e99c-4cd0-8ec3-8c1da353cfd0 req-f7b8e174-cac9-428d-887f-0329651dfd67 service nova] Acquiring lock "82d67874-5477-4554-bffc-2bf24eb28367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:33:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-e51f7409-e99c-4cd0-8ec3-8c1da353cfd0 req-f7b8e174-cac9-428d-887f-0329651dfd67 service nova] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:33:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-e51f7409-e99c-4cd0-8ec3-8c1da353cfd0 req-f7b8e174-cac9-428d-887f-0329651dfd67 service nova] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:33:12 user nova-compute[72418]: DEBUG nova.compute.manager [req-e51f7409-e99c-4cd0-8ec3-8c1da353cfd0 req-f7b8e174-cac9-428d-887f-0329651dfd67 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] No waiting events found dispatching network-vif-plugged-bb529102-e1c1-4932-a2b2-8c411d29ca58 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:33:12 user nova-compute[72418]: WARNING nova.compute.manager [req-e51f7409-e99c-4cd0-8ec3-8c1da353cfd0 req-f7b8e174-cac9-428d-887f-0329651dfd67 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received unexpected event network-vif-plugged-bb529102-e1c1-4932-a2b2-8c411d29ca58 for instance with vm_state building and task_state spawning.
Aug 09 18:33:12 user nova-compute[72418]: DEBUG nova.compute.manager [req-e51f7409-e99c-4cd0-8ec3-8c1da353cfd0 req-f7b8e174-cac9-428d-887f-0329651dfd67 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received event network-vif-plugged-bb529102-e1c1-4932-a2b2-8c411d29ca58 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:33:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-e51f7409-e99c-4cd0-8ec3-8c1da353cfd0 req-f7b8e174-cac9-428d-887f-0329651dfd67 service nova] Acquiring lock "82d67874-5477-4554-bffc-2bf24eb28367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:33:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-e51f7409-e99c-4cd0-8ec3-8c1da353cfd0 req-f7b8e174-cac9-428d-887f-0329651dfd67 service nova] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:33:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-e51f7409-e99c-4cd0-8ec3-8c1da353cfd0 req-f7b8e174-cac9-428d-887f-0329651dfd67 service nova] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:33:12 user nova-compute[72418]: DEBUG nova.compute.manager [req-e51f7409-e99c-4cd0-8ec3-8c1da353cfd0 req-f7b8e174-cac9-428d-887f-0329651dfd67 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] No waiting events found dispatching network-vif-plugged-bb529102-e1c1-4932-a2b2-8c411d29ca58 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:33:12 user nova-compute[72418]: WARNING nova.compute.manager [req-e51f7409-e99c-4cd0-8ec3-8c1da353cfd0 req-f7b8e174-cac9-428d-887f-0329651dfd67 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received unexpected event network-vif-plugged-bb529102-e1c1-4932-a2b2-8c411d29ca58 for instance with vm_state building and task_state spawning.
Aug 09 18:33:12 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605992.7426171, e07beace-59d8-4c02-844b-1db1a6e81198 => Resumed> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:33:12 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] VM Resumed (Lifecycle Event)
Aug 09 18:33:12 user nova-compute[72418]: DEBUG nova.compute.manager [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Instance event wait completed in 0 seconds for  {{(pid=72418) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 18:33:12 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Instance rebooted successfully.
Aug 09 18:33:12 user nova-compute[72418]: DEBUG nova.compute.manager [None req-975e89b9-7301-43a8-9195-390d90cde6e0 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:33:12 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:12 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:33:12 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:12 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:12 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:33:12 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 09 18:33:12 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605992.7427676, e07beace-59d8-4c02-844b-1db1a6e81198 => Started> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:33:12 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] VM Started (Lifecycle Event)
Aug 09 18:33:12 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:33:12 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:33:13 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:13 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:13 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:13 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605993.8940697, 82d67874-5477-4554-bffc-2bf24eb28367 => Resumed> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:33:13 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] VM Resumed (Lifecycle Event)
Aug 09 18:33:13 user nova-compute[72418]: DEBUG nova.compute.manager [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Instance event wait completed in 0 seconds for  {{(pid=72418) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 18:33:13 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Guest created on hypervisor {{(pid=72418) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 18:33:13 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Instance spawned successfully.
Aug 09 18:33:13 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 18:33:13 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:33:13 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:33:13 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Found default for hw_cdrom_bus of ide {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:33:13 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Found default for hw_disk_bus of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:33:13 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Found default for hw_input_bus of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:33:13 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Found default for hw_pointer_model of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:33:13 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Found default for hw_video_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:33:13 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Found default for hw_vif_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:33:13 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:33:13 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691605993.8976336, 82d67874-5477-4554-bffc-2bf24eb28367 => Started> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:33:13 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] VM Started (Lifecycle Event)
Aug 09 18:33:13 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:33:13 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:33:14 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:33:14 user nova-compute[72418]: DEBUG nova.compute.manager [req-48b75b80-3a37-45aa-9cf4-890ad25c55be req-73756a0d-3b21-407b-acca-09876e25bfb7 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received event network-vif-plugged-3d432e6f-81b2-4c44-bb25-b3d35941a43c {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:33:14 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-48b75b80-3a37-45aa-9cf4-890ad25c55be req-73756a0d-3b21-407b-acca-09876e25bfb7 service nova] Acquiring lock "82d67874-5477-4554-bffc-2bf24eb28367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:33:14 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-48b75b80-3a37-45aa-9cf4-890ad25c55be req-73756a0d-3b21-407b-acca-09876e25bfb7 service nova] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:33:14 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-48b75b80-3a37-45aa-9cf4-890ad25c55be req-73756a0d-3b21-407b-acca-09876e25bfb7 service nova] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:33:14 user nova-compute[72418]: DEBUG nova.compute.manager [req-48b75b80-3a37-45aa-9cf4-890ad25c55be req-73756a0d-3b21-407b-acca-09876e25bfb7 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] No waiting events found dispatching network-vif-plugged-3d432e6f-81b2-4c44-bb25-b3d35941a43c {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:33:14 user nova-compute[72418]: WARNING nova.compute.manager [req-48b75b80-3a37-45aa-9cf4-890ad25c55be req-73756a0d-3b21-407b-acca-09876e25bfb7 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received unexpected event network-vif-plugged-3d432e6f-81b2-4c44-bb25-b3d35941a43c for instance with vm_state building and task_state spawning.
Aug 09 18:33:14 user nova-compute[72418]: DEBUG nova.compute.manager [req-48b75b80-3a37-45aa-9cf4-890ad25c55be req-73756a0d-3b21-407b-acca-09876e25bfb7 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received event network-vif-plugged-3cd5a4d7-5e70-42d3-b3bd-8d9262131f59 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:33:14 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-48b75b80-3a37-45aa-9cf4-890ad25c55be req-73756a0d-3b21-407b-acca-09876e25bfb7 service nova] Acquiring lock "82d67874-5477-4554-bffc-2bf24eb28367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:33:14 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-48b75b80-3a37-45aa-9cf4-890ad25c55be req-73756a0d-3b21-407b-acca-09876e25bfb7 service nova] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:33:14 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-48b75b80-3a37-45aa-9cf4-890ad25c55be req-73756a0d-3b21-407b-acca-09876e25bfb7 service nova] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:33:14 user nova-compute[72418]: DEBUG nova.compute.manager [req-48b75b80-3a37-45aa-9cf4-890ad25c55be req-73756a0d-3b21-407b-acca-09876e25bfb7 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] No waiting events found dispatching network-vif-plugged-3cd5a4d7-5e70-42d3-b3bd-8d9262131f59 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:33:14 user nova-compute[72418]: WARNING nova.compute.manager [req-48b75b80-3a37-45aa-9cf4-890ad25c55be req-73756a0d-3b21-407b-acca-09876e25bfb7 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received unexpected event network-vif-plugged-3cd5a4d7-5e70-42d3-b3bd-8d9262131f59 for instance with vm_state building and task_state spawning.
Aug 09 18:33:14 user nova-compute[72418]: DEBUG nova.compute.manager [req-48b75b80-3a37-45aa-9cf4-890ad25c55be req-73756a0d-3b21-407b-acca-09876e25bfb7 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received event network-vif-plugged-3cd5a4d7-5e70-42d3-b3bd-8d9262131f59 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:33:14 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-48b75b80-3a37-45aa-9cf4-890ad25c55be req-73756a0d-3b21-407b-acca-09876e25bfb7 service nova] Acquiring lock "82d67874-5477-4554-bffc-2bf24eb28367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:33:14 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-48b75b80-3a37-45aa-9cf4-890ad25c55be req-73756a0d-3b21-407b-acca-09876e25bfb7 service nova] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:33:14 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-48b75b80-3a37-45aa-9cf4-890ad25c55be req-73756a0d-3b21-407b-acca-09876e25bfb7 service nova] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:33:14 user nova-compute[72418]: DEBUG nova.compute.manager [req-48b75b80-3a37-45aa-9cf4-890ad25c55be req-73756a0d-3b21-407b-acca-09876e25bfb7 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] No waiting events found dispatching network-vif-plugged-3cd5a4d7-5e70-42d3-b3bd-8d9262131f59 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:33:14 user nova-compute[72418]: WARNING nova.compute.manager [req-48b75b80-3a37-45aa-9cf4-890ad25c55be req-73756a0d-3b21-407b-acca-09876e25bfb7 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received unexpected event network-vif-plugged-3cd5a4d7-5e70-42d3-b3bd-8d9262131f59 for instance with vm_state building and task_state spawning.
Aug 09 18:33:14 user nova-compute[72418]: INFO nova.compute.manager [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Took 13.61 seconds to spawn the instance on the hypervisor.
Aug 09 18:33:14 user nova-compute[72418]: DEBUG nova.compute.manager [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:33:14 user nova-compute[72418]: INFO nova.compute.manager [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Took 44.40 seconds to build instance.
Aug 09 18:33:14 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-54899604-fb89-4c8e-96f6-c92d31549496 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Lock "82d67874-5477-4554-bffc-2bf24eb28367" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 44.523s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:33:16 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:18 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:21 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:26 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:26 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-68f330f9-15f4-4d88-b0a3-21c902e11cb6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Acquiring lock "c46f2599-93f8-412e-9918-7ace8a9f19dd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:33:26 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-68f330f9-15f4-4d88-b0a3-21c902e11cb6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "c46f2599-93f8-412e-9918-7ace8a9f19dd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:33:26 user nova-compute[72418]: INFO nova.compute.manager [None req-68f330f9-15f4-4d88-b0a3-21c902e11cb6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Detaching volume bdd54f84-accb-4284-bc01-7fe689728ee2
Aug 09 18:33:26 user nova-compute[72418]: INFO nova.virt.block_device [None req-68f330f9-15f4-4d88-b0a3-21c902e11cb6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Attempting to driver detach volume bdd54f84-accb-4284-bc01-7fe689728ee2 from mountpoint /dev/vdb
Aug 09 18:33:26 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-68f330f9-15f4-4d88-b0a3-21c902e11cb6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Attempting to detach device vdb from instance c46f2599-93f8-412e-9918-7ace8a9f19dd from the persistent domain config. {{(pid=72418) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 18:33:26 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-68f330f9-15f4-4d88-b0a3-21c902e11cb6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 18:33:26 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:33:26 user nova-compute[72418]:   <source dev="/dev/sdd"/>
Aug 09 18:33:26 user nova-compute[72418]:   <target dev="vdb" bus="virtio"/>
Aug 09 18:33:26 user nova-compute[72418]:   <serial>bdd54f84-accb-4284-bc01-7fe689728ee2</serial>
Aug 09 18:33:26 user nova-compute[72418]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 18:33:26 user nova-compute[72418]: </disk>
Aug 09 18:33:26 user nova-compute[72418]:  {{(pid=72418) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 18:33:26 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-68f330f9-15f4-4d88-b0a3-21c902e11cb6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Successfully detached device vdb from instance c46f2599-93f8-412e-9918-7ace8a9f19dd from the persistent domain config.
Aug 09 18:33:26 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-68f330f9-15f4-4d88-b0a3-21c902e11cb6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c46f2599-93f8-412e-9918-7ace8a9f19dd from the live domain config. {{(pid=72418) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 18:33:26 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-68f330f9-15f4-4d88-b0a3-21c902e11cb6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 18:33:26 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:33:26 user nova-compute[72418]:   <source dev="/dev/sdd"/>
Aug 09 18:33:26 user nova-compute[72418]:   <target dev="vdb" bus="virtio"/>
Aug 09 18:33:26 user nova-compute[72418]:   <serial>bdd54f84-accb-4284-bc01-7fe689728ee2</serial>
Aug 09 18:33:26 user nova-compute[72418]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 18:33:26 user nova-compute[72418]: </disk>
Aug 09 18:33:26 user nova-compute[72418]:  {{(pid=72418) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 18:33:27 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Received event <DeviceRemovedEvent: 1691606007.413716, c46f2599-93f8-412e-9918-7ace8a9f19dd => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72418) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 18:33:27 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-68f330f9-15f4-4d88-b0a3-21c902e11cb6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c46f2599-93f8-412e-9918-7ace8a9f19dd {{(pid=72418) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 18:33:27 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-68f330f9-15f4-4d88-b0a3-21c902e11cb6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Successfully detached device vdb from instance c46f2599-93f8-412e-9918-7ace8a9f19dd from the live domain config.
Aug 09 18:33:27 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68f330f9-15f4-4d88-b0a3-21c902e11cb6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] calling os-brick to detach iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 18:33:27 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f330f9-15f4-4d88-b0a3-21c902e11cb6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, {'target_iqns': ['iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lJvqKipO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:33:27 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-68f330f9-15f4-4d88-b0a3-21c902e11cb6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:33:27 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-68f330f9-15f4-4d88-b0a3-21c902e11cb6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:33:27 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-68f330f9-15f4-4d88-b0a3-21c902e11cb6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:33:27 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f330f9-15f4-4d88-b0a3-21c902e11cb6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2', 0)] {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 18:33:27 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:27 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:27 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4bb0835-a6ab-4cf3-980b-83372d4bbc3f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:33:27 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:27 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:27 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d02af3-6850-43bc-a112-c0db20a96759]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:33:27 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f330f9-15f4-4d88-b0a3-21c902e11cb6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:33:27 user nova-compute[72418]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 (non-flash)
Aug 09 18:33:27 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:33:27 user nova-compute[72418]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 (non-flash)
Aug 09 18:33:27 user nova-compute[72418]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab (non-flash)
Aug 09 18:33:27 user nova-compute[72418]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34 (non-flash)
Aug 09 18:33:27 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:33:27 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f330f9-15f4-4d88-b0a3-21c902e11cb6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:33:27 user nova-compute[72418]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 (non-flash)
Aug 09 18:33:27 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:33:27 user nova-compute[72418]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 (non-flash)
Aug 09 18:33:27 user nova-compute[72418]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab (non-flash)
Aug 09 18:33:27 user nova-compute[72418]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34 (non-flash)
Aug 09 18:33:27 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:33:27 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f330f9-15f4-4d88-b0a3-21c902e11cb6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f42d478ab00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2'): ({'sdd'}, set())}) {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 18:33:27 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-68f330f9-15f4-4d88-b0a3-21c902e11cb6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Removing single pathed devices sdd {{(pid=72418) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 18:33:27 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:27 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:27 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc5c043-3f93-4bf6-af51-9a5ad9af6cf6]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:33:27 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:27 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:27 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fad0b92-e1e2-4946-9516-489ea40685e4]: (4, ('ok\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:33:27 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-68f330f9-15f4-4d88-b0a3-21c902e11cb6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Flushing IO for device /dev/sdd {{(pid=72418) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 18:33:27 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:27 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:27 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[53789ae5-cd82-4afa-9264-2a11b1b67ec6]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:33:27 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-68f330f9-15f4-4d88-b0a3-21c902e11cb6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72418) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 18:33:27 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:27 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.036s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:27 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[853a1664-0abb-4038-bcac-d8a9c72f55fe]: (4, ('1', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:33:27 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-68f330f9-15f4-4d88-b0a3-21c902e11cb6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 18:33:27 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-68f330f9-15f4-4d88-b0a3-21c902e11cb6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] SCSI volumes sdd have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 18:33:27 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f330f9-15f4-4d88-b0a3-21c902e11cb6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2')] {{(pid=72418) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 18:33:27 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:27 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:27 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4bf31e4-aeef-403d-9661-2eba83b2b6a0]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:33:27 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f330f9-15f4-4d88-b0a3-21c902e11cb6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:33:27 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 -p 172.16.0.220:3260 --logout {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:27 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:27 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[89789490-f348-4fba-bcf7-fa9d287f700d]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:33:27 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f330f9-15f4-4d88-b0a3-21c902e11cb6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2, portal: 172.16.0.220,3260]
Aug 09 18:33:27 user nova-compute[72418]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2, portal: 172.16.0.220,3260] successful.
Aug 09 18:33:27 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:33:27 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 -p 172.16.0.220:3260 --op delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:27 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd54f84-accb-4284-bc01-7fe689728ee2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:27 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[4090fee6-dbd0-460b-b7f3-771b2f3ebbdc]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:33:27 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f330f9-15f4-4d88-b0a3-21c902e11cb6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:33:27 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-68f330f9-15f4-4d88-b0a3-21c902e11cb6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:33:27 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f330f9-15f4-4d88-b0a3-21c902e11cb6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] <== disconnect_volume: return (290ms) None {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:33:27 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68f330f9-15f4-4d88-b0a3-21c902e11cb6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Disconnected iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 18:33:28 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:28 user nova-compute[72418]: DEBUG nova.objects.instance [None req-68f330f9-15f4-4d88-b0a3-21c902e11cb6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lazy-loading 'flavor' on Instance uuid c46f2599-93f8-412e-9918-7ace8a9f19dd {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:33:28 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-68f330f9-15f4-4d88-b0a3-21c902e11cb6 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "c46f2599-93f8-412e-9918-7ace8a9f19dd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.635s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:33:30 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquiring lock "e24ebafb-73cb-42ea-a0b6-2263badd573f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:33:30 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "e24ebafb-73cb-42ea-a0b6-2263badd573f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:33:30 user nova-compute[72418]: DEBUG nova.compute.manager [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Starting instance... {{(pid=72418) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 18:33:30 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:33:30 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:33:30 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72418) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 18:33:30 user nova-compute[72418]: INFO nova.compute.claims [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Claim successful on node user
Aug 09 18:33:30 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:33:31 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:33:31 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:31 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.460s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:33:31 user nova-compute[72418]: DEBUG nova.compute.manager [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Start building networks asynchronously for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 18:33:31 user nova-compute[72418]: DEBUG nova.compute.manager [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Allocating IP information in the background. {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 18:33:31 user nova-compute[72418]: DEBUG nova.network.neutron [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] allocate_for_instance() {{(pid=72418) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 18:33:31 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 18:33:31 user nova-compute[72418]: DEBUG nova.compute.manager [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Start building block device mappings for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 18:33:31 user nova-compute[72418]: INFO nova.virt.block_device [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Booting with volume-backed-image 8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e at /dev/vda
Aug 09 18:33:31 user nova-compute[72418]: DEBUG nova.policy [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '621fd2b971c543d197a354c38e0d1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e5863cda54487682a4edcc24202c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72418) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 18:33:31 user nova-compute[72418]: DEBUG nova.network.neutron [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Successfully created port: af96e29f-e6ad-495f-9703-9597a81cb2ef {{(pid=72418) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 18:33:32 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:32 user nova-compute[72418]: DEBUG nova.network.neutron [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Successfully updated port: af96e29f-e6ad-495f-9703-9597a81cb2ef {{(pid=72418) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 18:33:32 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquiring lock "refresh_cache-e24ebafb-73cb-42ea-a0b6-2263badd573f" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:33:32 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquired lock "refresh_cache-e24ebafb-73cb-42ea-a0b6-2263badd573f" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:33:32 user nova-compute[72418]: DEBUG nova.network.neutron [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:33:32 user nova-compute[72418]: DEBUG nova.compute.manager [req-a3687c8f-4e32-4c6b-af58-3db3324b1f58 req-99b4fa1c-dbd2-4096-bc33-83072ba1ba3d service nova] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Received event network-changed-af96e29f-e6ad-495f-9703-9597a81cb2ef {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:33:32 user nova-compute[72418]: DEBUG nova.compute.manager [req-a3687c8f-4e32-4c6b-af58-3db3324b1f58 req-99b4fa1c-dbd2-4096-bc33-83072ba1ba3d service nova] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Refreshing instance network info cache due to event network-changed-af96e29f-e6ad-495f-9703-9597a81cb2ef. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:33:32 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a3687c8f-4e32-4c6b-af58-3db3324b1f58 req-99b4fa1c-dbd2-4096-bc33-83072ba1ba3d service nova] Acquiring lock "refresh_cache-e24ebafb-73cb-42ea-a0b6-2263badd573f" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:33:32 user nova-compute[72418]: DEBUG nova.network.neutron [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Instance cache missing network info. {{(pid=72418) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 18:33:33 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:33 user nova-compute[72418]: DEBUG nova.network.neutron [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Updating instance_info_cache with network_info: [{"id": "af96e29f-e6ad-495f-9703-9597a81cb2ef", "address": "fa:16:3e:4f:13:a9", "network": {"id": "beaefb5c-f5e4-47e7-ab68-60131f532ade", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e5863cda54487682a4edcc24202c91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf96e29f-e6", "ovs_interfaceid": "af96e29f-e6ad-495f-9703-9597a81cb2ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:33:33 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Releasing lock "refresh_cache-e24ebafb-73cb-42ea-a0b6-2263badd573f" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:33:33 user nova-compute[72418]: DEBUG nova.compute.manager [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Instance network_info: |[{"id": "af96e29f-e6ad-495f-9703-9597a81cb2ef", "address": "fa:16:3e:4f:13:a9", "network": {"id": "beaefb5c-f5e4-47e7-ab68-60131f532ade", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e5863cda54487682a4edcc24202c91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf96e29f-e6", "ovs_interfaceid": "af96e29f-e6ad-495f-9703-9597a81cb2ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 18:33:33 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a3687c8f-4e32-4c6b-af58-3db3324b1f58 req-99b4fa1c-dbd2-4096-bc33-83072ba1ba3d service nova] Acquired lock "refresh_cache-e24ebafb-73cb-42ea-a0b6-2263badd573f" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:33:33 user nova-compute[72418]: DEBUG nova.network.neutron [req-a3687c8f-4e32-4c6b-af58-3db3324b1f58 req-99b4fa1c-dbd2-4096-bc33-83072ba1ba3d service nova] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Refreshing network info cache for port af96e29f-e6ad-495f-9703-9597a81cb2ef {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:33:34 user nova-compute[72418]: DEBUG nova.network.neutron [req-a3687c8f-4e32-4c6b-af58-3db3324b1f58 req-99b4fa1c-dbd2-4096-bc33-83072ba1ba3d service nova] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Updated VIF entry in instance network info cache for port af96e29f-e6ad-495f-9703-9597a81cb2ef. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:33:34 user nova-compute[72418]: DEBUG nova.network.neutron [req-a3687c8f-4e32-4c6b-af58-3db3324b1f58 req-99b4fa1c-dbd2-4096-bc33-83072ba1ba3d service nova] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Updating instance_info_cache with network_info: [{"id": "af96e29f-e6ad-495f-9703-9597a81cb2ef", "address": "fa:16:3e:4f:13:a9", "network": {"id": "beaefb5c-f5e4-47e7-ab68-60131f532ade", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e5863cda54487682a4edcc24202c91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf96e29f-e6", "ovs_interfaceid": "af96e29f-e6ad-495f-9703-9597a81cb2ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:33:34 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a3687c8f-4e32-4c6b-af58-3db3324b1f58 req-99b4fa1c-dbd2-4096-bc33-83072ba1ba3d service nova] Releasing lock "refresh_cache-e24ebafb-73cb-42ea-a0b6-2263badd573f" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:33:36 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:38 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:41 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:42 user nova-compute[72418]: DEBUG os_brick.utils [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:33:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:42 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca871294-5547-4462-af61-ae22a0d7c35a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ad56b243ad71\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:33:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:42 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cae392b-9dad-4929-8a96-f59b9fdf3e1e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:33:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:42 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[77082c16-0449-411b-802e-ae7cb2fe3dc5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:33:42 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce998c2-20a2-4838-9534-3b04fb892e4a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:33:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Running cmd (subprocess): nvme version {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] 'nvme version' failed. Not Retrying. {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:33:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] nvme not present on system {{(pid=72418) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 18:33:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:33:42 user nova-compute[72418]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 18:33:42 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac734d82-65c9-4353-92d0-d1fffa4128e9]: (4, '') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:33:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72418) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 18:33:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 18:33:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] LIGHTOS: no hostnqn found. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 18:33:42 user nova-compute[72418]: DEBUG os_brick.utils [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ad56b243ad71', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:33:42 user nova-compute[72418]: DEBUG nova.virt.block_device [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Updating existing volume attachment record: e6c732cc-4840-4276-9cec-7b508389820f {{(pid=72418) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 18:33:43 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:46 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Acquiring lock "4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:33:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:33:47 user nova-compute[72418]: DEBUG nova.compute.manager [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Starting instance... {{(pid=72418) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 18:33:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:33:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:33:47 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72418) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 18:33:47 user nova-compute[72418]: INFO nova.compute.claims [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Claim successful on node user
Aug 09 18:33:48 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:48 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:33:48 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:33:48 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.518s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:33:48 user nova-compute[72418]: DEBUG nova.compute.manager [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Start building networks asynchronously for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 18:33:48 user nova-compute[72418]: DEBUG nova.compute.manager [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Allocating IP information in the background. {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 18:33:48 user nova-compute[72418]: DEBUG nova.network.neutron [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] allocate_for_instance() {{(pid=72418) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 18:33:48 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 18:33:48 user nova-compute[72418]: DEBUG nova.compute.manager [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Start building block device mappings for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 18:33:48 user nova-compute[72418]: DEBUG nova.policy [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '93e127bc79ec49fa813408f36b639504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee663228cbc483896e4fd409c4aa135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72418) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 18:33:48 user nova-compute[72418]: DEBUG nova.compute.manager [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Start spawning the instance on the hypervisor. {{(pid=72418) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 18:33:48 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Creating instance directory {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 18:33:48 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Creating image(s)
Aug 09 18:33:48 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Acquiring lock "/opt/stack/data/nova/instances/4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:33:48 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "/opt/stack/data/nova/instances/4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:33:48 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "/opt/stack/data/nova/instances/4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:33:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.134s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:48 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Acquiring lock "458773cfa7230b717e41c60277832e9f83806d71" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:33:48 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:33:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.138s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64/disk 1073741824 {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64/disk 1073741824" returned: 0 in 0.057s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:48 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:33:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:49 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.138s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:49 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64/disk. size=1073741824 {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 18:33:49 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:49 user nova-compute[72418]: DEBUG nova.network.neutron [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Successfully created port: 6a5e7c25-876c-403d-b3d3-9859c970030d {{(pid=72418) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 18:33:49 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:49 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Cannot resize image /opt/stack/data/nova/instances/4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64/disk to a smaller size. {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 18:33:49 user nova-compute[72418]: DEBUG nova.objects.instance [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lazy-loading 'migration_context' on Instance uuid 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:33:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Created local disks {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 18:33:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Ensure instance console log exists: /opt/stack/data/nova/instances/4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64/console.log {{(pid=72418) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 18:33:49 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:33:49 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:33:49 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:33:49 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:33:50 user nova-compute[72418]: DEBUG nova.network.neutron [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Successfully updated port: 6a5e7c25-876c-403d-b3d3-9859c970030d {{(pid=72418) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 18:33:50 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Acquiring lock "refresh_cache-4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:33:50 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Acquired lock "refresh_cache-4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:33:50 user nova-compute[72418]: DEBUG nova.network.neutron [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:33:50 user nova-compute[72418]: DEBUG nova.compute.manager [req-2d6d5e05-69ed-4ffb-bd07-2ce19899ed0b req-1be42cca-acf0-4df8-8737-485881054cf3 service nova] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Received event network-changed-6a5e7c25-876c-403d-b3d3-9859c970030d {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:33:50 user nova-compute[72418]: DEBUG nova.compute.manager [req-2d6d5e05-69ed-4ffb-bd07-2ce19899ed0b req-1be42cca-acf0-4df8-8737-485881054cf3 service nova] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Refreshing instance network info cache due to event network-changed-6a5e7c25-876c-403d-b3d3-9859c970030d. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:33:50 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-2d6d5e05-69ed-4ffb-bd07-2ce19899ed0b req-1be42cca-acf0-4df8-8737-485881054cf3 service nova] Acquiring lock "refresh_cache-4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:33:50 user nova-compute[72418]: DEBUG nova.network.neutron [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Instance cache missing network info. {{(pid=72418) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 18:33:50 user nova-compute[72418]: DEBUG nova.network.neutron [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Updating instance_info_cache with network_info: [{"id": "6a5e7c25-876c-403d-b3d3-9859c970030d", "address": "fa:16:3e:b0:f3:60", "network": {"id": "34f771ea-9846-4f27-94a0-c00494d053ab", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-973491744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eee663228cbc483896e4fd409c4aa135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a5e7c25-87", "ovs_interfaceid": "6a5e7c25-876c-403d-b3d3-9859c970030d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:33:50 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Releasing lock "refresh_cache-4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:33:50 user nova-compute[72418]: DEBUG nova.compute.manager [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Instance network_info: |[{"id": "6a5e7c25-876c-403d-b3d3-9859c970030d", "address": "fa:16:3e:b0:f3:60", "network": {"id": "34f771ea-9846-4f27-94a0-c00494d053ab", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-973491744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eee663228cbc483896e4fd409c4aa135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a5e7c25-87", "ovs_interfaceid": "6a5e7c25-876c-403d-b3d3-9859c970030d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 18:33:50 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-2d6d5e05-69ed-4ffb-bd07-2ce19899ed0b req-1be42cca-acf0-4df8-8737-485881054cf3 service nova] Acquired lock "refresh_cache-4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:33:50 user nova-compute[72418]: DEBUG nova.network.neutron [req-2d6d5e05-69ed-4ffb-bd07-2ce19899ed0b req-1be42cca-acf0-4df8-8737-485881054cf3 service nova] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Refreshing network info cache for port 6a5e7c25-876c-403d-b3d3-9859c970030d {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:33:50 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Start _get_guest_xml network_info=[{"id": "6a5e7c25-876c-403d-b3d3-9859c970030d", "address": "fa:16:3e:b0:f3:60", "network": {"id": "34f771ea-9846-4f27-94a0-c00494d053ab", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-973491744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eee663228cbc483896e4fd409c4aa135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a5e7c25-87", "ovs_interfaceid": "6a5e7c25-876c-403d-b3d3-9859c970030d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 18:33:50 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:33:50 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:33:50 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 18:33:50 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] CPU controller missing on host. {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 18:33:50 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 18:33:50 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] CPU controller found on host. {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 18:33:50 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72418) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 18:33:50 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T18:17:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 18:33:50 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Flavor limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 18:33:50 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Image limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 18:33:50 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Flavor pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 18:33:50 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Image pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 18:33:50 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 18:33:50 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 18:33:50 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 18:33:50 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Got 1 possible topologies {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 18:33:50 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 18:33:50 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 18:33:50 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:33:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-499264021',display_name='tempest-VolumesSnapshotTestJSON-instance-499264021',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-499264021',id=28,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNMWVy03XjriP/TJ7/YEscxmJD9kU13yulTLI3siuykjYEfDwTYfKiCessjhJ4B5Q2b3TQ1sqoAJLRd60hoFGEJmIMx4tpodH8Km6SS2dZUxh9D5AtPVawIq2XsIlaZX0Q==',key_name='tempest-keypair-37443166',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eee663228cbc483896e4fd409c4aa135',ramdisk_id='',reservation_id='r-3hzc6uq3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1926046841',owner_user_name='tempest-VolumesSnapshotTestJSON-1926046841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:33:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93e127bc79ec49fa813408f36b639504',uuid=4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a5e7c25-876c-403d-b3d3-9859c970030d", "address": "fa:16:3e:b0:f3:60", "network": {"id": "34f771ea-9846-4f27-94a0-c00494d053ab", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-973491744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eee663228cbc483896e4fd409c4aa135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a5e7c25-87", "ovs_interfaceid": "6a5e7c25-876c-403d-b3d3-9859c970030d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:33:50 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Converting VIF {"id": "6a5e7c25-876c-403d-b3d3-9859c970030d", "address": "fa:16:3e:b0:f3:60", "network": {"id": "34f771ea-9846-4f27-94a0-c00494d053ab", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-973491744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eee663228cbc483896e4fd409c4aa135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a5e7c25-87", "ovs_interfaceid": "6a5e7c25-876c-403d-b3d3-9859c970030d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:33:50 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:f3:60,bridge_name='br-int',has_traffic_filtering=True,id=6a5e7c25-876c-403d-b3d3-9859c970030d,network=Network(34f771ea-9846-4f27-94a0-c00494d053ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a5e7c25-87') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:33:50 user nova-compute[72418]: DEBUG nova.objects.instance [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:33:50 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] End _get_guest_xml xml=<domain type="kvm">
Aug 09 18:33:50 user nova-compute[72418]:   <uuid>4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64</uuid>
Aug 09 18:33:50 user nova-compute[72418]:   <name>instance-0000001c</name>
Aug 09 18:33:50 user nova-compute[72418]:   <memory>524288</memory>
Aug 09 18:33:50 user nova-compute[72418]:   <vcpu>1</vcpu>
Aug 09 18:33:50 user nova-compute[72418]:   <metadata>
Aug 09 18:33:50 user nova-compute[72418]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:33:50 user nova-compute[72418]:       <nova:package version="0.0.0"/>
Aug 09 18:33:50 user nova-compute[72418]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-499264021</nova:name>
Aug 09 18:33:50 user nova-compute[72418]:       <nova:creationTime>2023-08-09 18:33:50</nova:creationTime>
Aug 09 18:33:50 user nova-compute[72418]:       <nova:flavor name="m1.tiny">
Aug 09 18:33:50 user nova-compute[72418]:         <nova:memory>512</nova:memory>
Aug 09 18:33:50 user nova-compute[72418]:         <nova:disk>1</nova:disk>
Aug 09 18:33:50 user nova-compute[72418]:         <nova:swap>0</nova:swap>
Aug 09 18:33:50 user nova-compute[72418]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:33:50 user nova-compute[72418]:         <nova:vcpus>1</nova:vcpus>
Aug 09 18:33:50 user nova-compute[72418]:       </nova:flavor>
Aug 09 18:33:50 user nova-compute[72418]:       <nova:owner>
Aug 09 18:33:50 user nova-compute[72418]:         <nova:user uuid="93e127bc79ec49fa813408f36b639504">tempest-VolumesSnapshotTestJSON-1926046841-project-member</nova:user>
Aug 09 18:33:50 user nova-compute[72418]:         <nova:project uuid="eee663228cbc483896e4fd409c4aa135">tempest-VolumesSnapshotTestJSON-1926046841</nova:project>
Aug 09 18:33:50 user nova-compute[72418]:       </nova:owner>
Aug 09 18:33:50 user nova-compute[72418]:       <nova:root type="image" uuid="8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e"/>
Aug 09 18:33:50 user nova-compute[72418]:       <nova:ports>
Aug 09 18:33:50 user nova-compute[72418]:         <nova:port uuid="6a5e7c25-876c-403d-b3d3-9859c970030d">
Aug 09 18:33:50 user nova-compute[72418]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 18:33:50 user nova-compute[72418]:         </nova:port>
Aug 09 18:33:50 user nova-compute[72418]:       </nova:ports>
Aug 09 18:33:50 user nova-compute[72418]:     </nova:instance>
Aug 09 18:33:50 user nova-compute[72418]:   </metadata>
Aug 09 18:33:50 user nova-compute[72418]:   <sysinfo type="smbios">
Aug 09 18:33:50 user nova-compute[72418]:     <system>
Aug 09 18:33:50 user nova-compute[72418]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 18:33:50 user nova-compute[72418]:       <entry name="product">OpenStack Nova</entry>
Aug 09 18:33:50 user nova-compute[72418]:       <entry name="version">0.0.0</entry>
Aug 09 18:33:50 user nova-compute[72418]:       <entry name="serial">4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64</entry>
Aug 09 18:33:50 user nova-compute[72418]:       <entry name="uuid">4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64</entry>
Aug 09 18:33:50 user nova-compute[72418]:       <entry name="family">Virtual Machine</entry>
Aug 09 18:33:50 user nova-compute[72418]:     </system>
Aug 09 18:33:50 user nova-compute[72418]:   </sysinfo>
Aug 09 18:33:50 user nova-compute[72418]:   <os>
Aug 09 18:33:50 user nova-compute[72418]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 18:33:50 user nova-compute[72418]:     <boot dev="hd"/>
Aug 09 18:33:50 user nova-compute[72418]:     <smbios mode="sysinfo"/>
Aug 09 18:33:50 user nova-compute[72418]:   </os>
Aug 09 18:33:50 user nova-compute[72418]:   <features>
Aug 09 18:33:50 user nova-compute[72418]:     <acpi/>
Aug 09 18:33:50 user nova-compute[72418]:     <apic/>
Aug 09 18:33:50 user nova-compute[72418]:     <vmcoreinfo/>
Aug 09 18:33:50 user nova-compute[72418]:   </features>
Aug 09 18:33:50 user nova-compute[72418]:   <clock offset="utc">
Aug 09 18:33:50 user nova-compute[72418]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 18:33:50 user nova-compute[72418]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 18:33:50 user nova-compute[72418]:     <timer name="hpet" present="no"/>
Aug 09 18:33:50 user nova-compute[72418]:   </clock>
Aug 09 18:33:50 user nova-compute[72418]:   <cpu mode="custom" match="exact">
Aug 09 18:33:50 user nova-compute[72418]:     <model>Nehalem</model>
Aug 09 18:33:50 user nova-compute[72418]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 18:33:50 user nova-compute[72418]:   </cpu>
Aug 09 18:33:50 user nova-compute[72418]:   <devices>
Aug 09 18:33:50 user nova-compute[72418]:     <disk type="file" device="disk">
Aug 09 18:33:50 user nova-compute[72418]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 18:33:50 user nova-compute[72418]:       <source file="/opt/stack/data/nova/instances/4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64/disk"/>
Aug 09 18:33:50 user nova-compute[72418]:       <target dev="vda" bus="virtio"/>
Aug 09 18:33:50 user nova-compute[72418]:     </disk>
Aug 09 18:33:50 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:33:50 user nova-compute[72418]:       <mac address="fa:16:3e:b0:f3:60"/>
Aug 09 18:33:50 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:33:50 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:33:50 user nova-compute[72418]:       <target dev="tap6a5e7c25-87"/>
Aug 09 18:33:50 user nova-compute[72418]:     </interface>
Aug 09 18:33:50 user nova-compute[72418]:     <serial type="pty">
Aug 09 18:33:50 user nova-compute[72418]:       <log file="/opt/stack/data/nova/instances/4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64/console.log" append="off"/>
Aug 09 18:33:50 user nova-compute[72418]:     </serial>
Aug 09 18:33:50 user nova-compute[72418]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 18:33:50 user nova-compute[72418]:     <video>
Aug 09 18:33:50 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:33:50 user nova-compute[72418]:     </video>
Aug 09 18:33:50 user nova-compute[72418]:     <rng model="virtio">
Aug 09 18:33:50 user nova-compute[72418]:       <backend model="random">/dev/urandom</backend>
Aug 09 18:33:50 user nova-compute[72418]:     </rng>
Aug 09 18:33:50 user nova-compute[72418]:     <controller type="usb" index="0" model="none"/>
Aug 09 18:33:50 user nova-compute[72418]:     <memballoon model="virtio">
Aug 09 18:33:50 user nova-compute[72418]:       <stats period="10"/>
Aug 09 18:33:50 user nova-compute[72418]:     </memballoon>
Aug 09 18:33:50 user nova-compute[72418]:   </devices>
Aug 09 18:33:50 user nova-compute[72418]: </domain>
Aug 09 18:33:50 user nova-compute[72418]:  {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 18:33:50 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:33:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-499264021',display_name='tempest-VolumesSnapshotTestJSON-instance-499264021',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-499264021',id=28,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNMWVy03XjriP/TJ7/YEscxmJD9kU13yulTLI3siuykjYEfDwTYfKiCessjhJ4B5Q2b3TQ1sqoAJLRd60hoFGEJmIMx4tpodH8Km6SS2dZUxh9D5AtPVawIq2XsIlaZX0Q==',key_name='tempest-keypair-37443166',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eee663228cbc483896e4fd409c4aa135',ramdisk_id='',reservation_id='r-3hzc6uq3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1926046841',owner_user_name='tempest-VolumesSnapshotTestJSON-1926046841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:33:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93e127bc79ec49fa813408f36b639504',uuid=4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a5e7c25-876c-403d-b3d3-9859c970030d", "address": "fa:16:3e:b0:f3:60", "network": {"id": "34f771ea-9846-4f27-94a0-c00494d053ab", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-973491744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eee663228cbc483896e4fd409c4aa135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a5e7c25-87", "ovs_interfaceid": "6a5e7c25-876c-403d-b3d3-9859c970030d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:33:50 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Converting VIF {"id": "6a5e7c25-876c-403d-b3d3-9859c970030d", "address": "fa:16:3e:b0:f3:60", "network": {"id": "34f771ea-9846-4f27-94a0-c00494d053ab", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-973491744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eee663228cbc483896e4fd409c4aa135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a5e7c25-87", "ovs_interfaceid": "6a5e7c25-876c-403d-b3d3-9859c970030d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:33:50 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:f3:60,bridge_name='br-int',has_traffic_filtering=True,id=6a5e7c25-876c-403d-b3d3-9859c970030d,network=Network(34f771ea-9846-4f27-94a0-c00494d053ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a5e7c25-87') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:33:50 user nova-compute[72418]: DEBUG os_vif [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:f3:60,bridge_name='br-int',has_traffic_filtering=True,id=6a5e7c25-876c-403d-b3d3-9859c970030d,network=Network(34f771ea-9846-4f27-94a0-c00494d053ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a5e7c25-87') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:33:50 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:50 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:33:50 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:33:50 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:50 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a5e7c25-87, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:33:50 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6a5e7c25-87, col_values=(('external_ids', {'iface-id': '6a5e7c25-876c-403d-b3d3-9859c970030d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:f3:60', 'vm-uuid': '4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:33:50 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:50 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:33:50 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:50 user nova-compute[72418]: INFO os_vif [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:f3:60,bridge_name='br-int',has_traffic_filtering=True,id=6a5e7c25-876c-403d-b3d3-9859c970030d,network=Network(34f771ea-9846-4f27-94a0-c00494d053ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a5e7c25-87')
Aug 09 18:33:50 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:33:50 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] No VIF found with MAC fa:16:3e:b0:f3:60, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:33:50 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:33:51 user nova-compute[72418]: DEBUG nova.network.neutron [req-2d6d5e05-69ed-4ffb-bd07-2ce19899ed0b req-1be42cca-acf0-4df8-8737-485881054cf3 service nova] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Updated VIF entry in instance network info cache for port 6a5e7c25-876c-403d-b3d3-9859c970030d. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:33:51 user nova-compute[72418]: DEBUG nova.network.neutron [req-2d6d5e05-69ed-4ffb-bd07-2ce19899ed0b req-1be42cca-acf0-4df8-8737-485881054cf3 service nova] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Updating instance_info_cache with network_info: [{"id": "6a5e7c25-876c-403d-b3d3-9859c970030d", "address": "fa:16:3e:b0:f3:60", "network": {"id": "34f771ea-9846-4f27-94a0-c00494d053ab", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-973491744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eee663228cbc483896e4fd409c4aa135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a5e7c25-87", "ovs_interfaceid": "6a5e7c25-876c-403d-b3d3-9859c970030d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:33:51 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-2d6d5e05-69ed-4ffb-bd07-2ce19899ed0b req-1be42cca-acf0-4df8-8737-485881054cf3 service nova] Releasing lock "refresh_cache-4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:33:52 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:52 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:52 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:52 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:52 user nova-compute[72418]: DEBUG nova.compute.manager [req-ce62b56b-ed76-4f96-824d-c343a2959b83 req-cd1c78f8-a552-4267-a4e5-53beee7a4aac service nova] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Received event network-vif-plugged-6a5e7c25-876c-403d-b3d3-9859c970030d {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:33:52 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-ce62b56b-ed76-4f96-824d-c343a2959b83 req-cd1c78f8-a552-4267-a4e5-53beee7a4aac service nova] Acquiring lock "4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:33:52 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-ce62b56b-ed76-4f96-824d-c343a2959b83 req-cd1c78f8-a552-4267-a4e5-53beee7a4aac service nova] Lock "4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:33:52 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-ce62b56b-ed76-4f96-824d-c343a2959b83 req-cd1c78f8-a552-4267-a4e5-53beee7a4aac service nova] Lock "4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:33:52 user nova-compute[72418]: DEBUG nova.compute.manager [req-ce62b56b-ed76-4f96-824d-c343a2959b83 req-cd1c78f8-a552-4267-a4e5-53beee7a4aac service nova] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] No waiting events found dispatching network-vif-plugged-6a5e7c25-876c-403d-b3d3-9859c970030d {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:33:52 user nova-compute[72418]: WARNING nova.compute.manager [req-ce62b56b-ed76-4f96-824d-c343a2959b83 req-cd1c78f8-a552-4267-a4e5-53beee7a4aac service nova] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Received unexpected event network-vif-plugged-6a5e7c25-876c-403d-b3d3-9859c970030d for instance with vm_state building and task_state spawning.
Aug 09 18:33:52 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:52 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:52 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:52 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:33:53 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:53 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-0cf827aa-afad-4bab-9b10-7c7c402bb423 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Acquiring lock "03ad5bab-ab32-47fc-b7e8-b32282b9c20d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:33:53 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-0cf827aa-afad-4bab-9b10-7c7c402bb423 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lock "03ad5bab-ab32-47fc-b7e8-b32282b9c20d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:33:53 user nova-compute[72418]: DEBUG nova.objects.instance [None req-0cf827aa-afad-4bab-9b10-7c7c402bb423 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lazy-loading 'flavor' on Instance uuid 03ad5bab-ab32-47fc-b7e8-b32282b9c20d {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:33:53 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-0cf827aa-afad-4bab-9b10-7c7c402bb423 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lock "03ad5bab-ab32-47fc-b7e8-b32282b9c20d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:33:53 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-0cf827aa-afad-4bab-9b10-7c7c402bb423 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Acquiring lock "03ad5bab-ab32-47fc-b7e8-b32282b9c20d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:33:53 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-0cf827aa-afad-4bab-9b10-7c7c402bb423 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lock "03ad5bab-ab32-47fc-b7e8-b32282b9c20d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:33:53 user nova-compute[72418]: INFO nova.compute.manager [None req-0cf827aa-afad-4bab-9b10-7c7c402bb423 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Attaching volume 57cf2c50-486c-4ee4-a0f8-c48ad6790e71 to /dev/vdb
Aug 09 18:33:53 user nova-compute[72418]: DEBUG os_brick.utils [None req-0cf827aa-afad-4bab-9b10-7c7c402bb423 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:33:53 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:33:53 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72418) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 18:33:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:53 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[6efd69aa-3855-4a5a-9f22-022b047e43b3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ad56b243ad71\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:33:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:53 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e138114-0119-4031-84a1-a910bf9af1df]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:33:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:53 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85c0ba2-017d-478f-9228-6792b127b8e4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:33:53 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[62fabb0b-b268-4402-abd0-b4206f6b449d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:33:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-0cf827aa-afad-4bab-9b10-7c7c402bb423 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Running cmd (subprocess): nvme version {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-0cf827aa-afad-4bab-9b10-7c7c402bb423 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] 'nvme version' failed. Not Retrying. {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:33:54 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0cf827aa-afad-4bab-9b10-7c7c402bb423 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] nvme not present on system {{(pid=72418) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 18:33:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:33:54 user nova-compute[72418]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 18:33:54 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8f0061-4193-4901-9215-0d5220edffb0]: (4, '') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:33:54 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-0cf827aa-afad-4bab-9b10-7c7c402bb423 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72418) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 18:33:54 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-0cf827aa-afad-4bab-9b10-7c7c402bb423 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 18:33:54 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-0cf827aa-afad-4bab-9b10-7c7c402bb423 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] LIGHTOS: no hostnqn found. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 18:33:54 user nova-compute[72418]: DEBUG os_brick.utils [None req-0cf827aa-afad-4bab-9b10-7c7c402bb423 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ad56b243ad71', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:33:54 user nova-compute[72418]: DEBUG nova.virt.block_device [None req-0cf827aa-afad-4bab-9b10-7c7c402bb423 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Updating existing volume attachment record: 3847bfc7-b011-48b2-8918-ca2716ba6de9 {{(pid=72418) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 18:33:54 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691606034.4698305, 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64 => Resumed> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:33:54 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] VM Resumed (Lifecycle Event)
Aug 09 18:33:54 user nova-compute[72418]: DEBUG nova.compute.manager [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Instance event wait completed in 0 seconds for  {{(pid=72418) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 18:33:54 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Guest created on hypervisor {{(pid=72418) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 18:33:54 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Instance spawned successfully.
Aug 09 18:33:54 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 18:33:54 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:33:54 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:33:54 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Found default for hw_cdrom_bus of ide {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:33:54 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Found default for hw_disk_bus of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:33:54 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Found default for hw_input_bus of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:33:54 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Found default for hw_pointer_model of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:33:54 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Found default for hw_video_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:33:54 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Found default for hw_vif_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:33:54 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:33:54 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691606034.4764092, 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64 => Started> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:33:54 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] VM Started (Lifecycle Event)
Aug 09 18:33:54 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:33:54 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:33:54 user nova-compute[72418]: DEBUG nova.compute.manager [req-4ae04cce-fdad-4ca2-baf9-919075953373 req-f0a0b95b-366e-41c3-8277-2a0115869a0b service nova] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Received event network-vif-plugged-6a5e7c25-876c-403d-b3d3-9859c970030d {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:33:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-4ae04cce-fdad-4ca2-baf9-919075953373 req-f0a0b95b-366e-41c3-8277-2a0115869a0b service nova] Acquiring lock "4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:33:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-4ae04cce-fdad-4ca2-baf9-919075953373 req-f0a0b95b-366e-41c3-8277-2a0115869a0b service nova] Lock "4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:33:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-4ae04cce-fdad-4ca2-baf9-919075953373 req-f0a0b95b-366e-41c3-8277-2a0115869a0b service nova] Lock "4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:33:54 user nova-compute[72418]: DEBUG nova.compute.manager [req-4ae04cce-fdad-4ca2-baf9-919075953373 req-f0a0b95b-366e-41c3-8277-2a0115869a0b service nova] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] No waiting events found dispatching network-vif-plugged-6a5e7c25-876c-403d-b3d3-9859c970030d {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:33:54 user nova-compute[72418]: WARNING nova.compute.manager [req-4ae04cce-fdad-4ca2-baf9-919075953373 req-f0a0b95b-366e-41c3-8277-2a0115869a0b service nova] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Received unexpected event network-vif-plugged-6a5e7c25-876c-403d-b3d3-9859c970030d for instance with vm_state building and task_state spawning.
Aug 09 18:33:54 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:33:54 user nova-compute[72418]: INFO nova.compute.manager [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Took 6.05 seconds to spawn the instance on the hypervisor.
Aug 09 18:33:54 user nova-compute[72418]: DEBUG nova.compute.manager [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:33:54 user nova-compute[72418]: INFO nova.compute.manager [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Took 6.91 seconds to build instance.
Aug 09 18:33:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d47569e2-7fe7-4b41-82d9-e424ea395e84 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.010s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:33:54 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:33:54 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:33:55 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:55 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:33:55 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:33:57 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:33:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:33:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:33:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:33:57 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Auditing locally available compute resources for user (node: user) {{(pid=72418) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 18:33:58 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:33:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c53f871-2be9-4119-b5c0-d5081e2f4388/disk.rescue --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c53f871-2be9-4119-b5c0-d5081e2f4388/disk.rescue --force-share --output=json" returned: 0 in 0.156s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c53f871-2be9-4119-b5c0-d5081e2f4388/disk.rescue --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c53f871-2be9-4119-b5c0-d5081e2f4388/disk.rescue --force-share --output=json" returned: 0 in 0.155s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:58 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /opt/stack/data/nova/instances/1c53f871-2be9-4119-b5c0-d5081e2f4388/disk (vdb) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:33:58 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:33:58 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:33:58 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:33:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9e974b-b993-4f4e-9446-14941c39f109/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9e974b-b993-4f4e-9446-14941c39f109/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9e974b-b993-4f4e-9446-14941c39f109/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9e974b-b993-4f4e-9446-14941c39f109/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:33:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:33:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:00 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e582b61c-d998-4a3f-8392-a7f0e94a4dec/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e582b61c-d998-4a3f-8392-a7f0e94a4dec/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e582b61c-d998-4a3f-8392-a7f0e94a4dec/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e582b61c-d998-4a3f-8392-a7f0e94a4dec/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:01 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:34:02 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:34:02 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:34:02 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Hypervisor/Node resource view: name=user free_ram=7236MB free_disk=25.488842010498047GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72418) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 18:34:02 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:34:02 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:34:02 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 6af7918a-ce90-45ab-93d8-684e1489e891 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:34:02 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 8fe41968-a219-4a5a-afdb-32eb2082bb40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:34:02 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 01c46b33-6788-44a5-a43c-88ee4acc4d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:34:02 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance e019064c-955e-4f80-9b00-6b32b3835d58 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:34:02 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance e07beace-59d8-4c02-844b-1db1a6e81198 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:34:02 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance c46f2599-93f8-412e-9918-7ace8a9f19dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:34:02 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 03ad5bab-ab32-47fc-b7e8-b32282b9c20d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:34:02 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 1c53f871-2be9-4119-b5c0-d5081e2f4388 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:34:02 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance e582b61c-d998-4a3f-8392-a7f0e94a4dec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:34:02 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 82d67874-5477-4554-bffc-2bf24eb28367 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:34:02 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 2c9e974b-b993-4f4e-9446-14941c39f109 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:34:02 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance e24ebafb-73cb-42ea-a0b6-2263badd573f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:34:02 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:34:02 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 18:34:02 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 18:34:02 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:34:02 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:34:02 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Compute_service record updated for user:user {{(pid=72418) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 18:34:02 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.654s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:34:03 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cf827aa-afad-4bab-9b10-7c7c402bb423 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Calling os-brick to attach iSCSI Volume {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 18:34:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf827aa-afad-4bab-9b10-7c7c402bb423 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EzlWwnfa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:34:03 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-0cf827aa-afad-4bab-9b10-7c7c402bb423 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:34:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-0cf827aa-afad-4bab-9b10-7c7c402bb423 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:34:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-0cf827aa-afad-4bab-9b10-7c7c402bb423 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:34:03 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-0cf827aa-afad-4bab-9b10-7c7c402bb423 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:34:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-0cf827aa-afad-4bab-9b10-7c7c402bb423 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:34:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-0cf827aa-afad-4bab-9b10-7c7c402bb423 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:34:03 user nova-compute[72418]: INFO os_brick.initiator.connectors.iscsi [None req-0cf827aa-afad-4bab-9b10-7c7c402bb423 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 18:34:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:03 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:34:03 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Starting heal instance info cache {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 18:34:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:03 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9049e44-c3ba-4607-af7d-2cce28898747]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf827aa-afad-4bab-9b10-7c7c402bb423 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 18:34:03 user nova-compute[72418]:  {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:34:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --interface default --op new {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:03 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b4ce93-7d11-4551-b333-247afb0a3b00]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71] added\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf827aa-afad-4bab-9b10-7c7c402bb423 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71] added
Aug 09 18:34:03 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:34:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:03 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[17046080-c92d-4466-9633-deae52bc5b2b]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf827aa-afad-4bab-9b10-7c7c402bb423 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:34:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "refresh_cache-c46f2599-93f8-412e-9918-7ace8a9f19dd" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:34:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquired lock "refresh_cache-c46f2599-93f8-412e-9918-7ace8a9f19dd" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:34:03 user nova-compute[72418]: DEBUG nova.network.neutron [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Forcefully refreshing network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 18:34:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:03 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[548f9c60-80d5-4895-aeb4-885d47145b15]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf827aa-afad-4bab-9b10-7c7c402bb423 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:34:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EzlWwnfa {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EzlWwnfa" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:04 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea6a7ad-3db7-4bbb-9dfb-b5adef803845]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:04 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf827aa-afad-4bab-9b10-7c7c402bb423 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EzlWwnfa'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:34:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:04 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ad0f7f-ef69-47d9-9dac-397ad29d9523]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:04 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf827aa-afad-4bab-9b10-7c7c402bb423 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:34:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:04 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[12989bb6-22cb-4127-b3da-83631cbf540a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:04 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf827aa-afad-4bab-9b10-7c7c402bb423 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:34:04 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:34:04 user nova-compute[72418]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 (non-flash)
Aug 09 18:34:04 user nova-compute[72418]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab (non-flash)
Aug 09 18:34:04 user nova-compute[72418]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34 (non-flash)
Aug 09 18:34:04 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:34:04 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf827aa-afad-4bab-9b10-7c7c402bb423 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:34:04 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:34:04 user nova-compute[72418]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 (non-flash)
Aug 09 18:34:04 user nova-compute[72418]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab (non-flash)
Aug 09 18:34:04 user nova-compute[72418]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34 (non-flash)
Aug 09 18:34:04 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:34:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --login {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:04 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8e392d-b8b4-4c57-88da-fdc544db00d6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:04 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf827aa-afad-4bab-9b10-7c7c402bb423 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71, portal: 172.16.0.220,3260]
Aug 09 18:34:04 user nova-compute[72418]: Login to [iface: default, target: iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71, portal: 172.16.0.220,3260] successful.
Aug 09 18:34:04 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:34:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:04 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4ac805-e3d9-4379-b0bb-67837652b5a1]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:04 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf827aa-afad-4bab-9b10-7c7c402bb423 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:34:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:04 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b5d508-b2eb-4c99-85ec-04bef53fb33a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:04 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf827aa-afad-4bab-9b10-7c7c402bb423 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:34:04 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:34:04 user nova-compute[72418]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 (non-flash)
Aug 09 18:34:04 user nova-compute[72418]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab (non-flash)
Aug 09 18:34:04 user nova-compute[72418]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34 (non-flash)
Aug 09 18:34:04 user nova-compute[72418]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:34:04 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:34:04 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf827aa-afad-4bab-9b10-7c7c402bb423 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:34:04 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:34:04 user nova-compute[72418]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 (non-flash)
Aug 09 18:34:04 user nova-compute[72418]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab (non-flash)
Aug 09 18:34:04 user nova-compute[72418]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34 (non-flash)
Aug 09 18:34:04 user nova-compute[72418]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:34:04 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:34:04 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-0cf827aa-afad-4bab-9b10-7c7c402bb423 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:34:04 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf827aa-afad-4bab-9b10-7c7c402bb423 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Connected to 172.16.0.220:3260 {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 18:34:04 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-0cf827aa-afad-4bab-9b10-7c7c402bb423 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] HCTL ('35', '-', '-', 0) found on session 28 with lun 0 {{(pid=72418) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 18:34:04 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-0cf827aa-afad-4bab-9b10-7c7c402bb423 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72418) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 18:34:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:04 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2ec53a-583f-4f56-9fa5-f7a83d7486bb]: (4, ('- - 0', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:04 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-0cf827aa-afad-4bab-9b10-7c7c402bb423 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72418) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 18:34:04 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf827aa-afad-4bab-9b10-7c7c402bb423 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EzlWwnfa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 18:34:04 user nova-compute[72418]: DEBUG nova.network.neutron [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Updating instance_info_cache with network_info: [{"id": "6c9676d3-6e5d-4a95-a24f-0df4a15e993d", "address": "fa:16:3e:80:17:d9", "network": {"id": "bd36ef30-e57d-473f-97bc-c51b5db08aa7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-425133239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78b6e36a5b61456092ce7de9212c3c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9676d3-6e", "ovs_interfaceid": "6c9676d3-6e5d-4a95-a24f-0df4a15e993d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:34:04 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Releasing lock "refresh_cache-c46f2599-93f8-412e-9918-7ace8a9f19dd" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:34:04 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Updated the network info_cache for instance {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 18:34:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-0cf827aa-afad-4bab-9b10-7c7c402bb423 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:34:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf827aa-afad-4bab-9b10-7c7c402bb423 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '26131393039383131', 'path': '/dev/sdd'} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:34:05 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cf827aa-afad-4bab-9b10-7c7c402bb423 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131393039383131', 'path': '/dev/sdd'} {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 18:34:05 user nova-compute[72418]: DEBUG nova.objects.instance [None req-0cf827aa-afad-4bab-9b10-7c7c402bb423 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lazy-loading 'flavor' on Instance uuid 03ad5bab-ab32-47fc-b7e8-b32282b9c20d {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:34:05 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-0cf827aa-afad-4bab-9b10-7c7c402bb423 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 18:34:05 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:34:05 user nova-compute[72418]:   <source dev="/dev/sdd"/>
Aug 09 18:34:05 user nova-compute[72418]:   <target dev="vdb" bus="virtio"/>
Aug 09 18:34:05 user nova-compute[72418]:   <serial>57cf2c50-486c-4ee4-a0f8-c48ad6790e71</serial>
Aug 09 18:34:05 user nova-compute[72418]: </disk>
Aug 09 18:34:05 user nova-compute[72418]:  {{(pid=72418) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 18:34:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:34:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=72418) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 18:34:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72418) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 18:34:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72418) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 18:34:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:05 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-0cf827aa-afad-4bab-9b10-7c7c402bb423 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:34:05 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-0cf827aa-afad-4bab-9b10-7c7c402bb423 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:34:05 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-0cf827aa-afad-4bab-9b10-7c7c402bb423 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] No VIF found with MAC fa:16:3e:3e:5e:e7, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:34:05 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-0cf827aa-afad-4bab-9b10-7c7c402bb423 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lock "03ad5bab-ab32-47fc-b7e8-b32282b9c20d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.015s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:34:08 user nova-compute[72418]: DEBUG nova.compute.manager [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Stashing vm_state: active {{(pid=72418) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 09 18:34:08 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:34:08 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:34:08 user nova-compute[72418]: DEBUG nova.objects.instance [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lazy-loading 'pci_requests' on Instance uuid 03ad5bab-ab32-47fc-b7e8-b32282b9c20d {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:34:08 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72418) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 18:34:08 user nova-compute[72418]: INFO nova.compute.claims [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Claim successful on node user
Aug 09 18:34:08 user nova-compute[72418]: DEBUG nova.objects.instance [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lazy-loading 'resources' on Instance uuid 03ad5bab-ab32-47fc-b7e8-b32282b9c20d {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:34:08 user nova-compute[72418]: DEBUG nova.objects.instance [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lazy-loading 'pci_devices' on Instance uuid 03ad5bab-ab32-47fc-b7e8-b32282b9c20d {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:34:08 user nova-compute[72418]: INFO nova.compute.resource_tracker [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Updating resource usage from migration 553b15ef-7e30-4e6b-b878-f0338d7a7d98
Aug 09 18:34:09 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.589s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:34:09 user nova-compute[72418]: INFO nova.compute.manager [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Migrating
Aug 09 18:34:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Acquired lock "compute-rpcapi-router" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:34:09 user nova-compute[72418]: INFO nova.compute.rpcapi [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 09 18:34:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Releasing lock "compute-rpcapi-router" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Acquiring lock "refresh_cache-03ad5bab-ab32-47fc-b7e8-b32282b9c20d" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Acquired lock "refresh_cache-03ad5bab-ab32-47fc-b7e8-b32282b9c20d" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG nova.network.neutron [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG nova.compute.manager [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Start spawning the instance on the hypervisor. {{(pid=72418) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Creating instance directory {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 18:34:09 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Creating image(s)
Aug 09 18:34:09 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Did not create local disks {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Ensure instance console log exists: /opt/stack/data/nova/instances/e24ebafb-73cb-42ea-a0b6-2263badd573f/console.log {{(pid=72418) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Start _get_guest_xml network_info=[{"id": "af96e29f-e6ad-495f-9703-9597a81cb2ef", "address": "fa:16:3e:4f:13:a9", "network": {"id": "beaefb5c-f5e4-47e7-ab68-60131f532ade", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e5863cda54487682a4edcc24202c91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf96e29f-e6", "ovs_interfaceid": "af96e29f-e6ad-495f-9703-9597a81cb2ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'e6c732cc-4840-4276-9cec-7b508389820f', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ifyFsaxh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e24ebafb-73cb-42ea-a0b6-2263badd573f', 'attached_at': '', 'detached_at': '', 'volume_id': 'dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40', 'serial': 'dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 18:34:09 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:34:09 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:34:09 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] CPU controller missing on host. {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] CPU controller found on host. {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72418) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T18:17:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Flavor limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Image limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Flavor pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Image pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Got 1 possible topologies {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Calling os-brick to attach iSCSI Volume {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ifyFsaxh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:34:09 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:34:09 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:34:09 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:34:09 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:34:09 user nova-compute[72418]: INFO os_brick.initiator.connectors.iscsi [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 18:34:09 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 -p 172.16.0.220:3260 {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0914773-7667-45aa-9a9e-009769b1b3ed]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 18:34:09 user nova-compute[72418]:  {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 -p 172.16.0.220:3260 --interface default --op new {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f5aa2d-3491-4f4f-85de-2fbdc47604b5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40] added\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40] added
Aug 09 18:34:09 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f4328d-3720-4f02-9fb8-33bdcdf53825]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG nova.network.neutron [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Updating instance_info_cache with network_info: [{"id": "ea92909f-40d7-48a8-be09-50439674945c", "address": "fa:16:3e:3e:5e:e7", "network": {"id": "8354f86b-1e91-42ca-9847-769bb0aadcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-664289957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405587d223d54c5ab4f72a1994ac2862", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea92909f-40", "ovs_interfaceid": "ea92909f-40d7-48a8-be09-50439674945c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3618aa-5b1d-41e7-8845-f0de41de19ae]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ifyFsaxh {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Releasing lock "refresh_cache-03ad5bab-ab32-47fc-b7e8-b32282b9c20d" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ifyFsaxh" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[84bb3e8d-a6af-4a94-82fb-daccdcfe02be]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ifyFsaxh'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[9474fd43-72e4-455c-a75f-0a81a0d81b93]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02d29a9-0838-4755-9338-71ddd81d8d06]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:34:09 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:34:09 user nova-compute[72418]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 (non-flash)
Aug 09 18:34:09 user nova-compute[72418]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab (non-flash)
Aug 09 18:34:09 user nova-compute[72418]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34 (non-flash)
Aug 09 18:34:09 user nova-compute[72418]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:34:09 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:34:09 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:34:09 user nova-compute[72418]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 (non-flash)
Aug 09 18:34:09 user nova-compute[72418]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab (non-flash)
Aug 09 18:34:09 user nova-compute[72418]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34 (non-flash)
Aug 09 18:34:09 user nova-compute[72418]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:34:09 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 -p 172.16.0.220:3260 --login {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Starting migrate_disk_and_power_off {{(pid=72418) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[3258c474-3a6c-45f0-8c1b-0d7f3543e41e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40, portal: 172.16.0.220,3260]
Aug 09 18:34:09 user nova-compute[72418]: Login to [iface: default, target: iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40, portal: 172.16.0.220,3260] successful.
Aug 09 18:34:09 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39ca984-8a95-4b85-8092-87816fe00b6e]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e093cd6-2d77-4f4b-86c1-a2b8f0f93c2e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:34:09 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:34:09 user nova-compute[72418]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 (non-flash)
Aug 09 18:34:09 user nova-compute[72418]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab (non-flash)
Aug 09 18:34:09 user nova-compute[72418]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34 (non-flash)
Aug 09 18:34:09 user nova-compute[72418]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:34:09 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:34:09 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:34:09 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:34:09 user nova-compute[72418]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 (non-flash)
Aug 09 18:34:09 user nova-compute[72418]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab (non-flash)
Aug 09 18:34:09 user nova-compute[72418]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34 (non-flash)
Aug 09 18:34:09 user nova-compute[72418]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:34:09 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:34:09 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Connected to 172.16.0.220:3260 {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] HCTL ('39', '-', '-', 0) found on session 29 with lun 0 {{(pid=72418) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72418) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.030s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[3194c7e7-b963-4aef-afde-7318177ad5b1]: (4, ('- - 0', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Searching for a device in session 29 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72418) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ifyFsaxh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:09 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:10 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:10 user nova-compute[72418]: DEBUG nova.compute.manager [req-60616cbd-9f30-4bf2-ba89-ec2c3ec8e30d req-59781e4e-e7fc-41e4-ad42-a3c9c311017b service nova] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Received event network-vif-unplugged-ea92909f-40d7-48a8-be09-50439674945c {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:34:10 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-60616cbd-9f30-4bf2-ba89-ec2c3ec8e30d req-59781e4e-e7fc-41e4-ad42-a3c9c311017b service nova] Acquiring lock "03ad5bab-ab32-47fc-b7e8-b32282b9c20d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:34:10 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-60616cbd-9f30-4bf2-ba89-ec2c3ec8e30d req-59781e4e-e7fc-41e4-ad42-a3c9c311017b service nova] Lock "03ad5bab-ab32-47fc-b7e8-b32282b9c20d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:34:10 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-60616cbd-9f30-4bf2-ba89-ec2c3ec8e30d req-59781e4e-e7fc-41e4-ad42-a3c9c311017b service nova] Lock "03ad5bab-ab32-47fc-b7e8-b32282b9c20d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:34:10 user nova-compute[72418]: DEBUG nova.compute.manager [req-60616cbd-9f30-4bf2-ba89-ec2c3ec8e30d req-59781e4e-e7fc-41e4-ad42-a3c9c311017b service nova] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] No waiting events found dispatching network-vif-unplugged-ea92909f-40d7-48a8-be09-50439674945c {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:34:10 user nova-compute[72418]: WARNING nova.compute.manager [req-60616cbd-9f30-4bf2-ba89-ec2c3ec8e30d req-59781e4e-e7fc-41e4-ad42-a3c9c311017b service nova] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Received unexpected event network-vif-unplugged-ea92909f-40d7-48a8-be09-50439674945c for instance with vm_state active and task_state resize_migrating.
Aug 09 18:34:10 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Instance destroyed successfully.
Aug 09 18:34:10 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:30:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1873430052',display_name='tempest-ServerActionsTestOtherB-server-1873430052',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1873430052',id=22,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIcobG4HnuTYOQnNQv/MwdYT3LE/RLnOlgxtm9ZW7mVchwGrvFEE/XUOIJNiUK2ZNsyoG2e4ALumseJiS6y2HeRcRosbaQtxOHGtF7A55P++8WqVj1ISNQq63FhVymDdqQ==',key_name='tempest-keypair-1241971956',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:30:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='405587d223d54c5ab4f72a1994ac2862',ramdisk_id='',reservation_id='r-y3ado2eg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1643003262',owner_user_name='tempest-ServerActionsTestOtherB-1643003262-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:34:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8174362ccd88488d867db28e18906a62',uuid=03ad5bab-ab32-47fc-b7e8-b32282b9c20d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea92909f-40d7-48a8-be09-50439674945c", "address": "fa:16:3e:3e:5e:e7", "network": {"id": "8354f86b-1e91-42ca-9847-769bb0aadcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-664289957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-664289957-network", "vif_mac": "fa:16:3e:3e:5e:e7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405587d223d54c5ab4f72a1994ac2862", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea92909f-40", "ovs_interfaceid": "ea92909f-40d7-48a8-be09-50439674945c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 18:34:10 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Converting VIF {"id": "ea92909f-40d7-48a8-be09-50439674945c", "address": "fa:16:3e:3e:5e:e7", "network": {"id": "8354f86b-1e91-42ca-9847-769bb0aadcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-664289957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-664289957-network", "vif_mac": "fa:16:3e:3e:5e:e7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405587d223d54c5ab4f72a1994ac2862", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea92909f-40", "ovs_interfaceid": "ea92909f-40d7-48a8-be09-50439674945c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:34:10 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:5e:e7,bridge_name='br-int',has_traffic_filtering=True,id=ea92909f-40d7-48a8-be09-50439674945c,network=Network(8354f86b-1e91-42ca-9847-769bb0aadcd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea92909f-40') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:34:10 user nova-compute[72418]: DEBUG os_vif [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:5e:e7,bridge_name='br-int',has_traffic_filtering=True,id=ea92909f-40d7-48a8-be09-50439674945c,network=Network(8354f86b-1e91-42ca-9847-769bb0aadcd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea92909f-40') {{(pid=72418) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 18:34:10 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:10 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea92909f-40, bridge=br-int, if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:34:10 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:10 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:34:10 user nova-compute[72418]: INFO os_vif [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:5e:e7,bridge_name='br-int',has_traffic_filtering=True,id=ea92909f-40d7-48a8-be09-50439674945c,network=Network(8354f86b-1e91-42ca-9847-769bb0aadcd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea92909f-40')
Aug 09 18:34:10 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] calling os-brick to detach iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 18:34:10 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, {'target_iqns': ['iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EzlWwnfa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:34:10 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:34:10 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:34:10 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:34:10 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '23965376634613234', 'path': '/dev/sdh'} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:34:10 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965376634613234', 'path': '/dev/sdh'} {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 18:34:10 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.317s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:34:10 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71', 0)] {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 18:34:10 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:10 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:10 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1fcb60-716d-4e0b-939d-6d90c32abd8f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:10 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:10 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:33:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-469140945',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-469140945',id=27,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52e5863cda54487682a4edcc24202c91',ramdisk_id='',reservation_id='r-u0b4huj8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1120385592',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:33:31Z,user_data=None,user_id='621fd2b971c543d197a354c38e0d1867',uuid=e24ebafb-73cb-42ea-a0b6-2263badd573f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af96e29f-e6ad-495f-9703-9597a81cb2ef", "address": "fa:16:3e:4f:13:a9", "network": {"id": "beaefb5c-f5e4-47e7-ab68-60131f532ade", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e5863cda54487682a4edcc24202c91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf96e29f-e6", "ovs_interfaceid": "af96e29f-e6ad-495f-9703-9597a81cb2ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:34:10 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Converting VIF {"id": "af96e29f-e6ad-495f-9703-9597a81cb2ef", "address": "fa:16:3e:4f:13:a9", "network": {"id": "beaefb5c-f5e4-47e7-ab68-60131f532ade", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e5863cda54487682a4edcc24202c91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf96e29f-e6", "ovs_interfaceid": "af96e29f-e6ad-495f-9703-9597a81cb2ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:34:10 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:13:a9,bridge_name='br-int',has_traffic_filtering=True,id=af96e29f-e6ad-495f-9703-9597a81cb2ef,network=Network(beaefb5c-f5e4-47e7-ab68-60131f532ade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf96e29f-e6') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:34:10 user nova-compute[72418]: DEBUG nova.objects.instance [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lazy-loading 'pci_devices' on Instance uuid e24ebafb-73cb-42ea-a0b6-2263badd573f {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] End _get_guest_xml xml=<domain type="kvm">
Aug 09 18:34:11 user nova-compute[72418]:   <uuid>e24ebafb-73cb-42ea-a0b6-2263badd573f</uuid>
Aug 09 18:34:11 user nova-compute[72418]:   <name>instance-0000001b</name>
Aug 09 18:34:11 user nova-compute[72418]:   <memory>524288</memory>
Aug 09 18:34:11 user nova-compute[72418]:   <vcpu>1</vcpu>
Aug 09 18:34:11 user nova-compute[72418]:   <metadata>
Aug 09 18:34:11 user nova-compute[72418]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:34:11 user nova-compute[72418]:       <nova:package version="0.0.0"/>
Aug 09 18:34:11 user nova-compute[72418]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-469140945</nova:name>
Aug 09 18:34:11 user nova-compute[72418]:       <nova:creationTime>2023-08-09 18:34:09</nova:creationTime>
Aug 09 18:34:11 user nova-compute[72418]:       <nova:flavor name="m1.tiny">
Aug 09 18:34:11 user nova-compute[72418]:         <nova:memory>512</nova:memory>
Aug 09 18:34:11 user nova-compute[72418]:         <nova:disk>1</nova:disk>
Aug 09 18:34:11 user nova-compute[72418]:         <nova:swap>0</nova:swap>
Aug 09 18:34:11 user nova-compute[72418]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:34:11 user nova-compute[72418]:         <nova:vcpus>1</nova:vcpus>
Aug 09 18:34:11 user nova-compute[72418]:       </nova:flavor>
Aug 09 18:34:11 user nova-compute[72418]:       <nova:owner>
Aug 09 18:34:11 user nova-compute[72418]:         <nova:user uuid="621fd2b971c543d197a354c38e0d1867">tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member</nova:user>
Aug 09 18:34:11 user nova-compute[72418]:         <nova:project uuid="52e5863cda54487682a4edcc24202c91">tempest-ServerBootFromVolumeStableRescueTest-1120385592</nova:project>
Aug 09 18:34:11 user nova-compute[72418]:       </nova:owner>
Aug 09 18:34:11 user nova-compute[72418]:       <nova:root type="image" uuid="8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e"/>
Aug 09 18:34:11 user nova-compute[72418]:       <nova:ports>
Aug 09 18:34:11 user nova-compute[72418]:         <nova:port uuid="af96e29f-e6ad-495f-9703-9597a81cb2ef">
Aug 09 18:34:11 user nova-compute[72418]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 09 18:34:11 user nova-compute[72418]:         </nova:port>
Aug 09 18:34:11 user nova-compute[72418]:       </nova:ports>
Aug 09 18:34:11 user nova-compute[72418]:     </nova:instance>
Aug 09 18:34:11 user nova-compute[72418]:   </metadata>
Aug 09 18:34:11 user nova-compute[72418]:   <sysinfo type="smbios">
Aug 09 18:34:11 user nova-compute[72418]:     <system>
Aug 09 18:34:11 user nova-compute[72418]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 18:34:11 user nova-compute[72418]:       <entry name="product">OpenStack Nova</entry>
Aug 09 18:34:11 user nova-compute[72418]:       <entry name="version">0.0.0</entry>
Aug 09 18:34:11 user nova-compute[72418]:       <entry name="serial">e24ebafb-73cb-42ea-a0b6-2263badd573f</entry>
Aug 09 18:34:11 user nova-compute[72418]:       <entry name="uuid">e24ebafb-73cb-42ea-a0b6-2263badd573f</entry>
Aug 09 18:34:11 user nova-compute[72418]:       <entry name="family">Virtual Machine</entry>
Aug 09 18:34:11 user nova-compute[72418]:     </system>
Aug 09 18:34:11 user nova-compute[72418]:   </sysinfo>
Aug 09 18:34:11 user nova-compute[72418]:   <os>
Aug 09 18:34:11 user nova-compute[72418]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 18:34:11 user nova-compute[72418]:     <boot dev="hd"/>
Aug 09 18:34:11 user nova-compute[72418]:     <smbios mode="sysinfo"/>
Aug 09 18:34:11 user nova-compute[72418]:   </os>
Aug 09 18:34:11 user nova-compute[72418]:   <features>
Aug 09 18:34:11 user nova-compute[72418]:     <acpi/>
Aug 09 18:34:11 user nova-compute[72418]:     <apic/>
Aug 09 18:34:11 user nova-compute[72418]:     <vmcoreinfo/>
Aug 09 18:34:11 user nova-compute[72418]:   </features>
Aug 09 18:34:11 user nova-compute[72418]:   <clock offset="utc">
Aug 09 18:34:11 user nova-compute[72418]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 18:34:11 user nova-compute[72418]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 18:34:11 user nova-compute[72418]:     <timer name="hpet" present="no"/>
Aug 09 18:34:11 user nova-compute[72418]:   </clock>
Aug 09 18:34:11 user nova-compute[72418]:   <cpu mode="custom" match="exact">
Aug 09 18:34:11 user nova-compute[72418]:     <model>Nehalem</model>
Aug 09 18:34:11 user nova-compute[72418]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 18:34:11 user nova-compute[72418]:   </cpu>
Aug 09 18:34:11 user nova-compute[72418]:   <devices>
Aug 09 18:34:11 user nova-compute[72418]:     <disk type="block" device="disk">
Aug 09 18:34:11 user nova-compute[72418]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:34:11 user nova-compute[72418]:       <source dev="/dev/sdh"/>
Aug 09 18:34:11 user nova-compute[72418]:       <target dev="vda" bus="virtio"/>
Aug 09 18:34:11 user nova-compute[72418]:       <serial>dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40</serial>
Aug 09 18:34:11 user nova-compute[72418]:     </disk>
Aug 09 18:34:11 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:34:11 user nova-compute[72418]:       <mac address="fa:16:3e:4f:13:a9"/>
Aug 09 18:34:11 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:34:11 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:34:11 user nova-compute[72418]:       <target dev="tapaf96e29f-e6"/>
Aug 09 18:34:11 user nova-compute[72418]:     </interface>
Aug 09 18:34:11 user nova-compute[72418]:     <serial type="pty">
Aug 09 18:34:11 user nova-compute[72418]:       <log file="/opt/stack/data/nova/instances/e24ebafb-73cb-42ea-a0b6-2263badd573f/console.log" append="off"/>
Aug 09 18:34:11 user nova-compute[72418]:     </serial>
Aug 09 18:34:11 user nova-compute[72418]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 18:34:11 user nova-compute[72418]:     <video>
Aug 09 18:34:11 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:34:11 user nova-compute[72418]:     </video>
Aug 09 18:34:11 user nova-compute[72418]:     <rng model="virtio">
Aug 09 18:34:11 user nova-compute[72418]:       <backend model="random">/dev/urandom</backend>
Aug 09 18:34:11 user nova-compute[72418]:     </rng>
Aug 09 18:34:11 user nova-compute[72418]:     <controller type="usb" index="0" model="none"/>
Aug 09 18:34:11 user nova-compute[72418]:     <memballoon model="virtio">
Aug 09 18:34:11 user nova-compute[72418]:       <stats period="10"/>
Aug 09 18:34:11 user nova-compute[72418]:     </memballoon>
Aug 09 18:34:11 user nova-compute[72418]:   </devices>
Aug 09 18:34:11 user nova-compute[72418]: </domain>
Aug 09 18:34:11 user nova-compute[72418]:  {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:33:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-469140945',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-469140945',id=27,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52e5863cda54487682a4edcc24202c91',ramdisk_id='',reservation_id='r-u0b4huj8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1120385592',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:33:31Z,user_data=None,user_id='621fd2b971c543d197a354c38e0d1867',uuid=e24ebafb-73cb-42ea-a0b6-2263badd573f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af96e29f-e6ad-495f-9703-9597a81cb2ef", "address": "fa:16:3e:4f:13:a9", "network": {"id": "beaefb5c-f5e4-47e7-ab68-60131f532ade", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e5863cda54487682a4edcc24202c91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf96e29f-e6", "ovs_interfaceid": "af96e29f-e6ad-495f-9703-9597a81cb2ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Converting VIF {"id": "af96e29f-e6ad-495f-9703-9597a81cb2ef", "address": "fa:16:3e:4f:13:a9", "network": {"id": "beaefb5c-f5e4-47e7-ab68-60131f532ade", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e5863cda54487682a4edcc24202c91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf96e29f-e6", "ovs_interfaceid": "af96e29f-e6ad-495f-9703-9597a81cb2ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:13:a9,bridge_name='br-int',has_traffic_filtering=True,id=af96e29f-e6ad-495f-9703-9597a81cb2ef,network=Network(beaefb5c-f5e4-47e7-ab68-60131f532ade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf96e29f-e6') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG os_vif [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:13:a9,bridge_name='br-int',has_traffic_filtering=True,id=af96e29f-e6ad-495f-9703-9597a81cb2ef,network=Network(beaefb5c-f5e4-47e7-ab68-60131f532ade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf96e29f-e6') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e429285-de53-4bc9-8687-67dc18cc5a07]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:34:11 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:34:11 user nova-compute[72418]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 (non-flash)
Aug 09 18:34:11 user nova-compute[72418]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab (non-flash)
Aug 09 18:34:11 user nova-compute[72418]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34 (non-flash)
Aug 09 18:34:11 user nova-compute[72418]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:34:11 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:34:11 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:34:11 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:34:11 user nova-compute[72418]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 (non-flash)
Aug 09 18:34:11 user nova-compute[72418]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab (non-flash)
Aug 09 18:34:11 user nova-compute[72418]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34 (non-flash)
Aug 09 18:34:11 user nova-compute[72418]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:34:11 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:34:11 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f42d478bc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71'): ({'sdd'}, set())}) {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Removing single pathed devices sdd {{(pid=72418) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf96e29f-e6, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaf96e29f-e6, col_values=(('external_ids', {'iface-id': 'af96e29f-e6ad-495f-9703-9597a81cb2ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:13:a9', 'vm-uuid': 'e24ebafb-73cb-42ea-a0b6-2263badd573f'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e69a05-2d0a-4d05-a6b0-f22efd9dd80c]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:11 user nova-compute[72418]: INFO os_vif [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:13:a9,bridge_name='br-int',has_traffic_filtering=True,id=af96e29f-e6ad-495f-9703-9597a81cb2ef,network=Network(beaefb5c-f5e4-47e7-ab68-60131f532ade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf96e29f-e6')
Aug 09 18:34:11 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ecb8fd8-8fea-4ef0-af11-1d6e862c2292]: (4, ('ok\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Flushing IO for device /dev/sdd {{(pid=72418) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[30da1a1d-fa5f-40e0-9222-db7903cd12ee]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72418) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] No VIF found with MAC fa:16:3e:4f:13:a9, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b0b17e-a16e-42a2-bf4c-94100b3a8005]: (4, ('1', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] SCSI volumes sdd have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71')] {{(pid=72418) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[caed2dd6-9d3c-4eec-8671-1996702d8aa7]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --logout {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf94a0ab-347e-4843-8494-f5107b7afa70]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71, portal: 172.16.0.220,3260]
Aug 09 18:34:11 user nova-compute[72418]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71, portal: 172.16.0.220,3260] successful.
Aug 09 18:34:11 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --op delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[990c96ae-1723-430b-b22b-e001589c38f0]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] <== disconnect_volume: return (654ms) None {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Disconnected iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:34:11 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d_resize/disk /opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/disk {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:12 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] CMD "cp -r /opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d_resize/disk /opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/disk" returned: 0 in 0.409s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:12 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d_resize/disk.info /opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/disk.info {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:12 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] CMD "cp -r /opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d_resize/disk.info /opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/disk.info" returned: 0 in 0.032s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:12 user nova-compute[72418]: DEBUG nova.compute.manager [req-cfb3cef2-2eea-4cd8-9a01-17fc8240a7e7 req-df21b755-cede-4c67-9062-cfbe75ae9a37 service nova] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Received event network-vif-plugged-ea92909f-40d7-48a8-be09-50439674945c {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:34:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-cfb3cef2-2eea-4cd8-9a01-17fc8240a7e7 req-df21b755-cede-4c67-9062-cfbe75ae9a37 service nova] Acquiring lock "03ad5bab-ab32-47fc-b7e8-b32282b9c20d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:34:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-cfb3cef2-2eea-4cd8-9a01-17fc8240a7e7 req-df21b755-cede-4c67-9062-cfbe75ae9a37 service nova] Lock "03ad5bab-ab32-47fc-b7e8-b32282b9c20d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:34:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-cfb3cef2-2eea-4cd8-9a01-17fc8240a7e7 req-df21b755-cede-4c67-9062-cfbe75ae9a37 service nova] Lock "03ad5bab-ab32-47fc-b7e8-b32282b9c20d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:34:12 user nova-compute[72418]: DEBUG nova.compute.manager [req-cfb3cef2-2eea-4cd8-9a01-17fc8240a7e7 req-df21b755-cede-4c67-9062-cfbe75ae9a37 service nova] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] No waiting events found dispatching network-vif-plugged-ea92909f-40d7-48a8-be09-50439674945c {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:34:12 user nova-compute[72418]: WARNING nova.compute.manager [req-cfb3cef2-2eea-4cd8-9a01-17fc8240a7e7 req-df21b755-cede-4c67-9062-cfbe75ae9a37 service nova] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Received unexpected event network-vif-plugged-ea92909f-40d7-48a8-be09-50439674945c for instance with vm_state active and task_state resize_migrating.
Aug 09 18:34:12 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:12 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:12 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:12 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:12 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:13 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:14 user nova-compute[72418]: DEBUG nova.compute.manager [req-4c8a7192-d668-4cf9-afba-a914033d299e req-1c7e8be4-22ed-4f39-a188-a0102f7f0519 service nova] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Received event network-vif-plugged-af96e29f-e6ad-495f-9703-9597a81cb2ef {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:34:14 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-4c8a7192-d668-4cf9-afba-a914033d299e req-1c7e8be4-22ed-4f39-a188-a0102f7f0519 service nova] Acquiring lock "e24ebafb-73cb-42ea-a0b6-2263badd573f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:34:14 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-4c8a7192-d668-4cf9-afba-a914033d299e req-1c7e8be4-22ed-4f39-a188-a0102f7f0519 service nova] Lock "e24ebafb-73cb-42ea-a0b6-2263badd573f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:34:14 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-4c8a7192-d668-4cf9-afba-a914033d299e req-1c7e8be4-22ed-4f39-a188-a0102f7f0519 service nova] Lock "e24ebafb-73cb-42ea-a0b6-2263badd573f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:34:14 user nova-compute[72418]: DEBUG nova.compute.manager [req-4c8a7192-d668-4cf9-afba-a914033d299e req-1c7e8be4-22ed-4f39-a188-a0102f7f0519 service nova] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] No waiting events found dispatching network-vif-plugged-af96e29f-e6ad-495f-9703-9597a81cb2ef {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:34:14 user nova-compute[72418]: WARNING nova.compute.manager [req-4c8a7192-d668-4cf9-afba-a914033d299e req-1c7e8be4-22ed-4f39-a188-a0102f7f0519 service nova] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Received unexpected event network-vif-plugged-af96e29f-e6ad-495f-9703-9597a81cb2ef for instance with vm_state building and task_state spawning.
Aug 09 18:34:14 user nova-compute[72418]: DEBUG nova.compute.manager [req-4c8a7192-d668-4cf9-afba-a914033d299e req-1c7e8be4-22ed-4f39-a188-a0102f7f0519 service nova] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Received event network-vif-plugged-af96e29f-e6ad-495f-9703-9597a81cb2ef {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:34:14 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-4c8a7192-d668-4cf9-afba-a914033d299e req-1c7e8be4-22ed-4f39-a188-a0102f7f0519 service nova] Acquiring lock "e24ebafb-73cb-42ea-a0b6-2263badd573f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:34:14 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-4c8a7192-d668-4cf9-afba-a914033d299e req-1c7e8be4-22ed-4f39-a188-a0102f7f0519 service nova] Lock "e24ebafb-73cb-42ea-a0b6-2263badd573f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:34:14 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-4c8a7192-d668-4cf9-afba-a914033d299e req-1c7e8be4-22ed-4f39-a188-a0102f7f0519 service nova] Lock "e24ebafb-73cb-42ea-a0b6-2263badd573f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:34:14 user nova-compute[72418]: DEBUG nova.compute.manager [req-4c8a7192-d668-4cf9-afba-a914033d299e req-1c7e8be4-22ed-4f39-a188-a0102f7f0519 service nova] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] No waiting events found dispatching network-vif-plugged-af96e29f-e6ad-495f-9703-9597a81cb2ef {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:34:14 user nova-compute[72418]: WARNING nova.compute.manager [req-4c8a7192-d668-4cf9-afba-a914033d299e req-1c7e8be4-22ed-4f39-a188-a0102f7f0519 service nova] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Received unexpected event network-vif-plugged-af96e29f-e6ad-495f-9703-9597a81cb2ef for instance with vm_state building and task_state spawning.
Aug 09 18:34:14 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691606054.9876606, e24ebafb-73cb-42ea-a0b6-2263badd573f => Resumed> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:34:14 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] VM Resumed (Lifecycle Event)
Aug 09 18:34:14 user nova-compute[72418]: DEBUG nova.compute.manager [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Instance event wait completed in 0 seconds for  {{(pid=72418) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 18:34:14 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Guest created on hypervisor {{(pid=72418) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 18:34:15 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Instance spawned successfully.
Aug 09 18:34:15 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 18:34:15 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:34:15 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:34:15 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Found default for hw_cdrom_bus of ide {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:34:15 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Found default for hw_disk_bus of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:34:15 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Found default for hw_input_bus of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:34:15 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Found default for hw_pointer_model of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:34:15 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Found default for hw_video_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:34:15 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Found default for hw_vif_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:34:15 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:34:15 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691606054.9937782, e24ebafb-73cb-42ea-a0b6-2263badd573f => Started> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:34:15 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] VM Started (Lifecycle Event)
Aug 09 18:34:15 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:34:15 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:34:15 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:34:15 user nova-compute[72418]: INFO nova.compute.manager [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Took 5.67 seconds to spawn the instance on the hypervisor.
Aug 09 18:34:15 user nova-compute[72418]: DEBUG nova.compute.manager [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:34:15 user nova-compute[72418]: INFO nova.compute.manager [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Took 44.70 seconds to build instance.
Aug 09 18:34:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-f7af7f8d-88b3-420e-a056-b8bb79c35f17 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "e24ebafb-73cb-42ea-a0b6-2263badd573f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 44.820s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:34:16 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:16 user nova-compute[72418]: DEBUG nova.network.neutron [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Port ea92909f-40d7-48a8-be09-50439674945c binding to destination host user is already ACTIVE {{(pid=72418) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 09 18:34:16 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Acquiring lock "03ad5bab-ab32-47fc-b7e8-b32282b9c20d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:34:16 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lock "03ad5bab-ab32-47fc-b7e8-b32282b9c20d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:34:16 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lock "03ad5bab-ab32-47fc-b7e8-b32282b9c20d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:34:16 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Acquiring lock "refresh_cache-03ad5bab-ab32-47fc-b7e8-b32282b9c20d" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:34:16 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Acquired lock "refresh_cache-03ad5bab-ab32-47fc-b7e8-b32282b9c20d" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:34:16 user nova-compute[72418]: DEBUG nova.network.neutron [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:34:17 user nova-compute[72418]: DEBUG nova.network.neutron [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Updating instance_info_cache with network_info: [{"id": "ea92909f-40d7-48a8-be09-50439674945c", "address": "fa:16:3e:3e:5e:e7", "network": {"id": "8354f86b-1e91-42ca-9847-769bb0aadcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-664289957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405587d223d54c5ab4f72a1994ac2862", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea92909f-40", "ovs_interfaceid": "ea92909f-40d7-48a8-be09-50439674945c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:34:17 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Releasing lock "refresh_cache-03ad5bab-ab32-47fc-b7e8-b32282b9c20d" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:34:17 user nova-compute[72418]: DEBUG os_brick.utils [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:34:17 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:17 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:17 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c851cbc-9cbe-4666-9d00-d573d0a1116a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ad56b243ad71\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:17 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:17 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:17 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c130ae-602d-4d53-a3e0-e1540d6772ca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:17 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:17 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:17 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[457862e3-94fc-4099-ade2-55117ee7535f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:17 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[801224b9-19ff-49a5-a73a-57884a6be9e9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:17 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Running cmd (subprocess): nvme version {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:17 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] 'nvme version' failed. Not Retrying. {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:34:17 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] nvme not present on system {{(pid=72418) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 18:34:17 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:17 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:34:17 user nova-compute[72418]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 18:34:17 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[747d242c-1e1a-459b-9b02-ebfdd64d047a]: (4, '') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:17 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72418) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 18:34:17 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 18:34:17 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] LIGHTOS: no hostnqn found. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 18:34:17 user nova-compute[72418]: DEBUG os_brick.utils [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ad56b243ad71', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:34:18 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:20 user nova-compute[72418]: DEBUG nova.compute.manager [req-5ae4518f-4313-427f-b0a2-a8b48b1f539a req-51c99a93-388b-48db-a258-0e8618e6880b service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received event network-changed-b07016e4-a1a6-438c-86e0-9b29f347ece4 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:34:20 user nova-compute[72418]: DEBUG nova.compute.manager [req-5ae4518f-4313-427f-b0a2-a8b48b1f539a req-51c99a93-388b-48db-a258-0e8618e6880b service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Refreshing instance network info cache due to event network-changed-b07016e4-a1a6-438c-86e0-9b29f347ece4. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:34:20 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-5ae4518f-4313-427f-b0a2-a8b48b1f539a req-51c99a93-388b-48db-a258-0e8618e6880b service nova] Acquiring lock "refresh_cache-82d67874-5477-4554-bffc-2bf24eb28367" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:34:20 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-5ae4518f-4313-427f-b0a2-a8b48b1f539a req-51c99a93-388b-48db-a258-0e8618e6880b service nova] Acquired lock "refresh_cache-82d67874-5477-4554-bffc-2bf24eb28367" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:34:20 user nova-compute[72418]: DEBUG nova.network.neutron [req-5ae4518f-4313-427f-b0a2-a8b48b1f539a req-51c99a93-388b-48db-a258-0e8618e6880b service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Refreshing network info cache for port b07016e4-a1a6-438c-86e0-9b29f347ece4 {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:34:21 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:21 user nova-compute[72418]: DEBUG nova.network.neutron [req-5ae4518f-4313-427f-b0a2-a8b48b1f539a req-51c99a93-388b-48db-a258-0e8618e6880b service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Updated VIF entry in instance network info cache for port b07016e4-a1a6-438c-86e0-9b29f347ece4. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:34:21 user nova-compute[72418]: DEBUG nova.network.neutron [req-5ae4518f-4313-427f-b0a2-a8b48b1f539a req-51c99a93-388b-48db-a258-0e8618e6880b service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Updating instance_info_cache with network_info: [{"id": "b07016e4-a1a6-438c-86e0-9b29f347ece4", "address": "fa:16:3e:55:82:4c", "network": {"id": "962e505b-9e11-4c96-b339-e36363ab6ef6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1326388745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb07016e4-a1", "ovs_interfaceid": "b07016e4-a1a6-438c-86e0-9b29f347ece4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a5c55350-ec71-4b02-90cc-ebc30e6211e5", "address": "fa:16:3e:3a:4c:d7", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c55350-ec", "ovs_interfaceid": "a5c55350-ec71-4b02-90cc-ebc30e6211e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4d58b14a-e8d0-4d9d-a712-8bfaa2b74bfc", "address": "fa:16:3e:3e:b6:33", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d58b14a-e8", "ovs_interfaceid": "4d58b14a-e8d0-4d9d-a712-8bfaa2b74bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6bc46fc5-0af5-4d39-8c6e-bbbfb093af14", "address": "fa:16:3e:93:62:de", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bc46fc5-0a", "ovs_interfaceid": "6bc46fc5-0af5-4d39-8c6e-bbbfb093af14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bb529102-e1c1-4932-a2b2-8c411d29ca58", "address": "fa:16:3e:4a:b3:a4", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb529102-e1", "ovs_interfaceid": "bb529102-e1c1-4932-a2b2-8c411d29ca58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d432e6f-81b2-4c44-bb25-b3d35941a43c", "address": "fa:16:3e:ff:50:55", "network": {"id": "dc14bb1f-2228-427b-88a6-852777894bc3", "bridge": "br-int", "label": "tempest-device-tagging-net2-2080696379", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d432e6f-81", "ovs_interfaceid": "3d432e6f-81b2-4c44-bb25-b3d35941a43c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3cd5a4d7-5e70-42d3-b3bd-8d9262131f59", "address": "fa:16:3e:e8:1b:c1", "network": {"id": "dc14bb1f-2228-427b-88a6-852777894bc3", "bridge": "br-int", "label": "tempest-device-tagging-net2-2080696379", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cd5a4d7-5e", "ovs_interfaceid": "3cd5a4d7-5e70-42d3-b3bd-8d9262131f59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:34:21 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-5ae4518f-4313-427f-b0a2-a8b48b1f539a req-51c99a93-388b-48db-a258-0e8618e6880b service nova] Releasing lock "refresh_cache-82d67874-5477-4554-bffc-2bf24eb28367" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:34:23 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:23 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Acquiring lock "82d67874-5477-4554-bffc-2bf24eb28367" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:34:23 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Lock "82d67874-5477-4554-bffc-2bf24eb28367" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:34:23 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Acquiring lock "82d67874-5477-4554-bffc-2bf24eb28367-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:34:23 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:34:23 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:34:23 user nova-compute[72418]: INFO nova.compute.manager [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Terminating instance
Aug 09 18:34:23 user nova-compute[72418]: DEBUG nova.compute.manager [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Start destroying the instance on the hypervisor. {{(pid=72418) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 18:34:23 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:23 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:23 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:23 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:23 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:23 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:23 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:23 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:23 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:23 user nova-compute[72418]: DEBUG nova.compute.manager [req-a6ad35d1-5c85-47e8-9b66-8647cff49a4e req-22a45162-b4bb-4414-8110-80027e67f052 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received event network-vif-unplugged-b07016e4-a1a6-438c-86e0-9b29f347ece4 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:34:23 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a6ad35d1-5c85-47e8-9b66-8647cff49a4e req-22a45162-b4bb-4414-8110-80027e67f052 service nova] Acquiring lock "82d67874-5477-4554-bffc-2bf24eb28367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:34:23 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a6ad35d1-5c85-47e8-9b66-8647cff49a4e req-22a45162-b4bb-4414-8110-80027e67f052 service nova] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:34:23 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a6ad35d1-5c85-47e8-9b66-8647cff49a4e req-22a45162-b4bb-4414-8110-80027e67f052 service nova] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:34:23 user nova-compute[72418]: DEBUG nova.compute.manager [req-a6ad35d1-5c85-47e8-9b66-8647cff49a4e req-22a45162-b4bb-4414-8110-80027e67f052 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] No waiting events found dispatching network-vif-unplugged-b07016e4-a1a6-438c-86e0-9b29f347ece4 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:34:23 user nova-compute[72418]: DEBUG nova.compute.manager [req-a6ad35d1-5c85-47e8-9b66-8647cff49a4e req-22a45162-b4bb-4414-8110-80027e67f052 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received event network-vif-unplugged-b07016e4-a1a6-438c-86e0-9b29f347ece4 for instance with task_state deleting. {{(pid=72418) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 18:34:23 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:23 user nova-compute[72418]: DEBUG nova.compute.manager [req-592f4fdb-c652-4b2b-85f0-60deb9deaf46 req-35fdc507-b4db-42ad-9460-ec7226d50010 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received event network-vif-unplugged-a5c55350-ec71-4b02-90cc-ebc30e6211e5 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:34:23 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-592f4fdb-c652-4b2b-85f0-60deb9deaf46 req-35fdc507-b4db-42ad-9460-ec7226d50010 service nova] Acquiring lock "82d67874-5477-4554-bffc-2bf24eb28367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:34:23 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-592f4fdb-c652-4b2b-85f0-60deb9deaf46 req-35fdc507-b4db-42ad-9460-ec7226d50010 service nova] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:34:23 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-592f4fdb-c652-4b2b-85f0-60deb9deaf46 req-35fdc507-b4db-42ad-9460-ec7226d50010 service nova] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:34:23 user nova-compute[72418]: DEBUG nova.compute.manager [req-592f4fdb-c652-4b2b-85f0-60deb9deaf46 req-35fdc507-b4db-42ad-9460-ec7226d50010 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] No waiting events found dispatching network-vif-unplugged-a5c55350-ec71-4b02-90cc-ebc30e6211e5 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:34:23 user nova-compute[72418]: DEBUG nova.compute.manager [req-592f4fdb-c652-4b2b-85f0-60deb9deaf46 req-35fdc507-b4db-42ad-9460-ec7226d50010 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received event network-vif-unplugged-a5c55350-ec71-4b02-90cc-ebc30e6211e5 for instance with task_state deleting. {{(pid=72418) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 18:34:23 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:23 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:23 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:23 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:23 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:24 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:24 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:24 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:24 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:24 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:24 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:24 user nova-compute[72418]: DEBUG nova.compute.manager [req-7de91eb2-4456-42e9-a0d8-378a3098787f req-e212be79-be55-4353-92d2-61f2214ff2c0 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received event network-vif-unplugged-3d432e6f-81b2-4c44-bb25-b3d35941a43c {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:34:24 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-7de91eb2-4456-42e9-a0d8-378a3098787f req-e212be79-be55-4353-92d2-61f2214ff2c0 service nova] Acquiring lock "82d67874-5477-4554-bffc-2bf24eb28367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:34:24 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-7de91eb2-4456-42e9-a0d8-378a3098787f req-e212be79-be55-4353-92d2-61f2214ff2c0 service nova] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:34:24 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-7de91eb2-4456-42e9-a0d8-378a3098787f req-e212be79-be55-4353-92d2-61f2214ff2c0 service nova] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:34:24 user nova-compute[72418]: DEBUG nova.compute.manager [req-7de91eb2-4456-42e9-a0d8-378a3098787f req-e212be79-be55-4353-92d2-61f2214ff2c0 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] No waiting events found dispatching network-vif-unplugged-3d432e6f-81b2-4c44-bb25-b3d35941a43c {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:34:24 user nova-compute[72418]: DEBUG nova.compute.manager [req-7de91eb2-4456-42e9-a0d8-378a3098787f req-e212be79-be55-4353-92d2-61f2214ff2c0 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received event network-vif-unplugged-3d432e6f-81b2-4c44-bb25-b3d35941a43c for instance with task_state deleting. {{(pid=72418) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 18:34:24 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:24 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:24 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:25 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Instance destroyed successfully.
Aug 09 18:34:25 user nova-compute[72418]: DEBUG nova.objects.instance [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Lazy-loading 'resources' on Instance uuid 82d67874-5477-4554-bffc-2bf24eb28367 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T18:32:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-146038463',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-146038463',id=25,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLps7yz57S0cIqR+MidwubY3t7R2RCfbKmFUaZqcNb3jNuX4gOm5W/yhnM5SBZCJ2tBUdjMn9fHMYC8hq7ApchMsnyGU/gHVDL3/vQu07w/5OZ4oZIZxy/3huqoinWmsg==',key_name='tempest-keypair-1256803026',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:33:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32d3f1359c67450181629511bf3d908a',ramdisk_id='',reservation_id='r-tl1bs9bx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1910102697',owner_user_name='tempest-TaggedBootDevicesTest_v242-1910102697-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:33:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d01b87c4690c4a89949a5cce33bab9ab',uuid=82d67874-5477-4554-bffc-2bf24eb28367,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b07016e4-a1a6-438c-86e0-9b29f347ece4", "address": "fa:16:3e:55:82:4c", "network": {"id": "962e505b-9e11-4c96-b339-e36363ab6ef6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1326388745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb07016e4-a1", "ovs_interfaceid": "b07016e4-a1a6-438c-86e0-9b29f347ece4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Converting VIF {"id": "b07016e4-a1a6-438c-86e0-9b29f347ece4", "address": "fa:16:3e:55:82:4c", "network": {"id": "962e505b-9e11-4c96-b339-e36363ab6ef6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1326388745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb07016e4-a1", "ovs_interfaceid": "b07016e4-a1a6-438c-86e0-9b29f347ece4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:55:82:4c,bridge_name='br-int',has_traffic_filtering=True,id=b07016e4-a1a6-438c-86e0-9b29f347ece4,network=Network(962e505b-9e11-4c96-b339-e36363ab6ef6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb07016e4-a1') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG os_vif [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:82:4c,bridge_name='br-int',has_traffic_filtering=True,id=b07016e4-a1a6-438c-86e0-9b29f347ece4,network=Network(962e505b-9e11-4c96-b339-e36363ab6ef6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb07016e4-a1') {{(pid=72418) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb07016e4-a1, bridge=br-int, if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:25 user nova-compute[72418]: INFO os_vif [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:82:4c,bridge_name='br-int',has_traffic_filtering=True,id=b07016e4-a1a6-438c-86e0-9b29f347ece4,network=Network(962e505b-9e11-4c96-b339-e36363ab6ef6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb07016e4-a1')
Aug 09 18:34:25 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T18:32:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-146038463',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-146038463',id=25,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLps7yz57S0cIqR+MidwubY3t7R2RCfbKmFUaZqcNb3jNuX4gOm5W/yhnM5SBZCJ2tBUdjMn9fHMYC8hq7ApchMsnyGU/gHVDL3/vQu07w/5OZ4oZIZxy/3huqoinWmsg==',key_name='tempest-keypair-1256803026',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:33:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32d3f1359c67450181629511bf3d908a',ramdisk_id='',reservation_id='r-tl1bs9bx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1910102697',owner_user_name='tempest-TaggedBootDevicesTest_v242-1910102697-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:33:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d01b87c4690c4a89949a5cce33bab9ab',uuid=82d67874-5477-4554-bffc-2bf24eb28367,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a5c55350-ec71-4b02-90cc-ebc30e6211e5", "address": "fa:16:3e:3a:4c:d7", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c55350-ec", "ovs_interfaceid": "a5c55350-ec71-4b02-90cc-ebc30e6211e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72418) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Converting VIF {"id": "a5c55350-ec71-4b02-90cc-ebc30e6211e5", "address": "fa:16:3e:3a:4c:d7", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c55350-ec", "ovs_interfaceid": "a5c55350-ec71-4b02-90cc-ebc30e6211e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:4c:d7,bridge_name='br-int',has_traffic_filtering=True,id=a5c55350-ec71-4b02-90cc-ebc30e6211e5,network=Network(1607c003-cf2e-4a0f-9261-e0cac426786b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa5c55350-ec') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG os_vif [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:4c:d7,bridge_name='br-int',has_traffic_filtering=True,id=a5c55350-ec71-4b02-90cc-ebc30e6211e5,network=Network(1607c003-cf2e-4a0f-9261-e0cac426786b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa5c55350-ec') {{(pid=72418) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa5c55350-ec, bridge=br-int, if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:25 user nova-compute[72418]: INFO os_vif [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:4c:d7,bridge_name='br-int',has_traffic_filtering=True,id=a5c55350-ec71-4b02-90cc-ebc30e6211e5,network=Network(1607c003-cf2e-4a0f-9261-e0cac426786b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa5c55350-ec')
Aug 09 18:34:25 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T18:32:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-146038463',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-146038463',id=25,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLps7yz57S0cIqR+MidwubY3t7R2RCfbKmFUaZqcNb3jNuX4gOm5W/yhnM5SBZCJ2tBUdjMn9fHMYC8hq7ApchMsnyGU/gHVDL3/vQu07w/5OZ4oZIZxy/3huqoinWmsg==',key_name='tempest-keypair-1256803026',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:33:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32d3f1359c67450181629511bf3d908a',ramdisk_id='',reservation_id='r-tl1bs9bx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1910102697',owner_user_name='tempest-TaggedBootDevicesTest_v242-1910102697-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:33:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d01b87c4690c4a89949a5cce33bab9ab',uuid=82d67874-5477-4554-bffc-2bf24eb28367,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d58b14a-e8d0-4d9d-a712-8bfaa2b74bfc", "address": "fa:16:3e:3e:b6:33", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d58b14a-e8", "ovs_interfaceid": "4d58b14a-e8d0-4d9d-a712-8bfaa2b74bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72418) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Converting VIF {"id": "4d58b14a-e8d0-4d9d-a712-8bfaa2b74bfc", "address": "fa:16:3e:3e:b6:33", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d58b14a-e8", "ovs_interfaceid": "4d58b14a-e8d0-4d9d-a712-8bfaa2b74bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:b6:33,bridge_name='br-int',has_traffic_filtering=True,id=4d58b14a-e8d0-4d9d-a712-8bfaa2b74bfc,network=Network(1607c003-cf2e-4a0f-9261-e0cac426786b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4d58b14a-e8') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG os_vif [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:b6:33,bridge_name='br-int',has_traffic_filtering=True,id=4d58b14a-e8d0-4d9d-a712-8bfaa2b74bfc,network=Network(1607c003-cf2e-4a0f-9261-e0cac426786b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4d58b14a-e8') {{(pid=72418) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d58b14a-e8, bridge=br-int, if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:25 user nova-compute[72418]: INFO os_vif [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:b6:33,bridge_name='br-int',has_traffic_filtering=True,id=4d58b14a-e8d0-4d9d-a712-8bfaa2b74bfc,network=Network(1607c003-cf2e-4a0f-9261-e0cac426786b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4d58b14a-e8')
Aug 09 18:34:25 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T18:32:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-146038463',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-146038463',id=25,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLps7yz57S0cIqR+MidwubY3t7R2RCfbKmFUaZqcNb3jNuX4gOm5W/yhnM5SBZCJ2tBUdjMn9fHMYC8hq7ApchMsnyGU/gHVDL3/vQu07w/5OZ4oZIZxy/3huqoinWmsg==',key_name='tempest-keypair-1256803026',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:33:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32d3f1359c67450181629511bf3d908a',ramdisk_id='',reservation_id='r-tl1bs9bx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1910102697',owner_user_name='tempest-TaggedBootDevicesTest_v242-1910102697-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:33:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d01b87c4690c4a89949a5cce33bab9ab',uuid=82d67874-5477-4554-bffc-2bf24eb28367,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6bc46fc5-0af5-4d39-8c6e-bbbfb093af14", "address": "fa:16:3e:93:62:de", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bc46fc5-0a", "ovs_interfaceid": "6bc46fc5-0af5-4d39-8c6e-bbbfb093af14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Converting VIF {"id": "6bc46fc5-0af5-4d39-8c6e-bbbfb093af14", "address": "fa:16:3e:93:62:de", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bc46fc5-0a", "ovs_interfaceid": "6bc46fc5-0af5-4d39-8c6e-bbbfb093af14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:62:de,bridge_name='br-int',has_traffic_filtering=True,id=6bc46fc5-0af5-4d39-8c6e-bbbfb093af14,network=Network(1607c003-cf2e-4a0f-9261-e0cac426786b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bc46fc5-0a') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG os_vif [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:62:de,bridge_name='br-int',has_traffic_filtering=True,id=6bc46fc5-0af5-4d39-8c6e-bbbfb093af14,network=Network(1607c003-cf2e-4a0f-9261-e0cac426786b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bc46fc5-0a') {{(pid=72418) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6bc46fc5-0a, bridge=br-int, if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:25 user nova-compute[72418]: INFO os_vif [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:62:de,bridge_name='br-int',has_traffic_filtering=True,id=6bc46fc5-0af5-4d39-8c6e-bbbfb093af14,network=Network(1607c003-cf2e-4a0f-9261-e0cac426786b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bc46fc5-0a')
Aug 09 18:34:25 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T18:32:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-146038463',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-146038463',id=25,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLps7yz57S0cIqR+MidwubY3t7R2RCfbKmFUaZqcNb3jNuX4gOm5W/yhnM5SBZCJ2tBUdjMn9fHMYC8hq7ApchMsnyGU/gHVDL3/vQu07w/5OZ4oZIZxy/3huqoinWmsg==',key_name='tempest-keypair-1256803026',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:33:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32d3f1359c67450181629511bf3d908a',ramdisk_id='',reservation_id='r-tl1bs9bx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1910102697',owner_user_name='tempest-TaggedBootDevicesTest_v242-1910102697-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:33:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d01b87c4690c4a89949a5cce33bab9ab',uuid=82d67874-5477-4554-bffc-2bf24eb28367,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bb529102-e1c1-4932-a2b2-8c411d29ca58", "address": "fa:16:3e:4a:b3:a4", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb529102-e1", "ovs_interfaceid": "bb529102-e1c1-4932-a2b2-8c411d29ca58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Converting VIF {"id": "bb529102-e1c1-4932-a2b2-8c411d29ca58", "address": "fa:16:3e:4a:b3:a4", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb529102-e1", "ovs_interfaceid": "bb529102-e1c1-4932-a2b2-8c411d29ca58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:b3:a4,bridge_name='br-int',has_traffic_filtering=True,id=bb529102-e1c1-4932-a2b2-8c411d29ca58,network=Network(1607c003-cf2e-4a0f-9261-e0cac426786b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb529102-e1') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG os_vif [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:b3:a4,bridge_name='br-int',has_traffic_filtering=True,id=bb529102-e1c1-4932-a2b2-8c411d29ca58,network=Network(1607c003-cf2e-4a0f-9261-e0cac426786b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb529102-e1') {{(pid=72418) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbb529102-e1, bridge=br-int, if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:25 user nova-compute[72418]: INFO os_vif [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:b3:a4,bridge_name='br-int',has_traffic_filtering=True,id=bb529102-e1c1-4932-a2b2-8c411d29ca58,network=Network(1607c003-cf2e-4a0f-9261-e0cac426786b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb529102-e1')
Aug 09 18:34:25 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T18:32:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-146038463',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-146038463',id=25,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLps7yz57S0cIqR+MidwubY3t7R2RCfbKmFUaZqcNb3jNuX4gOm5W/yhnM5SBZCJ2tBUdjMn9fHMYC8hq7ApchMsnyGU/gHVDL3/vQu07w/5OZ4oZIZxy/3huqoinWmsg==',key_name='tempest-keypair-1256803026',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:33:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32d3f1359c67450181629511bf3d908a',ramdisk_id='',reservation_id='r-tl1bs9bx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1910102697',owner_user_name='tempest-TaggedBootDevicesTest_v242-1910102697-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:33:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d01b87c4690c4a89949a5cce33bab9ab',uuid=82d67874-5477-4554-bffc-2bf24eb28367,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d432e6f-81b2-4c44-bb25-b3d35941a43c", "address": "fa:16:3e:ff:50:55", "network": {"id": "dc14bb1f-2228-427b-88a6-852777894bc3", "bridge": "br-int", "label": "tempest-device-tagging-net2-2080696379", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d432e6f-81", "ovs_interfaceid": "3d432e6f-81b2-4c44-bb25-b3d35941a43c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Converting VIF {"id": "3d432e6f-81b2-4c44-bb25-b3d35941a43c", "address": "fa:16:3e:ff:50:55", "network": {"id": "dc14bb1f-2228-427b-88a6-852777894bc3", "bridge": "br-int", "label": "tempest-device-tagging-net2-2080696379", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d432e6f-81", "ovs_interfaceid": "3d432e6f-81b2-4c44-bb25-b3d35941a43c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:50:55,bridge_name='br-int',has_traffic_filtering=True,id=3d432e6f-81b2-4c44-bb25-b3d35941a43c,network=Network(dc14bb1f-2228-427b-88a6-852777894bc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d432e6f-81') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG os_vif [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:50:55,bridge_name='br-int',has_traffic_filtering=True,id=3d432e6f-81b2-4c44-bb25-b3d35941a43c,network=Network(dc14bb1f-2228-427b-88a6-852777894bc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d432e6f-81') {{(pid=72418) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d432e6f-81, bridge=br-int, if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:25 user nova-compute[72418]: INFO os_vif [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:50:55,bridge_name='br-int',has_traffic_filtering=True,id=3d432e6f-81b2-4c44-bb25-b3d35941a43c,network=Network(dc14bb1f-2228-427b-88a6-852777894bc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d432e6f-81')
Aug 09 18:34:25 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T18:32:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-146038463',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-146038463',id=25,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLps7yz57S0cIqR+MidwubY3t7R2RCfbKmFUaZqcNb3jNuX4gOm5W/yhnM5SBZCJ2tBUdjMn9fHMYC8hq7ApchMsnyGU/gHVDL3/vQu07w/5OZ4oZIZxy/3huqoinWmsg==',key_name='tempest-keypair-1256803026',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:33:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32d3f1359c67450181629511bf3d908a',ramdisk_id='',reservation_id='r-tl1bs9bx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1910102697',owner_user_name='tempest-TaggedBootDevicesTest_v242-1910102697-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:33:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d01b87c4690c4a89949a5cce33bab9ab',uuid=82d67874-5477-4554-bffc-2bf24eb28367,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3cd5a4d7-5e70-42d3-b3bd-8d9262131f59", "address": "fa:16:3e:e8:1b:c1", "network": {"id": "dc14bb1f-2228-427b-88a6-852777894bc3", "bridge": "br-int", "label": "tempest-device-tagging-net2-2080696379", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cd5a4d7-5e", "ovs_interfaceid": "3cd5a4d7-5e70-42d3-b3bd-8d9262131f59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Converting VIF {"id": "3cd5a4d7-5e70-42d3-b3bd-8d9262131f59", "address": "fa:16:3e:e8:1b:c1", "network": {"id": "dc14bb1f-2228-427b-88a6-852777894bc3", "bridge": "br-int", "label": "tempest-device-tagging-net2-2080696379", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cd5a4d7-5e", "ovs_interfaceid": "3cd5a4d7-5e70-42d3-b3bd-8d9262131f59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:1b:c1,bridge_name='br-int',has_traffic_filtering=True,id=3cd5a4d7-5e70-42d3-b3bd-8d9262131f59,network=Network(dc14bb1f-2228-427b-88a6-852777894bc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cd5a4d7-5e') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG os_vif [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:1b:c1,bridge_name='br-int',has_traffic_filtering=True,id=3cd5a4d7-5e70-42d3-b3bd-8d9262131f59,network=Network(dc14bb1f-2228-427b-88a6-852777894bc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cd5a4d7-5e') {{(pid=72418) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3cd5a4d7-5e, bridge=br-int, if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:34:25 user nova-compute[72418]: INFO os_vif [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:1b:c1,bridge_name='br-int',has_traffic_filtering=True,id=3cd5a4d7-5e70-42d3-b3bd-8d9262131f59,network=Network(dc14bb1f-2228-427b-88a6-852777894bc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cd5a4d7-5e')
Aug 09 18:34:25 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] calling os-brick to detach iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, {'target_iqns': ['iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'npwACEMt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:34:25 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:34:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81', 0)] {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac820c6c-31a8-40ff-8176-62d215edb87b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6b1cc3-bc32-4a8c-bf97-38e0659461b7]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:34:25 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:34:25 user nova-compute[72418]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 (non-flash)
Aug 09 18:34:25 user nova-compute[72418]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab (non-flash)
Aug 09 18:34:25 user nova-compute[72418]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34 (non-flash)
Aug 09 18:34:25 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:34:25 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:34:25 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:34:25 user nova-compute[72418]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 (non-flash)
Aug 09 18:34:25 user nova-compute[72418]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab (non-flash)
Aug 09 18:34:25 user nova-compute[72418]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34 (non-flash)
Aug 09 18:34:25 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:34:25 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f42f859c550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81'): ({'sde'}, set())}) {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Removing single pathed devices sde {{(pid=72418) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691606050.6075883, 03ad5bab-ab32-47fc-b7e8-b32282b9c20d => Stopped> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:34:25 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] VM Stopped (Lifecycle Event)
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a9f703-d09b-4d93-a35c-ca255d8df89a]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG nova.compute.manager [None req-6869c224-27f0-4715-93b8-6f7856ccb7bb None None] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8f4c9a-c2ab-484e-9b1b-6cd776ec1411]: (4, ('ok\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Flushing IO for device /dev/sde {{(pid=72418) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG nova.compute.manager [None req-6869c224-27f0-4715-93b8-6f7856ccb7bb None None] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f09ff75-3239-412c-9f9a-002fe17283fc]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72418) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:25 user nova-compute[72418]: INFO nova.compute.manager [None req-6869c224-27f0-4715-93b8-6f7856ccb7bb None None] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 09 18:34:25 user nova-compute[72418]: INFO nova.compute.manager [None req-2f596816-de30-4fe3-9d41-4332ad74534f tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Unrescuing
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-2f596816-de30-4fe3-9d41-4332ad74534f tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Acquiring lock "refresh_cache-1c53f871-2be9-4119-b5c0-d5081e2f4388" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-2f596816-de30-4fe3-9d41-4332ad74534f tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Acquired lock "refresh_cache-1c53f871-2be9-4119-b5c0-d5081e2f4388" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG nova.network.neutron [None req-2f596816-de30-4fe3-9d41-4332ad74534f tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.052s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[10bb2a14-72b7-449d-8bf1-4c5b41d987b9]: (4, ('1', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] SCSI volumes sde have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81')] {{(pid=72418) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG nova.compute.manager [req-04419be4-35b9-4267-babd-c197793c2bf1 req-2f93e5eb-2fc2-4830-9a26-864bdd2bb3e0 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received event network-vif-plugged-b07016e4-a1a6-438c-86e0-9b29f347ece4 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-04419be4-35b9-4267-babd-c197793c2bf1 req-2f93e5eb-2fc2-4830-9a26-864bdd2bb3e0 service nova] Acquiring lock "82d67874-5477-4554-bffc-2bf24eb28367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-04419be4-35b9-4267-babd-c197793c2bf1 req-2f93e5eb-2fc2-4830-9a26-864bdd2bb3e0 service nova] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-04419be4-35b9-4267-babd-c197793c2bf1 req-2f93e5eb-2fc2-4830-9a26-864bdd2bb3e0 service nova] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG nova.compute.manager [req-04419be4-35b9-4267-babd-c197793c2bf1 req-2f93e5eb-2fc2-4830-9a26-864bdd2bb3e0 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] No waiting events found dispatching network-vif-plugged-b07016e4-a1a6-438c-86e0-9b29f347ece4 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:34:25 user nova-compute[72418]: WARNING nova.compute.manager [req-04419be4-35b9-4267-babd-c197793c2bf1 req-2f93e5eb-2fc2-4830-9a26-864bdd2bb3e0 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received unexpected event network-vif-plugged-b07016e4-a1a6-438c-86e0-9b29f347ece4 for instance with vm_state active and task_state deleting.
Aug 09 18:34:25 user nova-compute[72418]: DEBUG nova.compute.manager [req-04419be4-35b9-4267-babd-c197793c2bf1 req-2f93e5eb-2fc2-4830-9a26-864bdd2bb3e0 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received event network-vif-unplugged-4d58b14a-e8d0-4d9d-a712-8bfaa2b74bfc {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-04419be4-35b9-4267-babd-c197793c2bf1 req-2f93e5eb-2fc2-4830-9a26-864bdd2bb3e0 service nova] Acquiring lock "82d67874-5477-4554-bffc-2bf24eb28367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-04419be4-35b9-4267-babd-c197793c2bf1 req-2f93e5eb-2fc2-4830-9a26-864bdd2bb3e0 service nova] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-04419be4-35b9-4267-babd-c197793c2bf1 req-2f93e5eb-2fc2-4830-9a26-864bdd2bb3e0 service nova] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG nova.compute.manager [req-04419be4-35b9-4267-babd-c197793c2bf1 req-2f93e5eb-2fc2-4830-9a26-864bdd2bb3e0 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] No waiting events found dispatching network-vif-unplugged-4d58b14a-e8d0-4d9d-a712-8bfaa2b74bfc {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG nova.compute.manager [req-04419be4-35b9-4267-babd-c197793c2bf1 req-2f93e5eb-2fc2-4830-9a26-864bdd2bb3e0 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received event network-vif-unplugged-4d58b14a-e8d0-4d9d-a712-8bfaa2b74bfc for instance with task_state deleting. {{(pid=72418) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG nova.compute.manager [req-04419be4-35b9-4267-babd-c197793c2bf1 req-2f93e5eb-2fc2-4830-9a26-864bdd2bb3e0 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received event network-vif-plugged-4d58b14a-e8d0-4d9d-a712-8bfaa2b74bfc {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-04419be4-35b9-4267-babd-c197793c2bf1 req-2f93e5eb-2fc2-4830-9a26-864bdd2bb3e0 service nova] Acquiring lock "82d67874-5477-4554-bffc-2bf24eb28367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-04419be4-35b9-4267-babd-c197793c2bf1 req-2f93e5eb-2fc2-4830-9a26-864bdd2bb3e0 service nova] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-04419be4-35b9-4267-babd-c197793c2bf1 req-2f93e5eb-2fc2-4830-9a26-864bdd2bb3e0 service nova] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG nova.compute.manager [req-04419be4-35b9-4267-babd-c197793c2bf1 req-2f93e5eb-2fc2-4830-9a26-864bdd2bb3e0 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] No waiting events found dispatching network-vif-plugged-4d58b14a-e8d0-4d9d-a712-8bfaa2b74bfc {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:34:25 user nova-compute[72418]: WARNING nova.compute.manager [req-04419be4-35b9-4267-babd-c197793c2bf1 req-2f93e5eb-2fc2-4830-9a26-864bdd2bb3e0 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received unexpected event network-vif-plugged-4d58b14a-e8d0-4d9d-a712-8bfaa2b74bfc for instance with vm_state active and task_state deleting.
Aug 09 18:34:25 user nova-compute[72418]: DEBUG nova.compute.manager [req-04419be4-35b9-4267-babd-c197793c2bf1 req-2f93e5eb-2fc2-4830-9a26-864bdd2bb3e0 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received event network-vif-unplugged-bb529102-e1c1-4932-a2b2-8c411d29ca58 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-04419be4-35b9-4267-babd-c197793c2bf1 req-2f93e5eb-2fc2-4830-9a26-864bdd2bb3e0 service nova] Acquiring lock "82d67874-5477-4554-bffc-2bf24eb28367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-04419be4-35b9-4267-babd-c197793c2bf1 req-2f93e5eb-2fc2-4830-9a26-864bdd2bb3e0 service nova] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-04419be4-35b9-4267-babd-c197793c2bf1 req-2f93e5eb-2fc2-4830-9a26-864bdd2bb3e0 service nova] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG nova.compute.manager [req-04419be4-35b9-4267-babd-c197793c2bf1 req-2f93e5eb-2fc2-4830-9a26-864bdd2bb3e0 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] No waiting events found dispatching network-vif-unplugged-bb529102-e1c1-4932-a2b2-8c411d29ca58 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG nova.compute.manager [req-04419be4-35b9-4267-babd-c197793c2bf1 req-2f93e5eb-2fc2-4830-9a26-864bdd2bb3e0 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received event network-vif-unplugged-bb529102-e1c1-4932-a2b2-8c411d29ca58 for instance with task_state deleting. {{(pid=72418) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG nova.compute.manager [req-04419be4-35b9-4267-babd-c197793c2bf1 req-2f93e5eb-2fc2-4830-9a26-864bdd2bb3e0 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received event network-vif-plugged-bb529102-e1c1-4932-a2b2-8c411d29ca58 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-04419be4-35b9-4267-babd-c197793c2bf1 req-2f93e5eb-2fc2-4830-9a26-864bdd2bb3e0 service nova] Acquiring lock "82d67874-5477-4554-bffc-2bf24eb28367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-04419be4-35b9-4267-babd-c197793c2bf1 req-2f93e5eb-2fc2-4830-9a26-864bdd2bb3e0 service nova] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-04419be4-35b9-4267-babd-c197793c2bf1 req-2f93e5eb-2fc2-4830-9a26-864bdd2bb3e0 service nova] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG nova.compute.manager [req-04419be4-35b9-4267-babd-c197793c2bf1 req-2f93e5eb-2fc2-4830-9a26-864bdd2bb3e0 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] No waiting events found dispatching network-vif-plugged-bb529102-e1c1-4932-a2b2-8c411d29ca58 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:34:25 user nova-compute[72418]: WARNING nova.compute.manager [req-04419be4-35b9-4267-babd-c197793c2bf1 req-2f93e5eb-2fc2-4830-9a26-864bdd2bb3e0 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received unexpected event network-vif-plugged-bb529102-e1c1-4932-a2b2-8c411d29ca58 for instance with vm_state active and task_state deleting.
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[09095c7b-f6be-4901-84d7-9b9705c41c1e]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 -p 172.16.0.220:3260 --logout {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG nova.compute.manager [req-ffaabdfe-e98c-492a-80a1-0aba822b6d94 req-8b18a8ac-69fe-49e0-b8e0-08c1c1ecdff8 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received event network-vif-plugged-a5c55350-ec71-4b02-90cc-ebc30e6211e5 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-ffaabdfe-e98c-492a-80a1-0aba822b6d94 req-8b18a8ac-69fe-49e0-b8e0-08c1c1ecdff8 service nova] Acquiring lock "82d67874-5477-4554-bffc-2bf24eb28367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-ffaabdfe-e98c-492a-80a1-0aba822b6d94 req-8b18a8ac-69fe-49e0-b8e0-08c1c1ecdff8 service nova] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-ffaabdfe-e98c-492a-80a1-0aba822b6d94 req-8b18a8ac-69fe-49e0-b8e0-08c1c1ecdff8 service nova] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG nova.compute.manager [req-ffaabdfe-e98c-492a-80a1-0aba822b6d94 req-8b18a8ac-69fe-49e0-b8e0-08c1c1ecdff8 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] No waiting events found dispatching network-vif-plugged-a5c55350-ec71-4b02-90cc-ebc30e6211e5 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:34:25 user nova-compute[72418]: WARNING nova.compute.manager [req-ffaabdfe-e98c-492a-80a1-0aba822b6d94 req-8b18a8ac-69fe-49e0-b8e0-08c1c1ecdff8 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received unexpected event network-vif-plugged-a5c55350-ec71-4b02-90cc-ebc30e6211e5 for instance with vm_state active and task_state deleting.
Aug 09 18:34:25 user nova-compute[72418]: DEBUG nova.compute.manager [req-ffaabdfe-e98c-492a-80a1-0aba822b6d94 req-8b18a8ac-69fe-49e0-b8e0-08c1c1ecdff8 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received event network-vif-unplugged-6bc46fc5-0af5-4d39-8c6e-bbbfb093af14 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-ffaabdfe-e98c-492a-80a1-0aba822b6d94 req-8b18a8ac-69fe-49e0-b8e0-08c1c1ecdff8 service nova] Acquiring lock "82d67874-5477-4554-bffc-2bf24eb28367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-ffaabdfe-e98c-492a-80a1-0aba822b6d94 req-8b18a8ac-69fe-49e0-b8e0-08c1c1ecdff8 service nova] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-ffaabdfe-e98c-492a-80a1-0aba822b6d94 req-8b18a8ac-69fe-49e0-b8e0-08c1c1ecdff8 service nova] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG nova.compute.manager [req-ffaabdfe-e98c-492a-80a1-0aba822b6d94 req-8b18a8ac-69fe-49e0-b8e0-08c1c1ecdff8 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] No waiting events found dispatching network-vif-unplugged-6bc46fc5-0af5-4d39-8c6e-bbbfb093af14 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG nova.compute.manager [req-ffaabdfe-e98c-492a-80a1-0aba822b6d94 req-8b18a8ac-69fe-49e0-b8e0-08c1c1ecdff8 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received event network-vif-unplugged-6bc46fc5-0af5-4d39-8c6e-bbbfb093af14 for instance with task_state deleting. {{(pid=72418) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG nova.compute.manager [req-ffaabdfe-e98c-492a-80a1-0aba822b6d94 req-8b18a8ac-69fe-49e0-b8e0-08c1c1ecdff8 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received event network-vif-plugged-6bc46fc5-0af5-4d39-8c6e-bbbfb093af14 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-ffaabdfe-e98c-492a-80a1-0aba822b6d94 req-8b18a8ac-69fe-49e0-b8e0-08c1c1ecdff8 service nova] Acquiring lock "82d67874-5477-4554-bffc-2bf24eb28367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-ffaabdfe-e98c-492a-80a1-0aba822b6d94 req-8b18a8ac-69fe-49e0-b8e0-08c1c1ecdff8 service nova] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-ffaabdfe-e98c-492a-80a1-0aba822b6d94 req-8b18a8ac-69fe-49e0-b8e0-08c1c1ecdff8 service nova] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG nova.compute.manager [req-ffaabdfe-e98c-492a-80a1-0aba822b6d94 req-8b18a8ac-69fe-49e0-b8e0-08c1c1ecdff8 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] No waiting events found dispatching network-vif-plugged-6bc46fc5-0af5-4d39-8c6e-bbbfb093af14 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:34:25 user nova-compute[72418]: WARNING nova.compute.manager [req-ffaabdfe-e98c-492a-80a1-0aba822b6d94 req-8b18a8ac-69fe-49e0-b8e0-08c1c1ecdff8 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received unexpected event network-vif-plugged-6bc46fc5-0af5-4d39-8c6e-bbbfb093af14 for instance with vm_state active and task_state deleting.
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb477e2-4c4d-477c-a778-86002d876bc6]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81, portal: 172.16.0.220,3260]
Aug 09 18:34:25 user nova-compute[72418]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81, portal: 172.16.0.220,3260] successful.
Aug 09 18:34:25 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 -p 172.16.0.220:3260 --op delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ef7ffde-331f-4d4a-868b-117c46dcdf81 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[0385340f-bc14-47d9-a700-96af22e00749]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] <== disconnect_volume: return (367ms) None {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Disconnected iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] calling os-brick to detach iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, {'target_iqns': ['iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EwtpMDLH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:34:25 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:34:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab', 0)] {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ce1812-ccd2-47ab-b349-21905574f374]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[92631d91-f183-4243-8af7-4c93ad321d36]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:34:25 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:34:25 user nova-compute[72418]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab (non-flash)
Aug 09 18:34:25 user nova-compute[72418]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34 (non-flash)
Aug 09 18:34:25 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:34:25 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:34:25 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:34:25 user nova-compute[72418]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab (non-flash)
Aug 09 18:34:25 user nova-compute[72418]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34 (non-flash)
Aug 09 18:34:25 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:34:25 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f42f8412dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab'): ({'sdf'}, set())}) {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Removing single pathed devices sdf {{(pid=72418) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 18:34:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[60585017-15c0-469a-805a-ddf21537cf07]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e86fad-2692-4297-9c53-fb19d4e5f951]: (4, ('ok\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Flushing IO for device /dev/sdf {{(pid=72418) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[be585495-2149-437d-818a-1466d26a2c24]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72418) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc568075-45fa-4b2c-834f-c217eec982bc]: (4, ('1', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] SCSI volumes sdf have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab')] {{(pid=72418) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10e5867-d919-4dcc-b398-a6211cb3f592]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab -p 172.16.0.220:3260 --logout {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15c5d86-22ed-4e3d-ba35-c6a326494bff]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab, portal: 172.16.0.220,3260]
Aug 09 18:34:26 user nova-compute[72418]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab, portal: 172.16.0.220,3260] successful.
Aug 09 18:34:26 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab -p 172.16.0.220:3260 --op delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG nova.network.neutron [None req-2f596816-de30-4fe3-9d41-4332ad74534f tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Updating instance_info_cache with network_info: [{"id": "84eb2df4-6995-47c5-bf0f-387932ece66d", "address": "fa:16:3e:d2:b0:b4", "network": {"id": "15a49d9b-3c0d-449b-9473-29f219960e2c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c68622cd79472ba6ad14a6876aeaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84eb2df4-69", "ovs_interfaceid": "84eb2df4-6995-47c5-bf0f-387932ece66d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-2f596816-de30-4fe3-9d41-4332ad74534f tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Releasing lock "refresh_cache-1c53f871-2be9-4119-b5c0-d5081e2f4388" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG nova.objects.instance [None req-2f596816-de30-4fe3-9d41-4332ad74534f tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lazy-loading 'flavor' on Instance uuid 1c53f871-2be9-4119-b5c0-d5081e2f4388 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c30415ea-87a0-40ae-8f0c-7f5fbec605ab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2acb9c-3aa8-4d34-b060-a94827b8b85e]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] <== disconnect_volume: return (339ms) None {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Disconnected iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] calling os-brick to detach iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, {'target_iqns': ['iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wmGxjntp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:34:26 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:34:26 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34', 0)] {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8df99a-67a8-409c-afa9-3b31265ee3bb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG nova.compute.manager [req-5cb8e783-c2a5-49ac-9514-19514a2ffef5 req-7a84724a-e152-4dc1-aa3f-2cd121f1e0c7 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received event network-vif-plugged-3d432e6f-81b2-4c44-bb25-b3d35941a43c {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-5cb8e783-c2a5-49ac-9514-19514a2ffef5 req-7a84724a-e152-4dc1-aa3f-2cd121f1e0c7 service nova] Acquiring lock "82d67874-5477-4554-bffc-2bf24eb28367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-5cb8e783-c2a5-49ac-9514-19514a2ffef5 req-7a84724a-e152-4dc1-aa3f-2cd121f1e0c7 service nova] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-5cb8e783-c2a5-49ac-9514-19514a2ffef5 req-7a84724a-e152-4dc1-aa3f-2cd121f1e0c7 service nova] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG nova.compute.manager [req-5cb8e783-c2a5-49ac-9514-19514a2ffef5 req-7a84724a-e152-4dc1-aa3f-2cd121f1e0c7 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] No waiting events found dispatching network-vif-plugged-3d432e6f-81b2-4c44-bb25-b3d35941a43c {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:34:26 user nova-compute[72418]: WARNING nova.compute.manager [req-5cb8e783-c2a5-49ac-9514-19514a2ffef5 req-7a84724a-e152-4dc1-aa3f-2cd121f1e0c7 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received unexpected event network-vif-plugged-3d432e6f-81b2-4c44-bb25-b3d35941a43c for instance with vm_state active and task_state deleting.
Aug 09 18:34:26 user nova-compute[72418]: DEBUG nova.compute.manager [req-5cb8e783-c2a5-49ac-9514-19514a2ffef5 req-7a84724a-e152-4dc1-aa3f-2cd121f1e0c7 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received event network-vif-unplugged-3cd5a4d7-5e70-42d3-b3bd-8d9262131f59 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-5cb8e783-c2a5-49ac-9514-19514a2ffef5 req-7a84724a-e152-4dc1-aa3f-2cd121f1e0c7 service nova] Acquiring lock "82d67874-5477-4554-bffc-2bf24eb28367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-5cb8e783-c2a5-49ac-9514-19514a2ffef5 req-7a84724a-e152-4dc1-aa3f-2cd121f1e0c7 service nova] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-5cb8e783-c2a5-49ac-9514-19514a2ffef5 req-7a84724a-e152-4dc1-aa3f-2cd121f1e0c7 service nova] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG nova.compute.manager [req-5cb8e783-c2a5-49ac-9514-19514a2ffef5 req-7a84724a-e152-4dc1-aa3f-2cd121f1e0c7 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] No waiting events found dispatching network-vif-unplugged-3cd5a4d7-5e70-42d3-b3bd-8d9262131f59 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG nova.compute.manager [req-5cb8e783-c2a5-49ac-9514-19514a2ffef5 req-7a84724a-e152-4dc1-aa3f-2cd121f1e0c7 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received event network-vif-unplugged-3cd5a4d7-5e70-42d3-b3bd-8d9262131f59 for instance with task_state deleting. {{(pid=72418) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG nova.compute.manager [req-5cb8e783-c2a5-49ac-9514-19514a2ffef5 req-7a84724a-e152-4dc1-aa3f-2cd121f1e0c7 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received event network-vif-plugged-3cd5a4d7-5e70-42d3-b3bd-8d9262131f59 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-5cb8e783-c2a5-49ac-9514-19514a2ffef5 req-7a84724a-e152-4dc1-aa3f-2cd121f1e0c7 service nova] Acquiring lock "82d67874-5477-4554-bffc-2bf24eb28367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-5cb8e783-c2a5-49ac-9514-19514a2ffef5 req-7a84724a-e152-4dc1-aa3f-2cd121f1e0c7 service nova] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-5cb8e783-c2a5-49ac-9514-19514a2ffef5 req-7a84724a-e152-4dc1-aa3f-2cd121f1e0c7 service nova] Lock "82d67874-5477-4554-bffc-2bf24eb28367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG nova.compute.manager [req-5cb8e783-c2a5-49ac-9514-19514a2ffef5 req-7a84724a-e152-4dc1-aa3f-2cd121f1e0c7 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] No waiting events found dispatching network-vif-plugged-3cd5a4d7-5e70-42d3-b3bd-8d9262131f59 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:34:26 user nova-compute[72418]: WARNING nova.compute.manager [req-5cb8e783-c2a5-49ac-9514-19514a2ffef5 req-7a84724a-e152-4dc1-aa3f-2cd121f1e0c7 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received unexpected event network-vif-plugged-3cd5a4d7-5e70-42d3-b3bd-8d9262131f59 for instance with vm_state active and task_state deleting.
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.050s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[791381af-02eb-4ec1-8540-5df42a56b859]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:34:26 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:34:26 user nova-compute[72418]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34 (non-flash)
Aug 09 18:34:26 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:34:26 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:34:26 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:34:26 user nova-compute[72418]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34 (non-flash)
Aug 09 18:34:26 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:34:26 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f42d47a63b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34'): ({'sdg'}, set())}) {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Removing single pathed devices sdg {{(pid=72418) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[8559103e-4714-4dd4-ad40-bd0c9f650dcf]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.032s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1c5bbf-c78e-43ed-9f6e-26a13925789f]: (4, ('ok\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Flushing IO for device /dev/sdg {{(pid=72418) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[23326219-76ec-43ef-8d2a-0a448bf43b37]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72418) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.048s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d220a3-fd3c-481a-9d51-174a1400c481]: (4, ('1', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] SCSI volumes sdg have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34')] {{(pid=72418) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[483dba95-18ae-42e7-9b04-2963fa4035bb]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34 -p 172.16.0.220:3260 --logout {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7fcc72-825c-4c00-9899-c1ba11b0cc04]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34, portal: 172.16.0.220,3260]
Aug 09 18:34:26 user nova-compute[72418]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34, portal: 172.16.0.220,3260] successful.
Aug 09 18:34:26 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34 -p 172.16.0.220:3260 --op delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e54d078-d390-405c-bb4d-77b8f90cfa34 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[968ff0fc-af2b-4c79-a5cc-bf0034eb35a5]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] <== disconnect_volume: return (377ms) None {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Disconnected iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 18:34:26 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Deleting instance files /opt/stack/data/nova/instances/82d67874-5477-4554-bffc-2bf24eb28367_del
Aug 09 18:34:26 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Deletion of /opt/stack/data/nova/instances/82d67874-5477-4554-bffc-2bf24eb28367_del complete
Aug 09 18:34:26 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:26 user nova-compute[72418]: INFO nova.compute.manager [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Took 3.45 seconds to destroy the instance on the hypervisor.
Aug 09 18:34:26 user nova-compute[72418]: DEBUG oslo.service.loopingcall [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72418) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG nova.compute.manager [-] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Deallocating network for instance {{(pid=72418) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 18:34:26 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] deallocate_for_instance() {{(pid=72418) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 18:34:27 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Instance destroyed successfully.
Aug 09 18:34:27 user nova-compute[72418]: DEBUG nova.compute.manager [req-bfec1e8d-34c8-49e3-ac86-b290dbc19f93 req-bb72b5b5-3d57-4f47-8cb9-ae495718eafb service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Received event network-vif-unplugged-84eb2df4-6995-47c5-bf0f-387932ece66d {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:34:27 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-bfec1e8d-34c8-49e3-ac86-b290dbc19f93 req-bb72b5b5-3d57-4f47-8cb9-ae495718eafb service nova] Acquiring lock "1c53f871-2be9-4119-b5c0-d5081e2f4388-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:34:27 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-bfec1e8d-34c8-49e3-ac86-b290dbc19f93 req-bb72b5b5-3d57-4f47-8cb9-ae495718eafb service nova] Lock "1c53f871-2be9-4119-b5c0-d5081e2f4388-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:34:27 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-bfec1e8d-34c8-49e3-ac86-b290dbc19f93 req-bb72b5b5-3d57-4f47-8cb9-ae495718eafb service nova] Lock "1c53f871-2be9-4119-b5c0-d5081e2f4388-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:34:27 user nova-compute[72418]: DEBUG nova.compute.manager [req-bfec1e8d-34c8-49e3-ac86-b290dbc19f93 req-bb72b5b5-3d57-4f47-8cb9-ae495718eafb service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] No waiting events found dispatching network-vif-unplugged-84eb2df4-6995-47c5-bf0f-387932ece66d {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:34:27 user nova-compute[72418]: WARNING nova.compute.manager [req-bfec1e8d-34c8-49e3-ac86-b290dbc19f93 req-bb72b5b5-3d57-4f47-8cb9-ae495718eafb service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Received unexpected event network-vif-unplugged-84eb2df4-6995-47c5-bf0f-387932ece66d for instance with vm_state rescued and task_state unrescuing.
Aug 09 18:34:27 user nova-compute[72418]: DEBUG nova.compute.manager [req-bfec1e8d-34c8-49e3-ac86-b290dbc19f93 req-bb72b5b5-3d57-4f47-8cb9-ae495718eafb service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Received event network-vif-plugged-84eb2df4-6995-47c5-bf0f-387932ece66d {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:34:27 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-bfec1e8d-34c8-49e3-ac86-b290dbc19f93 req-bb72b5b5-3d57-4f47-8cb9-ae495718eafb service nova] Acquiring lock "1c53f871-2be9-4119-b5c0-d5081e2f4388-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:34:27 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-bfec1e8d-34c8-49e3-ac86-b290dbc19f93 req-bb72b5b5-3d57-4f47-8cb9-ae495718eafb service nova] Lock "1c53f871-2be9-4119-b5c0-d5081e2f4388-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:34:27 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-bfec1e8d-34c8-49e3-ac86-b290dbc19f93 req-bb72b5b5-3d57-4f47-8cb9-ae495718eafb service nova] Lock "1c53f871-2be9-4119-b5c0-d5081e2f4388-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:34:27 user nova-compute[72418]: DEBUG nova.compute.manager [req-bfec1e8d-34c8-49e3-ac86-b290dbc19f93 req-bb72b5b5-3d57-4f47-8cb9-ae495718eafb service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] No waiting events found dispatching network-vif-plugged-84eb2df4-6995-47c5-bf0f-387932ece66d {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:34:27 user nova-compute[72418]: WARNING nova.compute.manager [req-bfec1e8d-34c8-49e3-ac86-b290dbc19f93 req-bb72b5b5-3d57-4f47-8cb9-ae495718eafb service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Received unexpected event network-vif-plugged-84eb2df4-6995-47c5-bf0f-387932ece66d for instance with vm_state rescued and task_state unrescuing.
Aug 09 18:34:28 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:28 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:28 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:28 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:28 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:28 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:28 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:29 user nova-compute[72418]: DEBUG nova.compute.manager [req-f7bce094-f6a3-4919-b614-ad63cfbc3df5 req-66961025-facb-44c5-be76-00cd3e5eabe0 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received event network-vif-deleted-3cd5a4d7-5e70-42d3-b3bd-8d9262131f59 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:34:29 user nova-compute[72418]: INFO nova.compute.manager [req-f7bce094-f6a3-4919-b614-ad63cfbc3df5 req-66961025-facb-44c5-be76-00cd3e5eabe0 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Neutron deleted interface 3cd5a4d7-5e70-42d3-b3bd-8d9262131f59; detaching it from the instance and deleting it from the info cache
Aug 09 18:34:29 user nova-compute[72418]: DEBUG nova.network.neutron [req-f7bce094-f6a3-4919-b614-ad63cfbc3df5 req-66961025-facb-44c5-be76-00cd3e5eabe0 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Updating instance_info_cache with network_info: [{"id": "b07016e4-a1a6-438c-86e0-9b29f347ece4", "address": "fa:16:3e:55:82:4c", "network": {"id": "962e505b-9e11-4c96-b339-e36363ab6ef6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1326388745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb07016e4-a1", "ovs_interfaceid": "b07016e4-a1a6-438c-86e0-9b29f347ece4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a5c55350-ec71-4b02-90cc-ebc30e6211e5", "address": "fa:16:3e:3a:4c:d7", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c55350-ec", "ovs_interfaceid": "a5c55350-ec71-4b02-90cc-ebc30e6211e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4d58b14a-e8d0-4d9d-a712-8bfaa2b74bfc", "address": "fa:16:3e:3e:b6:33", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d58b14a-e8", "ovs_interfaceid": "4d58b14a-e8d0-4d9d-a712-8bfaa2b74bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6bc46fc5-0af5-4d39-8c6e-bbbfb093af14", "address": "fa:16:3e:93:62:de", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bc46fc5-0a", "ovs_interfaceid": "6bc46fc5-0af5-4d39-8c6e-bbbfb093af14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bb529102-e1c1-4932-a2b2-8c411d29ca58", "address": "fa:16:3e:4a:b3:a4", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb529102-e1", "ovs_interfaceid": "bb529102-e1c1-4932-a2b2-8c411d29ca58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d432e6f-81b2-4c44-bb25-b3d35941a43c", "address": "fa:16:3e:ff:50:55", "network": {"id": "dc14bb1f-2228-427b-88a6-852777894bc3", "bridge": "br-int", "label": "tempest-device-tagging-net2-2080696379", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d432e6f-81", "ovs_interfaceid": "3d432e6f-81b2-4c44-bb25-b3d35941a43c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:34:29 user nova-compute[72418]: DEBUG nova.compute.manager [req-f7bce094-f6a3-4919-b614-ad63cfbc3df5 req-66961025-facb-44c5-be76-00cd3e5eabe0 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Detach interface failed, port_id=3cd5a4d7-5e70-42d3-b3bd-8d9262131f59, reason: Instance 82d67874-5477-4554-bffc-2bf24eb28367 could not be found. {{(pid=72418) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 18:34:29 user nova-compute[72418]: DEBUG nova.compute.manager [req-164f6026-2cba-4f17-9c60-3f12c4ced704 req-1815b70c-03b9-4079-b34f-ff81199264e1 service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Received event network-vif-plugged-84eb2df4-6995-47c5-bf0f-387932ece66d {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:34:29 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-164f6026-2cba-4f17-9c60-3f12c4ced704 req-1815b70c-03b9-4079-b34f-ff81199264e1 service nova] Acquiring lock "1c53f871-2be9-4119-b5c0-d5081e2f4388-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:34:29 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-164f6026-2cba-4f17-9c60-3f12c4ced704 req-1815b70c-03b9-4079-b34f-ff81199264e1 service nova] Lock "1c53f871-2be9-4119-b5c0-d5081e2f4388-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:34:29 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-164f6026-2cba-4f17-9c60-3f12c4ced704 req-1815b70c-03b9-4079-b34f-ff81199264e1 service nova] Lock "1c53f871-2be9-4119-b5c0-d5081e2f4388-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:34:29 user nova-compute[72418]: DEBUG nova.compute.manager [req-164f6026-2cba-4f17-9c60-3f12c4ced704 req-1815b70c-03b9-4079-b34f-ff81199264e1 service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] No waiting events found dispatching network-vif-plugged-84eb2df4-6995-47c5-bf0f-387932ece66d {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:34:29 user nova-compute[72418]: WARNING nova.compute.manager [req-164f6026-2cba-4f17-9c60-3f12c4ced704 req-1815b70c-03b9-4079-b34f-ff81199264e1 service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Received unexpected event network-vif-plugged-84eb2df4-6995-47c5-bf0f-387932ece66d for instance with vm_state rescued and task_state unrescuing.
Aug 09 18:34:29 user nova-compute[72418]: DEBUG nova.compute.manager [req-164f6026-2cba-4f17-9c60-3f12c4ced704 req-1815b70c-03b9-4079-b34f-ff81199264e1 service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Received event network-vif-plugged-84eb2df4-6995-47c5-bf0f-387932ece66d {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:34:29 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-164f6026-2cba-4f17-9c60-3f12c4ced704 req-1815b70c-03b9-4079-b34f-ff81199264e1 service nova] Acquiring lock "1c53f871-2be9-4119-b5c0-d5081e2f4388-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:34:29 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-164f6026-2cba-4f17-9c60-3f12c4ced704 req-1815b70c-03b9-4079-b34f-ff81199264e1 service nova] Lock "1c53f871-2be9-4119-b5c0-d5081e2f4388-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:34:29 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-164f6026-2cba-4f17-9c60-3f12c4ced704 req-1815b70c-03b9-4079-b34f-ff81199264e1 service nova] Lock "1c53f871-2be9-4119-b5c0-d5081e2f4388-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:34:29 user nova-compute[72418]: DEBUG nova.compute.manager [req-164f6026-2cba-4f17-9c60-3f12c4ced704 req-1815b70c-03b9-4079-b34f-ff81199264e1 service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] No waiting events found dispatching network-vif-plugged-84eb2df4-6995-47c5-bf0f-387932ece66d {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:34:29 user nova-compute[72418]: WARNING nova.compute.manager [req-164f6026-2cba-4f17-9c60-3f12c4ced704 req-1815b70c-03b9-4079-b34f-ff81199264e1 service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Received unexpected event network-vif-plugged-84eb2df4-6995-47c5-bf0f-387932ece66d for instance with vm_state rescued and task_state unrescuing.
Aug 09 18:34:30 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:31 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Removed pending event for 1c53f871-2be9-4119-b5c0-d5081e2f4388 due to event {{(pid=72418) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 18:34:31 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691606071.1569183, 1c53f871-2be9-4119-b5c0-d5081e2f4388 => Resumed> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:34:31 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] VM Resumed (Lifecycle Event)
Aug 09 18:34:31 user nova-compute[72418]: DEBUG nova.compute.manager [None req-2f596816-de30-4fe3-9d41-4332ad74534f tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:34:31 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:34:31 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:34:31 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 09 18:34:31 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691606071.158744, 1c53f871-2be9-4119-b5c0-d5081e2f4388 => Started> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:34:31 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] VM Started (Lifecycle Event)
Aug 09 18:34:31 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:34:31 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:34:31 user nova-compute[72418]: DEBUG nova.compute.manager [req-45a3ed6b-073a-4935-8f9b-310440823645 req-0586529e-f31b-42e4-a577-7b18ccda1e2a service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received event network-vif-deleted-3d432e6f-81b2-4c44-bb25-b3d35941a43c {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:34:31 user nova-compute[72418]: INFO nova.compute.manager [req-45a3ed6b-073a-4935-8f9b-310440823645 req-0586529e-f31b-42e4-a577-7b18ccda1e2a service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Neutron deleted interface 3d432e6f-81b2-4c44-bb25-b3d35941a43c; detaching it from the instance and deleting it from the info cache
Aug 09 18:34:31 user nova-compute[72418]: DEBUG nova.network.neutron [req-45a3ed6b-073a-4935-8f9b-310440823645 req-0586529e-f31b-42e4-a577-7b18ccda1e2a service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Updating instance_info_cache with network_info: [{"id": "b07016e4-a1a6-438c-86e0-9b29f347ece4", "address": "fa:16:3e:55:82:4c", "network": {"id": "962e505b-9e11-4c96-b339-e36363ab6ef6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1326388745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb07016e4-a1", "ovs_interfaceid": "b07016e4-a1a6-438c-86e0-9b29f347ece4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a5c55350-ec71-4b02-90cc-ebc30e6211e5", "address": "fa:16:3e:3a:4c:d7", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c55350-ec", "ovs_interfaceid": "a5c55350-ec71-4b02-90cc-ebc30e6211e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4d58b14a-e8d0-4d9d-a712-8bfaa2b74bfc", "address": "fa:16:3e:3e:b6:33", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d58b14a-e8", "ovs_interfaceid": "4d58b14a-e8d0-4d9d-a712-8bfaa2b74bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6bc46fc5-0af5-4d39-8c6e-bbbfb093af14", "address": "fa:16:3e:93:62:de", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bc46fc5-0a", "ovs_interfaceid": "6bc46fc5-0af5-4d39-8c6e-bbbfb093af14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bb529102-e1c1-4932-a2b2-8c411d29ca58", "address": "fa:16:3e:4a:b3:a4", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb529102-e1", "ovs_interfaceid": "bb529102-e1c1-4932-a2b2-8c411d29ca58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:34:31 user nova-compute[72418]: DEBUG nova.compute.manager [req-45a3ed6b-073a-4935-8f9b-310440823645 req-0586529e-f31b-42e4-a577-7b18ccda1e2a service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Detach interface failed, port_id=3d432e6f-81b2-4c44-bb25-b3d35941a43c, reason: Instance 82d67874-5477-4554-bffc-2bf24eb28367 could not be found. {{(pid=72418) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 18:34:31 user nova-compute[72418]: DEBUG nova.compute.manager [req-45a3ed6b-073a-4935-8f9b-310440823645 req-0586529e-f31b-42e4-a577-7b18ccda1e2a service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received event network-vif-deleted-6bc46fc5-0af5-4d39-8c6e-bbbfb093af14 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:34:31 user nova-compute[72418]: INFO nova.compute.manager [req-45a3ed6b-073a-4935-8f9b-310440823645 req-0586529e-f31b-42e4-a577-7b18ccda1e2a service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Neutron deleted interface 6bc46fc5-0af5-4d39-8c6e-bbbfb093af14; detaching it from the instance and deleting it from the info cache
Aug 09 18:34:31 user nova-compute[72418]: DEBUG nova.network.neutron [req-45a3ed6b-073a-4935-8f9b-310440823645 req-0586529e-f31b-42e4-a577-7b18ccda1e2a service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Updating instance_info_cache with network_info: [{"id": "b07016e4-a1a6-438c-86e0-9b29f347ece4", "address": "fa:16:3e:55:82:4c", "network": {"id": "962e505b-9e11-4c96-b339-e36363ab6ef6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1326388745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb07016e4-a1", "ovs_interfaceid": "b07016e4-a1a6-438c-86e0-9b29f347ece4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a5c55350-ec71-4b02-90cc-ebc30e6211e5", "address": "fa:16:3e:3a:4c:d7", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c55350-ec", "ovs_interfaceid": "a5c55350-ec71-4b02-90cc-ebc30e6211e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4d58b14a-e8d0-4d9d-a712-8bfaa2b74bfc", "address": "fa:16:3e:3e:b6:33", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d58b14a-e8", "ovs_interfaceid": "4d58b14a-e8d0-4d9d-a712-8bfaa2b74bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bb529102-e1c1-4932-a2b2-8c411d29ca58", "address": "fa:16:3e:4a:b3:a4", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb529102-e1", "ovs_interfaceid": "bb529102-e1c1-4932-a2b2-8c411d29ca58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:34:31 user nova-compute[72418]: DEBUG nova.compute.manager [req-45a3ed6b-073a-4935-8f9b-310440823645 req-0586529e-f31b-42e4-a577-7b18ccda1e2a service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Detach interface failed, port_id=6bc46fc5-0af5-4d39-8c6e-bbbfb093af14, reason: Instance 82d67874-5477-4554-bffc-2bf24eb28367 could not be found. {{(pid=72418) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 18:34:31 user nova-compute[72418]: DEBUG nova.compute.manager [req-45a3ed6b-073a-4935-8f9b-310440823645 req-0586529e-f31b-42e4-a577-7b18ccda1e2a service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received event network-vif-deleted-bb529102-e1c1-4932-a2b2-8c411d29ca58 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:34:31 user nova-compute[72418]: INFO nova.compute.manager [req-45a3ed6b-073a-4935-8f9b-310440823645 req-0586529e-f31b-42e4-a577-7b18ccda1e2a service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Neutron deleted interface bb529102-e1c1-4932-a2b2-8c411d29ca58; detaching it from the instance and deleting it from the info cache
Aug 09 18:34:31 user nova-compute[72418]: DEBUG nova.network.neutron [req-45a3ed6b-073a-4935-8f9b-310440823645 req-0586529e-f31b-42e4-a577-7b18ccda1e2a service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Updating instance_info_cache with network_info: [{"id": "b07016e4-a1a6-438c-86e0-9b29f347ece4", "address": "fa:16:3e:55:82:4c", "network": {"id": "962e505b-9e11-4c96-b339-e36363ab6ef6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1326388745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb07016e4-a1", "ovs_interfaceid": "b07016e4-a1a6-438c-86e0-9b29f347ece4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a5c55350-ec71-4b02-90cc-ebc30e6211e5", "address": "fa:16:3e:3a:4c:d7", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c55350-ec", "ovs_interfaceid": "a5c55350-ec71-4b02-90cc-ebc30e6211e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4d58b14a-e8d0-4d9d-a712-8bfaa2b74bfc", "address": "fa:16:3e:3e:b6:33", "network": {"id": "1607c003-cf2e-4a0f-9261-e0cac426786b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1397380945", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "32d3f1359c67450181629511bf3d908a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d58b14a-e8", "ovs_interfaceid": "4d58b14a-e8d0-4d9d-a712-8bfaa2b74bfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:34:31 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:34:31 user nova-compute[72418]: DEBUG nova.compute.manager [req-45a3ed6b-073a-4935-8f9b-310440823645 req-0586529e-f31b-42e4-a577-7b18ccda1e2a service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Detach interface failed, port_id=bb529102-e1c1-4932-a2b2-8c411d29ca58, reason: Instance 82d67874-5477-4554-bffc-2bf24eb28367 could not be found. {{(pid=72418) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 18:34:31 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-98961e9e-c592-4e35-ad53-00a0796732fd tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Acquiring lock "2c9e974b-b993-4f4e-9446-14941c39f109" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:34:31 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-98961e9e-c592-4e35-ad53-00a0796732fd tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "2c9e974b-b993-4f4e-9446-14941c39f109" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:34:31 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Took 4.85 seconds to deallocate network for instance.
Aug 09 18:34:31 user nova-compute[72418]: DEBUG nova.objects.instance [None req-98961e9e-c592-4e35-ad53-00a0796732fd tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lazy-loading 'flavor' on Instance uuid 2c9e974b-b993-4f4e-9446-14941c39f109 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:34:31 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-98961e9e-c592-4e35-ad53-00a0796732fd tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "2c9e974b-b993-4f4e-9446-14941c39f109" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:34:31 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-98961e9e-c592-4e35-ad53-00a0796732fd tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Acquiring lock "2c9e974b-b993-4f4e-9446-14941c39f109" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:34:31 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-98961e9e-c592-4e35-ad53-00a0796732fd tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "2c9e974b-b993-4f4e-9446-14941c39f109" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:34:31 user nova-compute[72418]: INFO nova.compute.manager [None req-98961e9e-c592-4e35-ad53-00a0796732fd tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Attaching volume 7247fc0c-7203-4491-9f2d-07256e221a76 to /dev/vdb
Aug 09 18:34:31 user nova-compute[72418]: DEBUG os_brick.utils [None req-98961e9e-c592-4e35-ad53-00a0796732fd tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:34:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:31 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8ae8f1-0bbd-4c3e-beff-5e06e0c45726]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ad56b243ad71\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:31 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[3010367d-c72a-4fc0-9851-2e8151f9e84f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:32 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:32 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a22493-7fd0-46cf-a974-48a2a7394532]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:32 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[207d6d11-f7c3-471c-90c1-5f5d69512d82]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:32 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-98961e9e-c592-4e35-ad53-00a0796732fd tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Running cmd (subprocess): nvme version {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:32 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-98961e9e-c592-4e35-ad53-00a0796732fd tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] 'nvme version' failed. Not Retrying. {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:34:32 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.nvmeof [None req-98961e9e-c592-4e35-ad53-00a0796732fd tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] nvme not present on system {{(pid=72418) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 18:34:32 user nova-compute[72418]: DEBUG nova.compute.manager [req-d4e79428-9bf1-496e-8dfd-b6c63fef39db req-591bd36d-b6f9-49ba-aa5e-4fed54beee17 service nova] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Received event network-changed-1fa6e320-1b1b-41dc-8204-a7bed1172292 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:34:32 user nova-compute[72418]: DEBUG nova.compute.manager [req-d4e79428-9bf1-496e-8dfd-b6c63fef39db req-591bd36d-b6f9-49ba-aa5e-4fed54beee17 service nova] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Refreshing instance network info cache due to event network-changed-1fa6e320-1b1b-41dc-8204-a7bed1172292. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:34:32 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-d4e79428-9bf1-496e-8dfd-b6c63fef39db req-591bd36d-b6f9-49ba-aa5e-4fed54beee17 service nova] Acquiring lock "refresh_cache-2c9e974b-b993-4f4e-9446-14941c39f109" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:34:32 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-d4e79428-9bf1-496e-8dfd-b6c63fef39db req-591bd36d-b6f9-49ba-aa5e-4fed54beee17 service nova] Acquired lock "refresh_cache-2c9e974b-b993-4f4e-9446-14941c39f109" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:34:32 user nova-compute[72418]: DEBUG nova.network.neutron [req-d4e79428-9bf1-496e-8dfd-b6c63fef39db req-591bd36d-b6f9-49ba-aa5e-4fed54beee17 service nova] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Refreshing network info cache for port 1fa6e320-1b1b-41dc-8204-a7bed1172292 {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:34:32 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:32 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:34:32 user nova-compute[72418]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 18:34:32 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ca0c2e-224a-441a-bd1d-b7ecfc32fbf2]: (4, '') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:32 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-98961e9e-c592-4e35-ad53-00a0796732fd tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72418) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 18:34:32 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-98961e9e-c592-4e35-ad53-00a0796732fd tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 18:34:32 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-98961e9e-c592-4e35-ad53-00a0796732fd tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] LIGHTOS: no hostnqn found. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 18:34:32 user nova-compute[72418]: DEBUG os_brick.utils [None req-98961e9e-c592-4e35-ad53-00a0796732fd tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ad56b243ad71', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:34:32 user nova-compute[72418]: DEBUG nova.virt.block_device [None req-98961e9e-c592-4e35-ad53-00a0796732fd tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Updating existing volume attachment record: af446fcb-df19-440b-83c4-53e029785b59 {{(pid=72418) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 18:34:32 user nova-compute[72418]: DEBUG nova.network.neutron [req-d4e79428-9bf1-496e-8dfd-b6c63fef39db req-591bd36d-b6f9-49ba-aa5e-4fed54beee17 service nova] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Updated VIF entry in instance network info cache for port 1fa6e320-1b1b-41dc-8204-a7bed1172292. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:34:32 user nova-compute[72418]: DEBUG nova.network.neutron [req-d4e79428-9bf1-496e-8dfd-b6c63fef39db req-591bd36d-b6f9-49ba-aa5e-4fed54beee17 service nova] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Updating instance_info_cache with network_info: [{"id": "1fa6e320-1b1b-41dc-8204-a7bed1172292", "address": "fa:16:3e:06:d3:3a", "network": {"id": "0fbd02ef-7c74-46c2-a09c-3b69be222ffa", "bridge": "br-int", "label": "tempest-TestStampPattern-85008345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce18df915bca48109597ad4aa8f1d116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fa6e320-1b", "ovs_interfaceid": "1fa6e320-1b1b-41dc-8204-a7bed1172292", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:34:32 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-d4e79428-9bf1-496e-8dfd-b6c63fef39db req-591bd36d-b6f9-49ba-aa5e-4fed54beee17 service nova] Releasing lock "refresh_cache-2c9e974b-b993-4f4e-9446-14941c39f109" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:34:33 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:33 user nova-compute[72418]: DEBUG nova.compute.manager [req-94c339d7-ebdc-49c4-95b3-13721b0418c0 req-e4e6fa80-3480-4c1e-a0fa-61cf6f247e84 service nova] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Received event network-vif-deleted-b07016e4-a1a6-438c-86e0-9b29f347ece4 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:34:34 user nova-compute[72418]: INFO nova.compute.manager [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Took 2.68 seconds to detach 3 volumes for instance.
Aug 09 18:34:34 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:34:34 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:34:34 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:34:34 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:34:34 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.500s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:34:34 user nova-compute[72418]: INFO nova.scheduler.client.report [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Deleted allocations for instance 82d67874-5477-4554-bffc-2bf24eb28367
Aug 09 18:34:35 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-9f590ed3-d205-42fa-ad9e-4f865334e7f4 tempest-TaggedBootDevicesTest_v242-1910102697 tempest-TaggedBootDevicesTest_v242-1910102697-project-member] Lock "82d67874-5477-4554-bffc-2bf24eb28367" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.737s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:34:35 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:38 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:40 user nova-compute[72418]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691606065.1460803, 82d67874-5477-4554-bffc-2bf24eb28367 => Stopped> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:34:40 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] VM Stopped (Lifecycle Event)
Aug 09 18:34:40 user nova-compute[72418]: DEBUG nova.compute.manager [None req-e9c71559-3b35-44ed-bef1-19855330e1bb None None] [instance: 82d67874-5477-4554-bffc-2bf24eb28367] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:34:40 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:40 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Starting finish_migration {{(pid=72418) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 09 18:34:40 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Instance directory exists: not creating {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 18:34:40 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Creating image(s)
Aug 09 18:34:40 user nova-compute[72418]: DEBUG nova.objects.instance [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lazy-loading 'trusted_certs' on Instance uuid 03ad5bab-ab32-47fc-b7e8-b32282b9c20d {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:34:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.152s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:40 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Checking if we can resize image /opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/disk. size=21474836480 {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 18:34:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/disk 21474836480 {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/disk 21474836480" returned: 0 in 0.060s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Did not create local disks {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Ensure instance console log exists: /opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/console.log {{(pid=72418) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Start _get_guest_xml network_info=[{"id": "ea92909f-40d7-48a8-be09-50439674945c", "address": "fa:16:3e:3e:5e:e7", "network": {"id": "8354f86b-1e91-42ca-9847-769bb0aadcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-664289957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-664289957-network", "vif_mac": "fa:16:3e:3e:5e:e7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405587d223d54c5ab4f72a1994ac2862", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea92909f-40", "ovs_interfaceid": "ea92909f-40d7-48a8-be09-50439674945c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'attachment_id': '04fd5eba-624c-4c98-8f9b-ab17664b66f9', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EzlWwnfa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '03ad5bab-ab32-47fc-b7e8-b32282b9c20d', 'attached_at': '2023-08-09T18:34:40.000000', 'detached_at': '', 'volume_id': '57cf2c50-486c-4ee4-a0f8-c48ad6790e71', 'serial': '57cf2c50-486c-4ee4-a0f8-c48ad6790e71'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'volume_type': None} {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 18:34:41 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:34:41 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:34:41 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] CPU controller missing on host. {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] CPU controller found on host. {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72418) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T18:18:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Flavor limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Image limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Flavor pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Image pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Got 1 possible topologies {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG nova.objects.instance [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lazy-loading 'vcpu_model' on Instance uuid 03ad5bab-ab32-47fc-b7e8-b32282b9c20d {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Calling os-brick to attach iSCSI Volume {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EzlWwnfa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:34:41 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:34:41 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:34:41 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:34:41 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:34:41 user nova-compute[72418]: INFO os_brick.initiator.connectors.iscsi [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 18:34:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80bf902-5ec5-4716-9c4d-951af33a5671]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 18:34:41 user nova-compute[72418]:  {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --interface default --op new {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4d748c-3af8-491c-af2f-81def3dd08c7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71] added\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71] added
Aug 09 18:34:41 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[276f45be-ab6a-4595-b1a3-28dda678952d]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c56908-03df-4229-add2-d8a93ddf8a57]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EzlWwnfa {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EzlWwnfa" returned: 0 in 0.028s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[9adc0352-0622-41ce-bfae-1f5927614b71]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EzlWwnfa'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc52db9e-ba11-4e57-ae3a-493630b118ee]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[7703fee4-e3cc-4bba-b1c3-bfef53aa15b0]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:34:41 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:34:41 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:34:41 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:34:41 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:34:41 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:34:41 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --login {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc6a5c0-336e-4be7-baf2-c765d13ef693]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71, portal: 172.16.0.220,3260]
Aug 09 18:34:41 user nova-compute[72418]: Login to [iface: default, target: iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71, portal: 172.16.0.220,3260] successful.
Aug 09 18:34:41 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98961e9e-c592-4e35-ad53-00a0796732fd tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Calling os-brick to attach iSCSI Volume {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-98961e9e-c592-4e35-ad53-00a0796732fd tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7247fc0c-7203-4491-9f2d-07256e221a76'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GAjfXOaB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:34:41 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-98961e9e-c592-4e35-ad53-00a0796732fd tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:34:41 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-98961e9e-c592-4e35-ad53-00a0796732fd tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db5c613-72cd-4da6-8af9-daf6a37c2868]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ba73cd-55a5-426a-a2be-485acfd1cb52]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:34:41 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:34:41 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:34:41 user nova-compute[72418]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:34:41 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:34:41 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:34:41 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:34:41 user nova-compute[72418]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:34:41 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.363s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Connected to 172.16.0.220:3260 {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] HCTL ('35', '-', '-', 0) found on session 30 with lun 0 {{(pid=72418) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72418) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78198c6-2d7a-48f5-bdcb-41009a7e70ad]: (4, ('- - 0', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72418) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 18:34:41 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EzlWwnfa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.414s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] <== connect_volume: return (1416ms) {'type': 'block', 'scsi_wwn': '26131393039383131', 'path': '/dev/sdd'} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131393039383131', 'path': '/dev/sdd'} {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-98961e9e-c592-4e35-ad53-00a0796732fd tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.092s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:34:42 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-98961e9e-c592-4e35-ad53-00a0796732fd tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:34:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-98961e9e-c592-4e35-ad53-00a0796732fd tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7247fc0c-7203-4491-9f2d-07256e221a76" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-98961e9e-c592-4e35-ad53-00a0796732fd tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7247fc0c-7203-4491-9f2d-07256e221a76" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:34:42 user nova-compute[72418]: INFO os_brick.initiator.connectors.iscsi [None req-98961e9e-c592-4e35-ad53-00a0796732fd tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 18:34:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7247fc0c-7203-4491-9f2d-07256e221a76 -p 172.16.0.220:3260 {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7247fc0c-7203-4491-9f2d-07256e221a76 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a526757-2678-41a3-979f-cddc96dd787d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-98961e9e-c592-4e35-ad53-00a0796732fd tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 18:34:42 user nova-compute[72418]:  {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7247fc0c-7203-4491-9f2d-07256e221a76 -p 172.16.0.220:3260 --interface default --op new {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:30:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1873430052',display_name='tempest-ServerActionsTestOtherB-server-1873430052',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1873430052',id=22,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIcobG4HnuTYOQnNQv/MwdYT3LE/RLnOlgxtm9ZW7mVchwGrvFEE/XUOIJNiUK2ZNsyoG2e4ALumseJiS6y2HeRcRosbaQtxOHGtF7A55P++8WqVj1ISNQq63FhVymDdqQ==',key_name='tempest-keypair-1241971956',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:30:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='405587d223d54c5ab4f72a1994ac2862',ramdisk_id='',reservation_id='r-y3ado2eg',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1643003262',owner_user_name='tempest-ServerActionsTestOtherB-1643003262-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:34:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8174362ccd88488d867db28e18906a62',uuid=03ad5bab-ab32-47fc-b7e8-b32282b9c20d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea92909f-40d7-48a8-be09-50439674945c", "address": "fa:16:3e:3e:5e:e7", "network": {"id": "8354f86b-1e91-42ca-9847-769bb0aadcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-664289957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-664289957-network", "vif_mac": "fa:16:3e:3e:5e:e7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405587d223d54c5ab4f72a1994ac2862", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea92909f-40", "ovs_interfaceid": "ea92909f-40d7-48a8-be09-50439674945c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Converting VIF {"id": "ea92909f-40d7-48a8-be09-50439674945c", "address": "fa:16:3e:3e:5e:e7", "network": {"id": "8354f86b-1e91-42ca-9847-769bb0aadcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-664289957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-664289957-network", "vif_mac": "fa:16:3e:3e:5e:e7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405587d223d54c5ab4f72a1994ac2862", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea92909f-40", "ovs_interfaceid": "ea92909f-40d7-48a8-be09-50439674945c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:5e:e7,bridge_name='br-int',has_traffic_filtering=True,id=ea92909f-40d7-48a8-be09-50439674945c,network=Network(8354f86b-1e91-42ca-9847-769bb0aadcd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea92909f-40') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] End _get_guest_xml xml=<domain type="kvm">
Aug 09 18:34:42 user nova-compute[72418]:   <uuid>03ad5bab-ab32-47fc-b7e8-b32282b9c20d</uuid>
Aug 09 18:34:42 user nova-compute[72418]:   <name>instance-00000016</name>
Aug 09 18:34:42 user nova-compute[72418]:   <memory>2097152</memory>
Aug 09 18:34:42 user nova-compute[72418]:   <vcpu>1</vcpu>
Aug 09 18:34:42 user nova-compute[72418]:   <metadata>
Aug 09 18:34:42 user nova-compute[72418]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:34:42 user nova-compute[72418]:       <nova:package version="0.0.0"/>
Aug 09 18:34:42 user nova-compute[72418]:       <nova:name>tempest-ServerActionsTestOtherB-server-1873430052</nova:name>
Aug 09 18:34:42 user nova-compute[72418]:       <nova:creationTime>2023-08-09 18:34:41</nova:creationTime>
Aug 09 18:34:42 user nova-compute[72418]:       <nova:flavor name="m1.small">
Aug 09 18:34:42 user nova-compute[72418]:         <nova:memory>2048</nova:memory>
Aug 09 18:34:42 user nova-compute[72418]:         <nova:disk>20</nova:disk>
Aug 09 18:34:42 user nova-compute[72418]:         <nova:swap>0</nova:swap>
Aug 09 18:34:42 user nova-compute[72418]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:34:42 user nova-compute[72418]:         <nova:vcpus>1</nova:vcpus>
Aug 09 18:34:42 user nova-compute[72418]:       </nova:flavor>
Aug 09 18:34:42 user nova-compute[72418]:       <nova:owner>
Aug 09 18:34:42 user nova-compute[72418]:         <nova:user uuid="8174362ccd88488d867db28e18906a62">tempest-ServerActionsTestOtherB-1643003262-project-member</nova:user>
Aug 09 18:34:42 user nova-compute[72418]:         <nova:project uuid="405587d223d54c5ab4f72a1994ac2862">tempest-ServerActionsTestOtherB-1643003262</nova:project>
Aug 09 18:34:42 user nova-compute[72418]:       </nova:owner>
Aug 09 18:34:42 user nova-compute[72418]:       <nova:root type="image" uuid="8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e"/>
Aug 09 18:34:42 user nova-compute[72418]:       <nova:ports>
Aug 09 18:34:42 user nova-compute[72418]:         <nova:port uuid="ea92909f-40d7-48a8-be09-50439674945c">
Aug 09 18:34:42 user nova-compute[72418]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 18:34:42 user nova-compute[72418]:         </nova:port>
Aug 09 18:34:42 user nova-compute[72418]:       </nova:ports>
Aug 09 18:34:42 user nova-compute[72418]:     </nova:instance>
Aug 09 18:34:42 user nova-compute[72418]:   </metadata>
Aug 09 18:34:42 user nova-compute[72418]:   <sysinfo type="smbios">
Aug 09 18:34:42 user nova-compute[72418]:     <system>
Aug 09 18:34:42 user nova-compute[72418]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 18:34:42 user nova-compute[72418]:       <entry name="product">OpenStack Nova</entry>
Aug 09 18:34:42 user nova-compute[72418]:       <entry name="version">0.0.0</entry>
Aug 09 18:34:42 user nova-compute[72418]:       <entry name="serial">03ad5bab-ab32-47fc-b7e8-b32282b9c20d</entry>
Aug 09 18:34:42 user nova-compute[72418]:       <entry name="uuid">03ad5bab-ab32-47fc-b7e8-b32282b9c20d</entry>
Aug 09 18:34:42 user nova-compute[72418]:       <entry name="family">Virtual Machine</entry>
Aug 09 18:34:42 user nova-compute[72418]:     </system>
Aug 09 18:34:42 user nova-compute[72418]:   </sysinfo>
Aug 09 18:34:42 user nova-compute[72418]:   <os>
Aug 09 18:34:42 user nova-compute[72418]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 18:34:42 user nova-compute[72418]:     <boot dev="hd"/>
Aug 09 18:34:42 user nova-compute[72418]:     <smbios mode="sysinfo"/>
Aug 09 18:34:42 user nova-compute[72418]:   </os>
Aug 09 18:34:42 user nova-compute[72418]:   <features>
Aug 09 18:34:42 user nova-compute[72418]:     <acpi/>
Aug 09 18:34:42 user nova-compute[72418]:     <apic/>
Aug 09 18:34:42 user nova-compute[72418]:     <vmcoreinfo/>
Aug 09 18:34:42 user nova-compute[72418]:   </features>
Aug 09 18:34:42 user nova-compute[72418]:   <clock offset="utc">
Aug 09 18:34:42 user nova-compute[72418]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 18:34:42 user nova-compute[72418]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 18:34:42 user nova-compute[72418]:     <timer name="hpet" present="no"/>
Aug 09 18:34:42 user nova-compute[72418]:   </clock>
Aug 09 18:34:42 user nova-compute[72418]:   <cpu mode="custom" match="exact">
Aug 09 18:34:42 user nova-compute[72418]:     <model>Nehalem</model>
Aug 09 18:34:42 user nova-compute[72418]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 18:34:42 user nova-compute[72418]:   </cpu>
Aug 09 18:34:42 user nova-compute[72418]:   <devices>
Aug 09 18:34:42 user nova-compute[72418]:     <disk type="file" device="disk">
Aug 09 18:34:42 user nova-compute[72418]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 18:34:42 user nova-compute[72418]:       <source file="/opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/disk"/>
Aug 09 18:34:42 user nova-compute[72418]:       <target dev="vda" bus="virtio"/>
Aug 09 18:34:42 user nova-compute[72418]:     </disk>
Aug 09 18:34:42 user nova-compute[72418]:     <disk type="block" device="disk">
Aug 09 18:34:42 user nova-compute[72418]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:34:42 user nova-compute[72418]:       <source dev="/dev/sdd"/>
Aug 09 18:34:42 user nova-compute[72418]:       <target dev="vdb" bus="virtio"/>
Aug 09 18:34:42 user nova-compute[72418]:       <serial>57cf2c50-486c-4ee4-a0f8-c48ad6790e71</serial>
Aug 09 18:34:42 user nova-compute[72418]:     </disk>
Aug 09 18:34:42 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:34:42 user nova-compute[72418]:       <mac address="fa:16:3e:3e:5e:e7"/>
Aug 09 18:34:42 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:34:42 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:34:42 user nova-compute[72418]:       <target dev="tapea92909f-40"/>
Aug 09 18:34:42 user nova-compute[72418]:     </interface>
Aug 09 18:34:42 user nova-compute[72418]:     <serial type="pty">
Aug 09 18:34:42 user nova-compute[72418]:       <log file="/opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/console.log" append="off"/>
Aug 09 18:34:42 user nova-compute[72418]:     </serial>
Aug 09 18:34:42 user nova-compute[72418]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 18:34:42 user nova-compute[72418]:     <video>
Aug 09 18:34:42 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:34:42 user nova-compute[72418]:     </video>
Aug 09 18:34:42 user nova-compute[72418]:     <rng model="virtio">
Aug 09 18:34:42 user nova-compute[72418]:       <backend model="random">/dev/urandom</backend>
Aug 09 18:34:42 user nova-compute[72418]:     </rng>
Aug 09 18:34:42 user nova-compute[72418]:     <controller type="usb" index="0" model="none"/>
Aug 09 18:34:42 user nova-compute[72418]:     <memballoon model="virtio">
Aug 09 18:34:42 user nova-compute[72418]:       <stats period="10"/>
Aug 09 18:34:42 user nova-compute[72418]:     </memballoon>
Aug 09 18:34:42 user nova-compute[72418]:   </devices>
Aug 09 18:34:42 user nova-compute[72418]: </domain>
Aug 09 18:34:42 user nova-compute[72418]:  {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:30:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1873430052',display_name='tempest-ServerActionsTestOtherB-server-1873430052',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1873430052',id=22,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIcobG4HnuTYOQnNQv/MwdYT3LE/RLnOlgxtm9ZW7mVchwGrvFEE/XUOIJNiUK2ZNsyoG2e4ALumseJiS6y2HeRcRosbaQtxOHGtF7A55P++8WqVj1ISNQq63FhVymDdqQ==',key_name='tempest-keypair-1241971956',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:30:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='405587d223d54c5ab4f72a1994ac2862',ramdisk_id='',reservation_id='r-y3ado2eg',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1643003262',owner_user_name='tempest-ServerActionsTestOtherB-1643003262-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:34:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8174362ccd88488d867db28e18906a62',uuid=03ad5bab-ab32-47fc-b7e8-b32282b9c20d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea92909f-40d7-48a8-be09-50439674945c", "address": "fa:16:3e:3e:5e:e7", "network": {"id": "8354f86b-1e91-42ca-9847-769bb0aadcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-664289957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-664289957-network", "vif_mac": "fa:16:3e:3e:5e:e7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405587d223d54c5ab4f72a1994ac2862", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea92909f-40", "ovs_interfaceid": "ea92909f-40d7-48a8-be09-50439674945c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Converting VIF {"id": "ea92909f-40d7-48a8-be09-50439674945c", "address": "fa:16:3e:3e:5e:e7", "network": {"id": "8354f86b-1e91-42ca-9847-769bb0aadcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-664289957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-664289957-network", "vif_mac": "fa:16:3e:3e:5e:e7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405587d223d54c5ab4f72a1994ac2862", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea92909f-40", "ovs_interfaceid": "ea92909f-40d7-48a8-be09-50439674945c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:5e:e7,bridge_name='br-int',has_traffic_filtering=True,id=ea92909f-40d7-48a8-be09-50439674945c,network=Network(8354f86b-1e91-42ca-9847-769bb0aadcd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea92909f-40') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG os_vif [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:5e:e7,bridge_name='br-int',has_traffic_filtering=True,id=ea92909f-40d7-48a8-be09-50439674945c,network=Network(8354f86b-1e91-42ca-9847-769bb0aadcd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea92909f-40') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7247fc0c-7203-4491-9f2d-07256e221a76 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9fb541-7b36-4f1c-96a6-ea1ad48e0942]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7247fc0c-7203-4491-9f2d-07256e221a76] added\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-98961e9e-c592-4e35-ad53-00a0796732fd tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7247fc0c-7203-4491-9f2d-07256e221a76] added
Aug 09 18:34:42 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7247fc0c-7203-4491-9f2d-07256e221a76 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea92909f-40, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapea92909f-40, col_values=(('external_ids', {'iface-id': 'ea92909f-40d7-48a8-be09-50439674945c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:5e:e7', 'vm-uuid': '03ad5bab-ab32-47fc-b7e8-b32282b9c20d'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:42 user nova-compute[72418]: INFO os_vif [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:5e:e7,bridge_name='br-int',has_traffic_filtering=True,id=ea92909f-40d7-48a8-be09-50439674945c,network=Network(8354f86b-1e91-42ca-9847-769bb0aadcd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea92909f-40')
Aug 09 18:34:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7247fc0c-7203-4491-9f2d-07256e221a76 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[d795fc8a-eed3-48ff-8943-b6615cc0c2e4]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-98961e9e-c592-4e35-ad53-00a0796732fd tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7247fc0c-7203-4491-9f2d-07256e221a76 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7247fc0c-7203-4491-9f2d-07256e221a76 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ded7c4-f940-4cb3-9870-a7a929f304fb]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-98961e9e-c592-4e35-ad53-00a0796732fd tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7247fc0c-7203-4491-9f2d-07256e221a76 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GAjfXOaB {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7247fc0c-7203-4491-9f2d-07256e221a76 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GAjfXOaB" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2b8cbc-f89f-4950-8eef-ea688c816e84]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-98961e9e-c592-4e35-ad53-00a0796732fd tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GAjfXOaB'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7247fc0c-7203-4491-9f2d-07256e221a76 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] No VIF found with MAC fa:16:3e:3e:5e:e7, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7247fc0c-7203-4491-9f2d-07256e221a76 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[94eb6c7a-638f-42af-adba-727ec5176bfb]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-98961e9e-c592-4e35-ad53-00a0796732fd tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea005eb-7663-4d2e-977d-bb1086dd8f47]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-98961e9e-c592-4e35-ad53-00a0796732fd tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:34:42 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:34:42 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:34:42 user nova-compute[72418]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:34:42 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-98961e9e-c592-4e35-ad53-00a0796732fd tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:34:42 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:34:42 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:34:42 user nova-compute[72418]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:34:42 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7247fc0c-7203-4491-9f2d-07256e221a76 -p 172.16.0.220:3260 --login {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7247fc0c-7203-4491-9f2d-07256e221a76 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54f9b32-56a0-4775-b106-85384933be65]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7247fc0c-7203-4491-9f2d-07256e221a76, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7247fc0c-7203-4491-9f2d-07256e221a76, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-98961e9e-c592-4e35-ad53-00a0796732fd tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7247fc0c-7203-4491-9f2d-07256e221a76, portal: 172.16.0.220,3260]
Aug 09 18:34:42 user nova-compute[72418]: Login to [iface: default, target: iqn.2010-10.org.openstack:7247fc0c-7203-4491-9f2d-07256e221a76, portal: 172.16.0.220,3260] successful.
Aug 09 18:34:42 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7247fc0c-7203-4491-9f2d-07256e221a76 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7247fc0c-7203-4491-9f2d-07256e221a76 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1bf3aef-03c7-4a84-92a3-6e1176c10f1f]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-98961e9e-c592-4e35-ad53-00a0796732fd tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9636d84-2577-46df-981b-e9bc28d7eaeb]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7247fc0c-7203-4491-9f2d-07256e221a76 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-98961e9e-c592-4e35-ad53-00a0796732fd tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:34:42 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:34:42 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:34:42 user nova-compute[72418]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:34:42 user nova-compute[72418]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7247fc0c-7203-4491-9f2d-07256e221a76 (non-flash)
Aug 09 18:34:42 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-98961e9e-c592-4e35-ad53-00a0796732fd tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:34:42 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:34:42 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:34:42 user nova-compute[72418]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:34:42 user nova-compute[72418]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7247fc0c-7203-4491-9f2d-07256e221a76 (non-flash)
Aug 09 18:34:42 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-98961e9e-c592-4e35-ad53-00a0796732fd tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7247fc0c-7203-4491-9f2d-07256e221a76" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-98961e9e-c592-4e35-ad53-00a0796732fd tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Connected to 172.16.0.220:3260 {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-98961e9e-c592-4e35-ad53-00a0796732fd tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] HCTL ('36', '-', '-', 0) found on session 31 with lun 0 {{(pid=72418) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-98961e9e-c592-4e35-ad53-00a0796732fd tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72418) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe160de-b9cd-4321-880e-21e8e62bd5cb]: (4, ('- - 0', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-98961e9e-c592-4e35-ad53-00a0796732fd tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72418) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 18:34:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-98961e9e-c592-4e35-ad53-00a0796732fd tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GAjfXOaB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 18:34:43 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:43 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-98961e9e-c592-4e35-ad53-00a0796732fd tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:34:43 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-98961e9e-c592-4e35-ad53-00a0796732fd tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] <== connect_volume: return (2436ms) {'type': 'block', 'scsi_wwn': '23831323433383034', 'path': '/dev/sde'} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:34:43 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98961e9e-c592-4e35-ad53-00a0796732fd tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831323433383034', 'path': '/dev/sde'} {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 18:34:43 user nova-compute[72418]: DEBUG nova.objects.instance [None req-98961e9e-c592-4e35-ad53-00a0796732fd tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lazy-loading 'flavor' on Instance uuid 2c9e974b-b993-4f4e-9446-14941c39f109 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:34:44 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-98961e9e-c592-4e35-ad53-00a0796732fd tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 18:34:44 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:34:44 user nova-compute[72418]:   <source dev="/dev/sde"/>
Aug 09 18:34:44 user nova-compute[72418]:   <target dev="vdb" bus="virtio"/>
Aug 09 18:34:44 user nova-compute[72418]:   <serial>7247fc0c-7203-4491-9f2d-07256e221a76</serial>
Aug 09 18:34:44 user nova-compute[72418]: </disk>
Aug 09 18:34:44 user nova-compute[72418]:  {{(pid=72418) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 18:34:44 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:44 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:44 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:44 user nova-compute[72418]: DEBUG nova.compute.manager [req-7f0c91c3-02a8-4a95-ba78-3d4ed5adfa43 req-2368aae3-70cb-47a4-892a-a894682fdd03 service nova] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Received event network-vif-plugged-ea92909f-40d7-48a8-be09-50439674945c {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:34:44 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-7f0c91c3-02a8-4a95-ba78-3d4ed5adfa43 req-2368aae3-70cb-47a4-892a-a894682fdd03 service nova] Acquiring lock "03ad5bab-ab32-47fc-b7e8-b32282b9c20d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:34:44 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-7f0c91c3-02a8-4a95-ba78-3d4ed5adfa43 req-2368aae3-70cb-47a4-892a-a894682fdd03 service nova] Lock "03ad5bab-ab32-47fc-b7e8-b32282b9c20d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:34:44 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-7f0c91c3-02a8-4a95-ba78-3d4ed5adfa43 req-2368aae3-70cb-47a4-892a-a894682fdd03 service nova] Lock "03ad5bab-ab32-47fc-b7e8-b32282b9c20d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:34:44 user nova-compute[72418]: DEBUG nova.compute.manager [req-7f0c91c3-02a8-4a95-ba78-3d4ed5adfa43 req-2368aae3-70cb-47a4-892a-a894682fdd03 service nova] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] No waiting events found dispatching network-vif-plugged-ea92909f-40d7-48a8-be09-50439674945c {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:34:44 user nova-compute[72418]: WARNING nova.compute.manager [req-7f0c91c3-02a8-4a95-ba78-3d4ed5adfa43 req-2368aae3-70cb-47a4-892a-a894682fdd03 service nova] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Received unexpected event network-vif-plugged-ea92909f-40d7-48a8-be09-50439674945c for instance with vm_state active and task_state resize_finish.
Aug 09 18:34:44 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-98961e9e-c592-4e35-ad53-00a0796732fd tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:34:44 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-98961e9e-c592-4e35-ad53-00a0796732fd tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:34:44 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-98961e9e-c592-4e35-ad53-00a0796732fd tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] No VIF found with MAC fa:16:3e:06:d3:3a, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:34:44 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-98961e9e-c592-4e35-ad53-00a0796732fd tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "2c9e974b-b993-4f4e-9446-14941c39f109" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.854s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:34:44 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:44 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:44 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:44 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:46 user nova-compute[72418]: DEBUG nova.compute.manager [req-d6d5a783-a293-4a3c-b4da-dfb67cb71e7e req-383a1ed5-9d36-4127-9009-ee5f8d7105b0 service nova] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Received event network-vif-plugged-ea92909f-40d7-48a8-be09-50439674945c {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:34:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-d6d5a783-a293-4a3c-b4da-dfb67cb71e7e req-383a1ed5-9d36-4127-9009-ee5f8d7105b0 service nova] Acquiring lock "03ad5bab-ab32-47fc-b7e8-b32282b9c20d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:34:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-d6d5a783-a293-4a3c-b4da-dfb67cb71e7e req-383a1ed5-9d36-4127-9009-ee5f8d7105b0 service nova] Lock "03ad5bab-ab32-47fc-b7e8-b32282b9c20d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:34:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-d6d5a783-a293-4a3c-b4da-dfb67cb71e7e req-383a1ed5-9d36-4127-9009-ee5f8d7105b0 service nova] Lock "03ad5bab-ab32-47fc-b7e8-b32282b9c20d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:34:46 user nova-compute[72418]: DEBUG nova.compute.manager [req-d6d5a783-a293-4a3c-b4da-dfb67cb71e7e req-383a1ed5-9d36-4127-9009-ee5f8d7105b0 service nova] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] No waiting events found dispatching network-vif-plugged-ea92909f-40d7-48a8-be09-50439674945c {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:34:46 user nova-compute[72418]: WARNING nova.compute.manager [req-d6d5a783-a293-4a3c-b4da-dfb67cb71e7e req-383a1ed5-9d36-4127-9009-ee5f8d7105b0 service nova] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Received unexpected event network-vif-plugged-ea92909f-40d7-48a8-be09-50439674945c for instance with vm_state active and task_state resize_finish.
Aug 09 18:34:46 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691606086.7449498, 03ad5bab-ab32-47fc-b7e8-b32282b9c20d => Resumed> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:34:46 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] VM Resumed (Lifecycle Event)
Aug 09 18:34:46 user nova-compute[72418]: DEBUG nova.compute.manager [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Instance event wait completed in 0 seconds for  {{(pid=72418) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 18:34:46 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Instance running successfully.
Aug 09 18:34:46 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Failed to set time: agent not configured {{(pid=72418) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 09 18:34:46 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-ed506279-690d-4dcf-b9bb-1fac38ea1ce8 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] finish_migration finished successfully. {{(pid=72418) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 09 18:34:46 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:34:46 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:34:46 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 09 18:34:46 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691606086.748537, 03ad5bab-ab32-47fc-b7e8-b32282b9c20d => Started> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:34:46 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] VM Started (Lifecycle Event)
Aug 09 18:34:46 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:34:46 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:34:46 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 09 18:34:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ca1a480d-95af-4201-a7ef-2807b30cf4b3 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Acquiring lock "2c9e974b-b993-4f4e-9446-14941c39f109" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:34:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ca1a480d-95af-4201-a7ef-2807b30cf4b3 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "2c9e974b-b993-4f4e-9446-14941c39f109" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:34:47 user nova-compute[72418]: INFO nova.compute.manager [None req-ca1a480d-95af-4201-a7ef-2807b30cf4b3 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Detaching volume 7247fc0c-7203-4491-9f2d-07256e221a76
Aug 09 18:34:47 user nova-compute[72418]: INFO nova.virt.block_device [None req-ca1a480d-95af-4201-a7ef-2807b30cf4b3 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Attempting to driver detach volume 7247fc0c-7203-4491-9f2d-07256e221a76 from mountpoint /dev/vdb
Aug 09 18:34:47 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-ca1a480d-95af-4201-a7ef-2807b30cf4b3 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Attempting to detach device vdb from instance 2c9e974b-b993-4f4e-9446-14941c39f109 from the persistent domain config. {{(pid=72418) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 18:34:47 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-ca1a480d-95af-4201-a7ef-2807b30cf4b3 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 18:34:47 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:34:47 user nova-compute[72418]:   <source dev="/dev/sde"/>
Aug 09 18:34:47 user nova-compute[72418]:   <target dev="vdb" bus="virtio"/>
Aug 09 18:34:47 user nova-compute[72418]:   <serial>7247fc0c-7203-4491-9f2d-07256e221a76</serial>
Aug 09 18:34:47 user nova-compute[72418]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 18:34:47 user nova-compute[72418]: </disk>
Aug 09 18:34:47 user nova-compute[72418]:  {{(pid=72418) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 18:34:47 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-ca1a480d-95af-4201-a7ef-2807b30cf4b3 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Successfully detached device vdb from instance 2c9e974b-b993-4f4e-9446-14941c39f109 from the persistent domain config.
Aug 09 18:34:47 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-ca1a480d-95af-4201-a7ef-2807b30cf4b3 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2c9e974b-b993-4f4e-9446-14941c39f109 from the live domain config. {{(pid=72418) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 18:34:47 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-ca1a480d-95af-4201-a7ef-2807b30cf4b3 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 18:34:47 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:34:47 user nova-compute[72418]:   <source dev="/dev/sde"/>
Aug 09 18:34:47 user nova-compute[72418]:   <target dev="vdb" bus="virtio"/>
Aug 09 18:34:47 user nova-compute[72418]:   <serial>7247fc0c-7203-4491-9f2d-07256e221a76</serial>
Aug 09 18:34:47 user nova-compute[72418]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 18:34:47 user nova-compute[72418]: </disk>
Aug 09 18:34:47 user nova-compute[72418]:  {{(pid=72418) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 18:34:47 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:48 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:48 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Received event <DeviceRemovedEvent: 1691606088.1194553, 2c9e974b-b993-4f4e-9446-14941c39f109 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72418) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 18:34:48 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-ca1a480d-95af-4201-a7ef-2807b30cf4b3 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2c9e974b-b993-4f4e-9446-14941c39f109 {{(pid=72418) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 18:34:48 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-ca1a480d-95af-4201-a7ef-2807b30cf4b3 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Successfully detached device vdb from instance 2c9e974b-b993-4f4e-9446-14941c39f109 from the live domain config.
Aug 09 18:34:48 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca1a480d-95af-4201-a7ef-2807b30cf4b3 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] calling os-brick to detach iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 18:34:48 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1a480d-95af-4201-a7ef-2807b30cf4b3 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, {'target_iqns': ['iqn.2010-10.org.openstack:7247fc0c-7203-4491-9f2d-07256e221a76'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GAjfXOaB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:34:48 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-ca1a480d-95af-4201-a7ef-2807b30cf4b3 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:34:48 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-ca1a480d-95af-4201-a7ef-2807b30cf4b3 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:34:48 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-ca1a480d-95af-4201-a7ef-2807b30cf4b3 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:34:48 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1a480d-95af-4201-a7ef-2807b30cf4b3 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7247fc0c-7203-4491-9f2d-07256e221a76', 0)] {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 18:34:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:48 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8cdf8c-4d7a-4e71-865c-3a0762de358d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7247fc0c-7203-4491-9f2d-07256e221a76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:48 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[47afe84e-704b-4a8d-ab4d-e41e829d13b8]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7247fc0c-7203-4491-9f2d-07256e221a76 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:48 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1a480d-95af-4201-a7ef-2807b30cf4b3 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:34:48 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:34:48 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:34:48 user nova-compute[72418]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:34:48 user nova-compute[72418]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7247fc0c-7203-4491-9f2d-07256e221a76 (non-flash)
Aug 09 18:34:48 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:34:48 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1a480d-95af-4201-a7ef-2807b30cf4b3 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:34:48 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:34:48 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:34:48 user nova-compute[72418]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:34:48 user nova-compute[72418]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7247fc0c-7203-4491-9f2d-07256e221a76 (non-flash)
Aug 09 18:34:48 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:34:48 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1a480d-95af-4201-a7ef-2807b30cf4b3 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f42f8412200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7247fc0c-7203-4491-9f2d-07256e221a76'): ({'sde'}, set())}) {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 18:34:48 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-ca1a480d-95af-4201-a7ef-2807b30cf4b3 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Removing single pathed devices sde {{(pid=72418) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 18:34:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:48 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[292a4e62-d6c1-46ea-a052-5466ddbcb1b3]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:48 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb0a9ca-dea5-4bc5-989e-3f207cb6c7aa]: (4, ('ok\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:48 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-ca1a480d-95af-4201-a7ef-2807b30cf4b3 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Flushing IO for device /dev/sde {{(pid=72418) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 18:34:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:48 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[0890af28-3e84-4ce4-aca2-660d479e0f91]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:48 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-ca1a480d-95af-4201-a7ef-2807b30cf4b3 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72418) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 18:34:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:48 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75c6068-450e-4b47-a3e6-b756d7277658]: (4, ('1', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:48 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-ca1a480d-95af-4201-a7ef-2807b30cf4b3 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 18:34:48 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-ca1a480d-95af-4201-a7ef-2807b30cf4b3 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] SCSI volumes sde have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 18:34:48 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1a480d-95af-4201-a7ef-2807b30cf4b3 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7247fc0c-7203-4491-9f2d-07256e221a76')] {{(pid=72418) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 18:34:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7247fc0c-7203-4491-9f2d-07256e221a76 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7247fc0c-7203-4491-9f2d-07256e221a76 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:48 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce43104-baf7-4842-a241-fb7d5b78dfd9]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:48 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1a480d-95af-4201-a7ef-2807b30cf4b3 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:34:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7247fc0c-7203-4491-9f2d-07256e221a76 -p 172.16.0.220:3260 --logout {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7247fc0c-7203-4491-9f2d-07256e221a76 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:48 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67146cd-e2f6-4bec-bca1-299ad84f7b71]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:7247fc0c-7203-4491-9f2d-07256e221a76, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:7247fc0c-7203-4491-9f2d-07256e221a76, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:48 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1a480d-95af-4201-a7ef-2807b30cf4b3 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:7247fc0c-7203-4491-9f2d-07256e221a76, portal: 172.16.0.220,3260]
Aug 09 18:34:48 user nova-compute[72418]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:7247fc0c-7203-4491-9f2d-07256e221a76, portal: 172.16.0.220,3260] successful.
Aug 09 18:34:48 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:34:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7247fc0c-7203-4491-9f2d-07256e221a76 -p 172.16.0.220:3260 --op delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7247fc0c-7203-4491-9f2d-07256e221a76 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:48 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f18641-6582-42b8-b725-b2fac60c7543]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:34:48 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1a480d-95af-4201-a7ef-2807b30cf4b3 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:34:48 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-ca1a480d-95af-4201-a7ef-2807b30cf4b3 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:34:48 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1a480d-95af-4201-a7ef-2807b30cf4b3 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] <== disconnect_volume: return (280ms) None {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:34:48 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca1a480d-95af-4201-a7ef-2807b30cf4b3 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Disconnected iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 18:34:49 user nova-compute[72418]: DEBUG nova.objects.instance [None req-ca1a480d-95af-4201-a7ef-2807b30cf4b3 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lazy-loading 'flavor' on Instance uuid 2c9e974b-b993-4f4e-9446-14941c39f109 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:34:49 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ca1a480d-95af-4201-a7ef-2807b30cf4b3 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "2c9e974b-b993-4f4e-9446-14941c39f109" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.622s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:34:49 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:34:52 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:53 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:54 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:34:54 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:34:54 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:34:54 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:34:54 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72418) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 18:34:55 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-30443a19-846f-42cb-9d07-a2b67916e792 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Acquiring lock "e07beace-59d8-4c02-844b-1db1a6e81198" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:34:55 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-30443a19-846f-42cb-9d07-a2b67916e792 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "e07beace-59d8-4c02-844b-1db1a6e81198" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:34:55 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-30443a19-846f-42cb-9d07-a2b67916e792 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Acquiring lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:34:55 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-30443a19-846f-42cb-9d07-a2b67916e792 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:34:55 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-30443a19-846f-42cb-9d07-a2b67916e792 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:34:55 user nova-compute[72418]: INFO nova.compute.manager [None req-30443a19-846f-42cb-9d07-a2b67916e792 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Terminating instance
Aug 09 18:34:55 user nova-compute[72418]: DEBUG nova.compute.manager [None req-30443a19-846f-42cb-9d07-a2b67916e792 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Start destroying the instance on the hypervisor. {{(pid=72418) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 18:34:55 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:55 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:55 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:55 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:55 user nova-compute[72418]: DEBUG nova.compute.manager [req-a4b2c910-c05b-4f28-86c6-0426e50281bf req-a22d646a-690a-4b81-918e-694507bd6518 service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Received event network-vif-unplugged-301d9f8c-022d-4c02-90dd-374ead3daa23 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:34:55 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a4b2c910-c05b-4f28-86c6-0426e50281bf req-a22d646a-690a-4b81-918e-694507bd6518 service nova] Acquiring lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:34:55 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a4b2c910-c05b-4f28-86c6-0426e50281bf req-a22d646a-690a-4b81-918e-694507bd6518 service nova] Lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:34:55 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a4b2c910-c05b-4f28-86c6-0426e50281bf req-a22d646a-690a-4b81-918e-694507bd6518 service nova] Lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:34:55 user nova-compute[72418]: DEBUG nova.compute.manager [req-a4b2c910-c05b-4f28-86c6-0426e50281bf req-a22d646a-690a-4b81-918e-694507bd6518 service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] No waiting events found dispatching network-vif-unplugged-301d9f8c-022d-4c02-90dd-374ead3daa23 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:34:55 user nova-compute[72418]: DEBUG nova.compute.manager [req-a4b2c910-c05b-4f28-86c6-0426e50281bf req-a22d646a-690a-4b81-918e-694507bd6518 service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Received event network-vif-unplugged-301d9f8c-022d-4c02-90dd-374ead3daa23 for instance with task_state deleting. {{(pid=72418) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 18:34:56 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:56 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:56 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:56 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:56 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:56 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Instance destroyed successfully.
Aug 09 18:34:56 user nova-compute[72418]: DEBUG nova.objects.instance [None req-30443a19-846f-42cb-9d07-a2b67916e792 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lazy-loading 'resources' on Instance uuid e07beace-59d8-4c02-844b-1db1a6e81198 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:34:56 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-30443a19-846f-42cb-9d07-a2b67916e792 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:25:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-115156542',display_name='tempest-AttachVolumeTestJSON-server-115156542',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-115156542',id=16,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKIZ6czeitZd68FtX30D3PEurZKgjyFnUFrxFwHkysLhaffrzQKQu80qXZZAnkUayD+bRR0naGJJ9tbYqVXNcVqacPFRuWh7mU4dCbsXBHxDBemAgqD4XDp+3Jf6xUihXw==',key_name='tempest-keypair-957533556',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:25:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5242fb37f9664dbf9a8b50449f8dd129',ramdisk_id='',reservation_id='r-8u61z3zg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1480837700',owner_user_name='tempest-AttachVolumeTestJSON-1480837700-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:33:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='236307357ebf43bc8150f86f832260ba',uuid=e07beace-59d8-4c02-844b-1db1a6e81198,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "301d9f8c-022d-4c02-90dd-374ead3daa23", "address": "fa:16:3e:a6:38:d9", "network": {"id": "7621f03d-76ac-49da-89a8-0753bb11e329", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596253708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5242fb37f9664dbf9a8b50449f8dd129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap301d9f8c-02", "ovs_interfaceid": "301d9f8c-022d-4c02-90dd-374ead3daa23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 18:34:56 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-30443a19-846f-42cb-9d07-a2b67916e792 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Converting VIF {"id": "301d9f8c-022d-4c02-90dd-374ead3daa23", "address": "fa:16:3e:a6:38:d9", "network": {"id": "7621f03d-76ac-49da-89a8-0753bb11e329", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596253708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5242fb37f9664dbf9a8b50449f8dd129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap301d9f8c-02", "ovs_interfaceid": "301d9f8c-022d-4c02-90dd-374ead3daa23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:34:56 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-30443a19-846f-42cb-9d07-a2b67916e792 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:38:d9,bridge_name='br-int',has_traffic_filtering=True,id=301d9f8c-022d-4c02-90dd-374ead3daa23,network=Network(7621f03d-76ac-49da-89a8-0753bb11e329),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap301d9f8c-02') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:34:56 user nova-compute[72418]: DEBUG os_vif [None req-30443a19-846f-42cb-9d07-a2b67916e792 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:38:d9,bridge_name='br-int',has_traffic_filtering=True,id=301d9f8c-022d-4c02-90dd-374ead3daa23,network=Network(7621f03d-76ac-49da-89a8-0753bb11e329),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap301d9f8c-02') {{(pid=72418) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 18:34:56 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:56 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap301d9f8c-02, bridge=br-int, if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:34:56 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:56 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:34:56 user nova-compute[72418]: INFO os_vif [None req-30443a19-846f-42cb-9d07-a2b67916e792 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:38:d9,bridge_name='br-int',has_traffic_filtering=True,id=301d9f8c-022d-4c02-90dd-374ead3daa23,network=Network(7621f03d-76ac-49da-89a8-0753bb11e329),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap301d9f8c-02')
Aug 09 18:34:56 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-30443a19-846f-42cb-9d07-a2b67916e792 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Deleting instance files /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198_del
Aug 09 18:34:56 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-30443a19-846f-42cb-9d07-a2b67916e792 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Deletion of /opt/stack/data/nova/instances/e07beace-59d8-4c02-844b-1db1a6e81198_del complete
Aug 09 18:34:56 user nova-compute[72418]: INFO nova.compute.manager [None req-30443a19-846f-42cb-9d07-a2b67916e792 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Took 0.70 seconds to destroy the instance on the hypervisor.
Aug 09 18:34:56 user nova-compute[72418]: DEBUG oslo.service.loopingcall [None req-30443a19-846f-42cb-9d07-a2b67916e792 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72418) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 18:34:56 user nova-compute[72418]: DEBUG nova.compute.manager [-] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Deallocating network for instance {{(pid=72418) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 18:34:56 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] deallocate_for_instance() {{(pid=72418) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 18:34:56 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:56 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:56 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:56 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:56 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:56 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:56 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:56 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:56 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:34:57 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:34:57 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Took 1.18 seconds to deallocate network for instance.
Aug 09 18:34:57 user nova-compute[72418]: DEBUG nova.compute.manager [req-3fb022d1-9447-4462-a8c2-60b58181be1d req-81889bf0-50f9-49cc-a087-f2fb7e4fc4c0 service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Received event network-vif-deleted-301d9f8c-022d-4c02-90dd-374ead3daa23 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:34:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-30443a19-846f-42cb-9d07-a2b67916e792 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:34:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-30443a19-846f-42cb-9d07-a2b67916e792 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:34:57 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-30443a19-846f-42cb-9d07-a2b67916e792 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:34:57 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-30443a19-846f-42cb-9d07-a2b67916e792 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:34:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-30443a19-846f-42cb-9d07-a2b67916e792 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.364s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:34:57 user nova-compute[72418]: DEBUG nova.compute.manager [req-83588b08-d57d-435d-8b9e-4cf20b8b2a46 req-de4d7226-4eab-4152-895c-b7335e17835c service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Received event network-vif-plugged-301d9f8c-022d-4c02-90dd-374ead3daa23 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:34:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-83588b08-d57d-435d-8b9e-4cf20b8b2a46 req-de4d7226-4eab-4152-895c-b7335e17835c service nova] Acquiring lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:34:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-83588b08-d57d-435d-8b9e-4cf20b8b2a46 req-de4d7226-4eab-4152-895c-b7335e17835c service nova] Lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:34:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-83588b08-d57d-435d-8b9e-4cf20b8b2a46 req-de4d7226-4eab-4152-895c-b7335e17835c service nova] Lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:34:57 user nova-compute[72418]: DEBUG nova.compute.manager [req-83588b08-d57d-435d-8b9e-4cf20b8b2a46 req-de4d7226-4eab-4152-895c-b7335e17835c service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] No waiting events found dispatching network-vif-plugged-301d9f8c-022d-4c02-90dd-374ead3daa23 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:34:57 user nova-compute[72418]: WARNING nova.compute.manager [req-83588b08-d57d-435d-8b9e-4cf20b8b2a46 req-de4d7226-4eab-4152-895c-b7335e17835c service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Received unexpected event network-vif-plugged-301d9f8c-022d-4c02-90dd-374ead3daa23 for instance with vm_state deleted and task_state None.
Aug 09 18:34:57 user nova-compute[72418]: DEBUG nova.compute.manager [req-83588b08-d57d-435d-8b9e-4cf20b8b2a46 req-de4d7226-4eab-4152-895c-b7335e17835c service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Received event network-vif-plugged-301d9f8c-022d-4c02-90dd-374ead3daa23 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:34:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-83588b08-d57d-435d-8b9e-4cf20b8b2a46 req-de4d7226-4eab-4152-895c-b7335e17835c service nova] Acquiring lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:34:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-83588b08-d57d-435d-8b9e-4cf20b8b2a46 req-de4d7226-4eab-4152-895c-b7335e17835c service nova] Lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:34:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-83588b08-d57d-435d-8b9e-4cf20b8b2a46 req-de4d7226-4eab-4152-895c-b7335e17835c service nova] Lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:34:57 user nova-compute[72418]: DEBUG nova.compute.manager [req-83588b08-d57d-435d-8b9e-4cf20b8b2a46 req-de4d7226-4eab-4152-895c-b7335e17835c service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] No waiting events found dispatching network-vif-plugged-301d9f8c-022d-4c02-90dd-374ead3daa23 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:34:57 user nova-compute[72418]: WARNING nova.compute.manager [req-83588b08-d57d-435d-8b9e-4cf20b8b2a46 req-de4d7226-4eab-4152-895c-b7335e17835c service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Received unexpected event network-vif-plugged-301d9f8c-022d-4c02-90dd-374ead3daa23 for instance with vm_state deleted and task_state None.
Aug 09 18:34:57 user nova-compute[72418]: DEBUG nova.compute.manager [req-83588b08-d57d-435d-8b9e-4cf20b8b2a46 req-de4d7226-4eab-4152-895c-b7335e17835c service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Received event network-vif-plugged-301d9f8c-022d-4c02-90dd-374ead3daa23 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:34:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-83588b08-d57d-435d-8b9e-4cf20b8b2a46 req-de4d7226-4eab-4152-895c-b7335e17835c service nova] Acquiring lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:34:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-83588b08-d57d-435d-8b9e-4cf20b8b2a46 req-de4d7226-4eab-4152-895c-b7335e17835c service nova] Lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:34:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-83588b08-d57d-435d-8b9e-4cf20b8b2a46 req-de4d7226-4eab-4152-895c-b7335e17835c service nova] Lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:34:57 user nova-compute[72418]: DEBUG nova.compute.manager [req-83588b08-d57d-435d-8b9e-4cf20b8b2a46 req-de4d7226-4eab-4152-895c-b7335e17835c service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] No waiting events found dispatching network-vif-plugged-301d9f8c-022d-4c02-90dd-374ead3daa23 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:34:57 user nova-compute[72418]: WARNING nova.compute.manager [req-83588b08-d57d-435d-8b9e-4cf20b8b2a46 req-de4d7226-4eab-4152-895c-b7335e17835c service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Received unexpected event network-vif-plugged-301d9f8c-022d-4c02-90dd-374ead3daa23 for instance with vm_state deleted and task_state None.
Aug 09 18:34:57 user nova-compute[72418]: DEBUG nova.compute.manager [req-83588b08-d57d-435d-8b9e-4cf20b8b2a46 req-de4d7226-4eab-4152-895c-b7335e17835c service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Received event network-vif-unplugged-301d9f8c-022d-4c02-90dd-374ead3daa23 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:34:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-83588b08-d57d-435d-8b9e-4cf20b8b2a46 req-de4d7226-4eab-4152-895c-b7335e17835c service nova] Acquiring lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:34:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-83588b08-d57d-435d-8b9e-4cf20b8b2a46 req-de4d7226-4eab-4152-895c-b7335e17835c service nova] Lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:34:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-83588b08-d57d-435d-8b9e-4cf20b8b2a46 req-de4d7226-4eab-4152-895c-b7335e17835c service nova] Lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:34:57 user nova-compute[72418]: DEBUG nova.compute.manager [req-83588b08-d57d-435d-8b9e-4cf20b8b2a46 req-de4d7226-4eab-4152-895c-b7335e17835c service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] No waiting events found dispatching network-vif-unplugged-301d9f8c-022d-4c02-90dd-374ead3daa23 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:34:57 user nova-compute[72418]: WARNING nova.compute.manager [req-83588b08-d57d-435d-8b9e-4cf20b8b2a46 req-de4d7226-4eab-4152-895c-b7335e17835c service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Received unexpected event network-vif-unplugged-301d9f8c-022d-4c02-90dd-374ead3daa23 for instance with vm_state deleted and task_state None.
Aug 09 18:34:57 user nova-compute[72418]: DEBUG nova.compute.manager [req-83588b08-d57d-435d-8b9e-4cf20b8b2a46 req-de4d7226-4eab-4152-895c-b7335e17835c service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Received event network-vif-plugged-301d9f8c-022d-4c02-90dd-374ead3daa23 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:34:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-83588b08-d57d-435d-8b9e-4cf20b8b2a46 req-de4d7226-4eab-4152-895c-b7335e17835c service nova] Acquiring lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:34:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-83588b08-d57d-435d-8b9e-4cf20b8b2a46 req-de4d7226-4eab-4152-895c-b7335e17835c service nova] Lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:34:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-83588b08-d57d-435d-8b9e-4cf20b8b2a46 req-de4d7226-4eab-4152-895c-b7335e17835c service nova] Lock "e07beace-59d8-4c02-844b-1db1a6e81198-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:34:57 user nova-compute[72418]: DEBUG nova.compute.manager [req-83588b08-d57d-435d-8b9e-4cf20b8b2a46 req-de4d7226-4eab-4152-895c-b7335e17835c service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] No waiting events found dispatching network-vif-plugged-301d9f8c-022d-4c02-90dd-374ead3daa23 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:34:57 user nova-compute[72418]: WARNING nova.compute.manager [req-83588b08-d57d-435d-8b9e-4cf20b8b2a46 req-de4d7226-4eab-4152-895c-b7335e17835c service nova] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Received unexpected event network-vif-plugged-301d9f8c-022d-4c02-90dd-374ead3daa23 for instance with vm_state deleted and task_state None.
Aug 09 18:34:57 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:34:57 user nova-compute[72418]: INFO nova.scheduler.client.report [None req-30443a19-846f-42cb-9d07-a2b67916e792 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Deleted allocations for instance e07beace-59d8-4c02-844b-1db1a6e81198
Aug 09 18:34:58 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-30443a19-846f-42cb-9d07-a2b67916e792 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "e07beace-59d8-4c02-844b-1db1a6e81198" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.421s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:34:58 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:34:58 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:34:58 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Starting heal instance info cache {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 18:34:58 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Didn't find any instances for network info cache update. {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 18:34:58 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:34:58 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:34:58 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:34:58 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:34:58 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Auditing locally available compute resources for user (node: user) {{(pid=72418) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 18:34:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c53f871-2be9-4119-b5c0-d5081e2f4388/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c53f871-2be9-4119-b5c0-d5081e2f4388/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c53f871-2be9-4119-b5c0-d5081e2f4388/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c53f871-2be9-4119-b5c0-d5081e2f4388/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:59 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:34:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:34:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:34:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:35:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9e974b-b993-4f4e-9446-14941c39f109/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9e974b-b993-4f4e-9446-14941c39f109/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9e974b-b993-4f4e-9446-14941c39f109/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9e974b-b993-4f4e-9446-14941c39f109/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:01 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:35:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e582b61c-d998-4a3f-8392-a7f0e94a4dec/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e582b61c-d998-4a3f-8392-a7f0e94a4dec/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e582b61c-d998-4a3f-8392-a7f0e94a4dec/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e582b61c-d998-4a3f-8392-a7f0e94a4dec/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:02 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:35:02 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:35:02 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:35:02 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Hypervisor/Node resource view: name=user free_ram=7320MB free_disk=25.448211669921875GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72418) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 18:35:02 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:35:02 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:35:02 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Applying migration context for instance 03ad5bab-ab32-47fc-b7e8-b32282b9c20d as it has an incoming, in-progress migration 553b15ef-7e30-4e6b-b878-f0338d7a7d98. Migration status is finished {{(pid=72418) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 09 18:35:02 user nova-compute[72418]: INFO nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Updating resource usage from migration 553b15ef-7e30-4e6b-b878-f0338d7a7d98
Aug 09 18:35:02 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 6af7918a-ce90-45ab-93d8-684e1489e891 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:35:02 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 8fe41968-a219-4a5a-afdb-32eb2082bb40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:35:02 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 01c46b33-6788-44a5-a43c-88ee4acc4d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:35:02 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance e019064c-955e-4f80-9b00-6b32b3835d58 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:35:02 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance c46f2599-93f8-412e-9918-7ace8a9f19dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:35:02 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 1c53f871-2be9-4119-b5c0-d5081e2f4388 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:35:02 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance e582b61c-d998-4a3f-8392-a7f0e94a4dec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:35:02 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 2c9e974b-b993-4f4e-9446-14941c39f109 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:35:02 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance e24ebafb-73cb-42ea-a0b6-2263badd573f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:35:02 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:35:02 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Migration 553b15ef-7e30-4e6b-b878-f0338d7a7d98 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 09 18:35:02 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 03ad5bab-ab32-47fc-b7e8-b32282b9c20d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:35:02 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 18:35:02 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 18:35:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:03 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:35:03 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:35:03 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Compute_service record updated for user:user {{(pid=72418) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 18:35:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.496s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:35:06 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:08 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:11 user nova-compute[72418]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691606096.159008, e07beace-59d8-4c02-844b-1db1a6e81198 => Stopped> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:35:11 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] VM Stopped (Lifecycle Event)
Aug 09 18:35:11 user nova-compute[72418]: DEBUG nova.compute.manager [None req-72a07f36-f470-4ebf-b61c-8f376dbcd309 None None] [instance: e07beace-59d8-4c02-844b-1db1a6e81198] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:35:11 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:13 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:16 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:18 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:21 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:21 user nova-compute[72418]: INFO nova.compute.manager [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Rescuing
Aug 09 18:35:21 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquiring lock "refresh_cache-e24ebafb-73cb-42ea-a0b6-2263badd573f" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:35:21 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquired lock "refresh_cache-e24ebafb-73cb-42ea-a0b6-2263badd573f" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:35:21 user nova-compute[72418]: DEBUG nova.network.neutron [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:35:22 user nova-compute[72418]: DEBUG nova.network.neutron [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Updating instance_info_cache with network_info: [{"id": "af96e29f-e6ad-495f-9703-9597a81cb2ef", "address": "fa:16:3e:4f:13:a9", "network": {"id": "beaefb5c-f5e4-47e7-ab68-60131f532ade", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e5863cda54487682a4edcc24202c91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf96e29f-e6", "ovs_interfaceid": "af96e29f-e6ad-495f-9703-9597a81cb2ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:35:22 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Releasing lock "refresh_cache-e24ebafb-73cb-42ea-a0b6-2263badd573f" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:35:22 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:22 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:22 user nova-compute[72418]: DEBUG nova.compute.manager [req-5adc5d73-aa6a-4bde-bd30-1a5fe15a7703 req-1a40425f-114f-440b-8659-972351b2060f service nova] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Received event network-vif-unplugged-af96e29f-e6ad-495f-9703-9597a81cb2ef {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:35:22 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-5adc5d73-aa6a-4bde-bd30-1a5fe15a7703 req-1a40425f-114f-440b-8659-972351b2060f service nova] Acquiring lock "e24ebafb-73cb-42ea-a0b6-2263badd573f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:35:22 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-5adc5d73-aa6a-4bde-bd30-1a5fe15a7703 req-1a40425f-114f-440b-8659-972351b2060f service nova] Lock "e24ebafb-73cb-42ea-a0b6-2263badd573f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:35:22 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-5adc5d73-aa6a-4bde-bd30-1a5fe15a7703 req-1a40425f-114f-440b-8659-972351b2060f service nova] Lock "e24ebafb-73cb-42ea-a0b6-2263badd573f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:35:22 user nova-compute[72418]: DEBUG nova.compute.manager [req-5adc5d73-aa6a-4bde-bd30-1a5fe15a7703 req-1a40425f-114f-440b-8659-972351b2060f service nova] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] No waiting events found dispatching network-vif-unplugged-af96e29f-e6ad-495f-9703-9597a81cb2ef {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:35:22 user nova-compute[72418]: WARNING nova.compute.manager [req-5adc5d73-aa6a-4bde-bd30-1a5fe15a7703 req-1a40425f-114f-440b-8659-972351b2060f service nova] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Received unexpected event network-vif-unplugged-af96e29f-e6ad-495f-9703-9597a81cb2ef for instance with vm_state active and task_state rescuing.
Aug 09 18:35:22 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:22 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:23 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:23 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:23 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:23 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Instance destroyed successfully.
Aug 09 18:35:23 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Attempting a stable device rescue
Aug 09 18:35:23 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:23 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72418) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 09 18:35:23 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Instance directory exists: not creating {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 18:35:23 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Creating image(s)
Aug 09 18:35:23 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquiring lock "/opt/stack/data/nova/instances/e24ebafb-73cb-42ea-a0b6-2263badd573f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:35:23 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "/opt/stack/data/nova/instances/e24ebafb-73cb-42ea-a0b6-2263badd573f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:35:23 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "/opt/stack/data/nova/instances/e24ebafb-73cb-42ea-a0b6-2263badd573f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:35:23 user nova-compute[72418]: DEBUG nova.objects.instance [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lazy-loading 'trusted_certs' on Instance uuid e24ebafb-73cb-42ea-a0b6-2263badd573f {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:35:23 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquiring lock "fda1b1691ee2f3077953e7bd60791d57e29a1369" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:35:23 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "fda1b1691ee2f3077953e7bd60791d57e29a1369" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:35:23 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:24 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fda1b1691ee2f3077953e7bd60791d57e29a1369.part --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:24 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:24 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fda1b1691ee2f3077953e7bd60791d57e29a1369.part --force-share --output=json" returned: 0 in 0.155s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:24 user nova-compute[72418]: DEBUG nova.virt.images [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] 61c59b57-cb1f-4ca4-8bc4-b964ddc07575 was qcow2, converting to raw {{(pid=72418) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 18:35:24 user nova-compute[72418]: DEBUG nova.privsep.utils [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72418) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 18:35:24 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fda1b1691ee2f3077953e7bd60791d57e29a1369.part /opt/stack/data/nova/instances/_base/fda1b1691ee2f3077953e7bd60791d57e29a1369.converted {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:24 user nova-compute[72418]: DEBUG nova.compute.manager [req-cace1c54-d929-4f48-89d1-193f435aa6e2 req-016126de-d8b0-4d58-9c06-7f3a1d542847 service nova] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Received event network-vif-plugged-af96e29f-e6ad-495f-9703-9597a81cb2ef {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:35:24 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-cace1c54-d929-4f48-89d1-193f435aa6e2 req-016126de-d8b0-4d58-9c06-7f3a1d542847 service nova] Acquiring lock "e24ebafb-73cb-42ea-a0b6-2263badd573f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:35:24 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-cace1c54-d929-4f48-89d1-193f435aa6e2 req-016126de-d8b0-4d58-9c06-7f3a1d542847 service nova] Lock "e24ebafb-73cb-42ea-a0b6-2263badd573f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:35:24 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-cace1c54-d929-4f48-89d1-193f435aa6e2 req-016126de-d8b0-4d58-9c06-7f3a1d542847 service nova] Lock "e24ebafb-73cb-42ea-a0b6-2263badd573f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:35:24 user nova-compute[72418]: DEBUG nova.compute.manager [req-cace1c54-d929-4f48-89d1-193f435aa6e2 req-016126de-d8b0-4d58-9c06-7f3a1d542847 service nova] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] No waiting events found dispatching network-vif-plugged-af96e29f-e6ad-495f-9703-9597a81cb2ef {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:35:24 user nova-compute[72418]: WARNING nova.compute.manager [req-cace1c54-d929-4f48-89d1-193f435aa6e2 req-016126de-d8b0-4d58-9c06-7f3a1d542847 service nova] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Received unexpected event network-vif-plugged-af96e29f-e6ad-495f-9703-9597a81cb2ef for instance with vm_state active and task_state rescuing.
Aug 09 18:35:24 user nova-compute[72418]: DEBUG nova.compute.manager [req-cace1c54-d929-4f48-89d1-193f435aa6e2 req-016126de-d8b0-4d58-9c06-7f3a1d542847 service nova] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Received event network-vif-plugged-af96e29f-e6ad-495f-9703-9597a81cb2ef {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:35:24 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-cace1c54-d929-4f48-89d1-193f435aa6e2 req-016126de-d8b0-4d58-9c06-7f3a1d542847 service nova] Acquiring lock "e24ebafb-73cb-42ea-a0b6-2263badd573f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:35:24 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-cace1c54-d929-4f48-89d1-193f435aa6e2 req-016126de-d8b0-4d58-9c06-7f3a1d542847 service nova] Lock "e24ebafb-73cb-42ea-a0b6-2263badd573f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:35:24 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-cace1c54-d929-4f48-89d1-193f435aa6e2 req-016126de-d8b0-4d58-9c06-7f3a1d542847 service nova] Lock "e24ebafb-73cb-42ea-a0b6-2263badd573f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:35:24 user nova-compute[72418]: DEBUG nova.compute.manager [req-cace1c54-d929-4f48-89d1-193f435aa6e2 req-016126de-d8b0-4d58-9c06-7f3a1d542847 service nova] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] No waiting events found dispatching network-vif-plugged-af96e29f-e6ad-495f-9703-9597a81cb2ef {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:35:24 user nova-compute[72418]: WARNING nova.compute.manager [req-cace1c54-d929-4f48-89d1-193f435aa6e2 req-016126de-d8b0-4d58-9c06-7f3a1d542847 service nova] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Received unexpected event network-vif-plugged-af96e29f-e6ad-495f-9703-9597a81cb2ef for instance with vm_state active and task_state rescuing.
Aug 09 18:35:24 user nova-compute[72418]: DEBUG nova.compute.manager [req-cace1c54-d929-4f48-89d1-193f435aa6e2 req-016126de-d8b0-4d58-9c06-7f3a1d542847 service nova] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Received event network-vif-plugged-af96e29f-e6ad-495f-9703-9597a81cb2ef {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:35:24 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-cace1c54-d929-4f48-89d1-193f435aa6e2 req-016126de-d8b0-4d58-9c06-7f3a1d542847 service nova] Acquiring lock "e24ebafb-73cb-42ea-a0b6-2263badd573f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:35:24 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-cace1c54-d929-4f48-89d1-193f435aa6e2 req-016126de-d8b0-4d58-9c06-7f3a1d542847 service nova] Lock "e24ebafb-73cb-42ea-a0b6-2263badd573f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:35:24 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-cace1c54-d929-4f48-89d1-193f435aa6e2 req-016126de-d8b0-4d58-9c06-7f3a1d542847 service nova] Lock "e24ebafb-73cb-42ea-a0b6-2263badd573f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:35:24 user nova-compute[72418]: DEBUG nova.compute.manager [req-cace1c54-d929-4f48-89d1-193f435aa6e2 req-016126de-d8b0-4d58-9c06-7f3a1d542847 service nova] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] No waiting events found dispatching network-vif-plugged-af96e29f-e6ad-495f-9703-9597a81cb2ef {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:35:24 user nova-compute[72418]: WARNING nova.compute.manager [req-cace1c54-d929-4f48-89d1-193f435aa6e2 req-016126de-d8b0-4d58-9c06-7f3a1d542847 service nova] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Received unexpected event network-vif-plugged-af96e29f-e6ad-495f-9703-9597a81cb2ef for instance with vm_state active and task_state rescuing.
Aug 09 18:35:24 user nova-compute[72418]: DEBUG nova.compute.manager [req-cace1c54-d929-4f48-89d1-193f435aa6e2 req-016126de-d8b0-4d58-9c06-7f3a1d542847 service nova] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Received event network-vif-unplugged-af96e29f-e6ad-495f-9703-9597a81cb2ef {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:35:24 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-cace1c54-d929-4f48-89d1-193f435aa6e2 req-016126de-d8b0-4d58-9c06-7f3a1d542847 service nova] Acquiring lock "e24ebafb-73cb-42ea-a0b6-2263badd573f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:35:24 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-cace1c54-d929-4f48-89d1-193f435aa6e2 req-016126de-d8b0-4d58-9c06-7f3a1d542847 service nova] Lock "e24ebafb-73cb-42ea-a0b6-2263badd573f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:35:24 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-cace1c54-d929-4f48-89d1-193f435aa6e2 req-016126de-d8b0-4d58-9c06-7f3a1d542847 service nova] Lock "e24ebafb-73cb-42ea-a0b6-2263badd573f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:35:24 user nova-compute[72418]: DEBUG nova.compute.manager [req-cace1c54-d929-4f48-89d1-193f435aa6e2 req-016126de-d8b0-4d58-9c06-7f3a1d542847 service nova] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] No waiting events found dispatching network-vif-unplugged-af96e29f-e6ad-495f-9703-9597a81cb2ef {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:35:24 user nova-compute[72418]: WARNING nova.compute.manager [req-cace1c54-d929-4f48-89d1-193f435aa6e2 req-016126de-d8b0-4d58-9c06-7f3a1d542847 service nova] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Received unexpected event network-vif-unplugged-af96e29f-e6ad-495f-9703-9597a81cb2ef for instance with vm_state active and task_state rescuing.
Aug 09 18:35:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fda1b1691ee2f3077953e7bd60791d57e29a1369.part /opt/stack/data/nova/instances/_base/fda1b1691ee2f3077953e7bd60791d57e29a1369.converted" returned: 0 in 0.642s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fda1b1691ee2f3077953e7bd60791d57e29a1369.converted --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fda1b1691ee2f3077953e7bd60791d57e29a1369.converted --force-share --output=json" returned: 0 in 0.154s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "fda1b1691ee2f3077953e7bd60791d57e29a1369" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.154s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquiring lock "fda1b1691ee2f3077953e7bd60791d57e29a1369" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "fda1b1691ee2f3077953e7bd60791d57e29a1369" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fda1b1691ee2f3077953e7bd60791d57e29a1369 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fda1b1691ee2f3077953e7bd60791d57e29a1369 --force-share --output=json" returned: 0 in 0.146s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fda1b1691ee2f3077953e7bd60791d57e29a1369,backing_fmt=raw /opt/stack/data/nova/instances/e24ebafb-73cb-42ea-a0b6-2263badd573f/disk.rescue {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fda1b1691ee2f3077953e7bd60791d57e29a1369,backing_fmt=raw /opt/stack/data/nova/instances/e24ebafb-73cb-42ea-a0b6-2263badd573f/disk.rescue" returned: 0 in 0.057s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "fda1b1691ee2f3077953e7bd60791d57e29a1369" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.211s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG nova.objects.instance [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lazy-loading 'migration_context' on Instance uuid e24ebafb-73cb-42ea-a0b6-2263badd573f {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Created local disks {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Start _get_guest_xml network_info=[{"id": "af96e29f-e6ad-495f-9703-9597a81cb2ef", "address": "fa:16:3e:4f:13:a9", "network": {"id": "beaefb5c-f5e4-47e7-ab68-60131f532ade", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "vif_mac": "fa:16:3e:4f:13:a9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e5863cda54487682a4edcc24202c91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf96e29f-e6", "ovs_interfaceid": "af96e29f-e6ad-495f-9703-9597a81cb2ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '61c59b57-cb1f-4ca4-8bc4-b964ddc07575', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'e6c732cc-4840-4276-9cec-7b508389820f', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ifyFsaxh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': 'e24ebafb-73cb-42ea-a0b6-2263badd573f', 'attached_at': '', 'detached_at': '', 'volume_id': 'dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40', 'serial': 'dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG nova.objects.instance [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lazy-loading 'resources' on Instance uuid e24ebafb-73cb-42ea-a0b6-2263badd573f {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG nova.objects.instance [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lazy-loading 'numa_topology' on Instance uuid e24ebafb-73cb-42ea-a0b6-2263badd573f {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:35:25 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:35:25 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:35:25 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] CPU controller missing on host. {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] CPU controller found on host. {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72418) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T18:17:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Flavor limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Image limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Flavor pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Image pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Got 1 possible topologies {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG nova.objects.instance [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lazy-loading 'vcpu_model' on Instance uuid e24ebafb-73cb-42ea-a0b6-2263badd573f {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Calling os-brick to attach iSCSI Volume {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ifyFsaxh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:35:25 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:35:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:35:25 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:35:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:35:25 user nova-compute[72418]: INFO os_brick.initiator.connectors.iscsi [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 18:35:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 -p 172.16.0.220:3260 {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00c28f3-c6c5-40c2-8520-533ed3a6cb66]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = ifyFsaxh\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 09 18:35:25 user nova-compute[72418]: node.name = iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40
Aug 09 18:35:25 user nova-compute[72418]: node.tpgt = -1
Aug 09 18:35:25 user nova-compute[72418]: node.startup = automatic
Aug 09 18:35:25 user nova-compute[72418]: node.leading_login = No
Aug 09 18:35:25 user nova-compute[72418]: iface.iscsi_ifacename = default
Aug 09 18:35:25 user nova-compute[72418]: iface.net_ifacename = <empty>
Aug 09 18:35:25 user nova-compute[72418]: iface.ipaddress = <empty>
Aug 09 18:35:25 user nova-compute[72418]: iface.prefix_len = 0
Aug 09 18:35:25 user nova-compute[72418]: iface.hwaddress = <empty>
Aug 09 18:35:25 user nova-compute[72418]: iface.transport_name = tcp
Aug 09 18:35:25 user nova-compute[72418]: iface.initiatorname = <empty>
Aug 09 18:35:25 user nova-compute[72418]: iface.state = <empty>
Aug 09 18:35:25 user nova-compute[72418]: iface.vlan_id = 0
Aug 09 18:35:25 user nova-compute[72418]: iface.vlan_priority = 0
Aug 09 18:35:25 user nova-compute[72418]: iface.vlan_state = <empty>
Aug 09 18:35:25 user nova-compute[72418]: iface.iface_num = 0
Aug 09 18:35:25 user nova-compute[72418]: iface.mtu = 0
Aug 09 18:35:25 user nova-compute[72418]: iface.port = 0
Aug 09 18:35:25 user nova-compute[72418]: iface.bootproto = <empty>
Aug 09 18:35:25 user nova-compute[72418]: iface.subnet_mask = <empty>
Aug 09 18:35:25 user nova-compute[72418]: iface.gateway = <empty>
Aug 09 18:35:25 user nova-compute[72418]: iface.dhcp_alt_client_id_state = <empty>
Aug 09 18:35:25 user nova-compute[72418]: iface.dhcp_alt_client_id = <empty>
Aug 09 18:35:25 user nova-compute[72418]: iface.dhcp_dns = <empty>
Aug 09 18:35:25 user nova-compute[72418]: iface.dhcp_learn_iqn = <empty>
Aug 09 18:35:25 user nova-compute[72418]: iface.dhcp_req_vendor_id_state = <empty>
Aug 09 18:35:25 user nova-compute[72418]: iface.dhcp_vendor_id_state = <empty>
Aug 09 18:35:25 user nova-compute[72418]: iface.dhcp_vendor_id = <empty>
Aug 09 18:35:25 user nova-compute[72418]: iface.dhcp_slp_da = <empty>
Aug 09 18:35:25 user nova-compute[72418]: iface.fragmentation = <empty>
Aug 09 18:35:25 user nova-compute[72418]: iface.gratuitous_arp = <empty>
Aug 09 18:35:25 user nova-compute[72418]: iface.incoming_forwarding = <empty>
Aug 09 18:35:25 user nova-compute[72418]: iface.tos_state = <empty>
Aug 09 18:35:25 user nova-compute[72418]: iface.tos = 0
Aug 09 18:35:25 user nova-compute[72418]: iface.ttl = 0
Aug 09 18:35:25 user nova-compute[72418]: iface.delayed_ack = <empty>
Aug 09 18:35:25 user nova-compute[72418]: iface.tcp_nagle = <empty>
Aug 09 18:35:25 user nova-compute[72418]: iface.tcp_wsf_state = <empty>
Aug 09 18:35:25 user nova-compute[72418]: iface.tcp_wsf = 0
Aug 09 18:35:25 user nova-compute[72418]: iface.tcp_timer_scale = 0
Aug 09 18:35:25 user nova-compute[72418]: iface.tcp_timestamp = <empty>
Aug 09 18:35:25 user nova-compute[72418]: iface.redirect = <empty>
Aug 09 18:35:25 user nova-compute[72418]: iface.def_task_mgmt_timeout = 0
Aug 09 18:35:25 user nova-compute[72418]: iface.header_digest = <empty>
Aug 09 18:35:25 user nova-compute[72418]: iface.data_digest = <empty>
Aug 09 18:35:25 user nova-compute[72418]: iface.immediate_data = <empty>
Aug 09 18:35:25 user nova-compute[72418]: iface.initial_r2t = <empty>
Aug 09 18:35:25 user nova-compute[72418]: iface.data_seq_inorder = <empty>
Aug 09 18:35:25 user nova-compute[72418]: iface.data_pdu_inorder = <empty>
Aug 09 18:35:25 user nova-compute[72418]: iface.erl = 0
Aug 09 18:35:25 user nova-compute[72418]: iface.max_receive_data_len = 0
Aug 09 18:35:25 user nova-compute[72418]: iface.first_burst_len = 0
Aug 09 18:35:25 user nova-compute[72418]: iface.max_outstanding_r2t = 0
Aug 09 18:35:25 user nova-compute[72418]: iface.max_burst_len = 0
Aug 09 18:35:25 user nova-compute[72418]: iface.chap_auth = <empty>
Aug 09 18:35:25 user nova-compute[72418]: iface.bidi_chap = <empty>
Aug 09 18:35:25 user nova-compute[72418]: iface.strict_login_compliance = <empty>
Aug 09 18:35:25 user nova-compute[72418]: iface.discovery_auth = <empty>
Aug 09 18:35:25 user nova-compute[72418]: iface.discovery_logout = <empty>
Aug 09 18:35:25 user nova-compute[72418]: node.discovery_address = <empty>
Aug 09 18:35:25 user nova-compute[72418]: node.discovery_port = 0
Aug 09 18:35:25 user nova-compute[72418]: node.discovery_type = static
Aug 09 18:35:25 user nova-compute[72418]: node.session.initial_cmdsn = 0
Aug 09 18:35:25 user nova-compute[72418]: node.session.initial_login_retry_max = 8
Aug 09 18:35:25 user nova-compute[72418]: node.session.xmit_thread_priority = -20
Aug 09 18:35:25 user nova-compute[72418]: node.session.cmds_max = 128
Aug 09 18:35:25 user nova-compute[72418]: node.session.queue_depth = 32
Aug 09 18:35:25 user nova-compute[72418]: node.session.nr_sessions = 1
Aug 09 18:35:25 user nova-compute[72418]: node.session.auth.authmethod = CHAP
Aug 09 18:35:25 user nova-compute[72418]: node.session.auth.username = ifyFsaxh
Aug 09 18:35:25 user nova-compute[72418]: node.session.auth.password = ***
Aug 09 18:35:25 user nova-compute[72418]: node.session.auth.username_in = <empty>
Aug 09 18:35:25 user nova-compute[72418]: node.session.auth.password_in = <empty>
Aug 09 18:35:25 user nova-compute[72418]: node.session.auth.chap_algs = MD5
Aug 09 18:35:25 user nova-compute[72418]: node.session.timeo.replacement_timeout = 120
Aug 09 18:35:25 user nova-compute[72418]: node.session.err_timeo.abort_timeout = 15
Aug 09 18:35:25 user nova-compute[72418]: node.session.err_timeo.lu_reset_timeout = 30
Aug 09 18:35:25 user nova-compute[72418]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 09 18:35:25 user nova-compute[72418]: node.session.err_timeo.host_reset_timeout = 60
Aug 09 18:35:25 user nova-compute[72418]: node.session.iscsi.FastAbort = Yes
Aug 09 18:35:25 user nova-compute[72418]: node.session.iscsi.InitialR2T = No
Aug 09 18:35:25 user nova-compute[72418]: node.session.iscsi.ImmediateData = Yes
Aug 09 18:35:25 user nova-compute[72418]: node.session.iscsi.FirstBurstLength = 262144
Aug 09 18:35:25 user nova-compute[72418]: node.session.iscsi.MaxBurstLength = 16776192
Aug 09 18:35:25 user nova-compute[72418]: node.session.iscsi.DefaultTime2Retain = 0
Aug 09 18:35:25 user nova-compute[72418]: node.session.iscsi.DefaultTime2Wait = 2
Aug 09 18:35:25 user nova-compute[72418]: node.session.iscsi.MaxConnections = 1
Aug 09 18:35:25 user nova-compute[72418]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 09 18:35:25 user nova-compute[72418]: node.session.iscsi.ERL = 0
Aug 09 18:35:25 user nova-compute[72418]: node.session.scan = manual
Aug 09 18:35:25 user nova-compute[72418]: node.session.reopen_max = 0
Aug 09 18:35:25 user nova-compute[72418]: node.conn[0].address = 172.16.0.220
Aug 09 18:35:25 user nova-compute[72418]: node.conn[0].port = 3260
Aug 09 18:35:25 user nova-compute[72418]: node.conn[0].startup = manual
Aug 09 18:35:25 user nova-compute[72418]: node.conn[0].tcp.window_size = 524288
Aug 09 18:35:25 user nova-compute[72418]: node.conn[0].tcp.type_of_service = 0
Aug 09 18:35:25 user nova-compute[72418]: node.conn[0].timeo.logout_timeout = 15
Aug 09 18:35:25 user nova-compute[72418]: node.conn[0].timeo.login_timeout = 15
Aug 09 18:35:25 user nova-compute[72418]: node.conn[0].timeo.auth_timeout = 45
Aug 09 18:35:25 user nova-compute[72418]: node.conn[0].timeo.noop_out_interval = 5
Aug 09 18:35:25 user nova-compute[72418]: node.conn[0].timeo.noop_out_timeout = 5
Aug 09 18:35:25 user nova-compute[72418]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 09 18:35:25 user nova-compute[72418]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 09 18:35:25 user nova-compute[72418]: node.conn[0].iscsi.HeaderDigest = None
Aug 09 18:35:25 user nova-compute[72418]: node.conn[0].iscsi.DataDigest = None
Aug 09 18:35:25 user nova-compute[72418]: node.conn[0].iscsi.IFMarker = No
Aug 09 18:35:25 user nova-compute[72418]: node.conn[0].iscsi.OFMarker = No
Aug 09 18:35:25 user nova-compute[72418]: # END RECORD
Aug 09 18:35:25 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[375dd439-2fc1-4ec4-b196-8d901d8ba67d]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[f568f1bc-52b5-4718-afaa-583f0c4afc7a]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ifyFsaxh {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ifyFsaxh" returned: 0 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[743965e9-c7e4-420f-a88b-c45202a2112d]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ifyFsaxh'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[decbc94c-b3fb-4d6a-a669-ea90c73b3fa0]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e44a79-194b-4e18-a9f0-517564f3238e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:35:25 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:35:25 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:35:25 user nova-compute[72418]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:35:25 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:35:25 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:35:25 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:35:25 user nova-compute[72418]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:35:25 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.155s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Connected to 172.16.0.220:3260 {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] HCTL ('39', '0', '0', 0) found on session 29 with lun 0 {{(pid=72418) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Scanning host 39 c: 0, t: 0, l: 0) {{(pid=72418) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.014s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40695d5-7b24-458a-a290-349ea376a966]: (4, ('0 0 0', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Searching for a device in session 29 and hctl ('39', '0', '0', 0) yield: sdh {{(pid=72418) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ifyFsaxh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.181s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] <== connect_volume: return (183ms) {'type': 'block', 'scsi_wwn': '23965376634613234', 'path': '/dev/sdh'} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965376634613234', 'path': '/dev/sdh'} {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:33:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-469140945',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-469140945',id=27,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:34:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52e5863cda54487682a4edcc24202c91',ramdisk_id='',reservation_id='r-u0b4huj8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1120385592',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:34:15Z,user_data=None,user_id='621fd2b971c543d197a354c38e0d1867',uuid=e24ebafb-73cb-42ea-a0b6-2263badd573f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af96e29f-e6ad-495f-9703-9597a81cb2ef", "address": "fa:16:3e:4f:13:a9", "network": {"id": "beaefb5c-f5e4-47e7-ab68-60131f532ade", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "vif_mac": "fa:16:3e:4f:13:a9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e5863cda54487682a4edcc24202c91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf96e29f-e6", "ovs_interfaceid": "af96e29f-e6ad-495f-9703-9597a81cb2ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Converting VIF {"id": "af96e29f-e6ad-495f-9703-9597a81cb2ef", "address": "fa:16:3e:4f:13:a9", "network": {"id": "beaefb5c-f5e4-47e7-ab68-60131f532ade", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "vif_mac": "fa:16:3e:4f:13:a9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e5863cda54487682a4edcc24202c91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf96e29f-e6", "ovs_interfaceid": "af96e29f-e6ad-495f-9703-9597a81cb2ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:13:a9,bridge_name='br-int',has_traffic_filtering=True,id=af96e29f-e6ad-495f-9703-9597a81cb2ef,network=Network(beaefb5c-f5e4-47e7-ab68-60131f532ade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf96e29f-e6') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG nova.objects.instance [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lazy-loading 'pci_devices' on Instance uuid e24ebafb-73cb-42ea-a0b6-2263badd573f {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:35:25 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] End _get_guest_xml xml=<domain type="kvm">
Aug 09 18:35:25 user nova-compute[72418]:   <uuid>e24ebafb-73cb-42ea-a0b6-2263badd573f</uuid>
Aug 09 18:35:25 user nova-compute[72418]:   <name>instance-0000001b</name>
Aug 09 18:35:25 user nova-compute[72418]:   <memory>524288</memory>
Aug 09 18:35:25 user nova-compute[72418]:   <vcpu>1</vcpu>
Aug 09 18:35:25 user nova-compute[72418]:   <metadata>
Aug 09 18:35:25 user nova-compute[72418]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:35:25 user nova-compute[72418]:       <nova:package version="0.0.0"/>
Aug 09 18:35:25 user nova-compute[72418]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-469140945</nova:name>
Aug 09 18:35:25 user nova-compute[72418]:       <nova:creationTime>2023-08-09 18:35:25</nova:creationTime>
Aug 09 18:35:25 user nova-compute[72418]:       <nova:flavor name="m1.tiny">
Aug 09 18:35:25 user nova-compute[72418]:         <nova:memory>512</nova:memory>
Aug 09 18:35:25 user nova-compute[72418]:         <nova:disk>1</nova:disk>
Aug 09 18:35:25 user nova-compute[72418]:         <nova:swap>0</nova:swap>
Aug 09 18:35:25 user nova-compute[72418]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:35:25 user nova-compute[72418]:         <nova:vcpus>1</nova:vcpus>
Aug 09 18:35:25 user nova-compute[72418]:       </nova:flavor>
Aug 09 18:35:25 user nova-compute[72418]:       <nova:owner>
Aug 09 18:35:25 user nova-compute[72418]:         <nova:user uuid="621fd2b971c543d197a354c38e0d1867">tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member</nova:user>
Aug 09 18:35:25 user nova-compute[72418]:         <nova:project uuid="52e5863cda54487682a4edcc24202c91">tempest-ServerBootFromVolumeStableRescueTest-1120385592</nova:project>
Aug 09 18:35:25 user nova-compute[72418]:       </nova:owner>
Aug 09 18:35:25 user nova-compute[72418]:       <nova:root type="image" uuid="8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e"/>
Aug 09 18:35:25 user nova-compute[72418]:       <nova:ports>
Aug 09 18:35:25 user nova-compute[72418]:         <nova:port uuid="af96e29f-e6ad-495f-9703-9597a81cb2ef">
Aug 09 18:35:25 user nova-compute[72418]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 09 18:35:25 user nova-compute[72418]:         </nova:port>
Aug 09 18:35:25 user nova-compute[72418]:       </nova:ports>
Aug 09 18:35:25 user nova-compute[72418]:     </nova:instance>
Aug 09 18:35:25 user nova-compute[72418]:   </metadata>
Aug 09 18:35:25 user nova-compute[72418]:   <sysinfo type="smbios">
Aug 09 18:35:25 user nova-compute[72418]:     <system>
Aug 09 18:35:25 user nova-compute[72418]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 18:35:25 user nova-compute[72418]:       <entry name="product">OpenStack Nova</entry>
Aug 09 18:35:25 user nova-compute[72418]:       <entry name="version">0.0.0</entry>
Aug 09 18:35:25 user nova-compute[72418]:       <entry name="serial">e24ebafb-73cb-42ea-a0b6-2263badd573f</entry>
Aug 09 18:35:25 user nova-compute[72418]:       <entry name="uuid">e24ebafb-73cb-42ea-a0b6-2263badd573f</entry>
Aug 09 18:35:25 user nova-compute[72418]:       <entry name="family">Virtual Machine</entry>
Aug 09 18:35:25 user nova-compute[72418]:     </system>
Aug 09 18:35:25 user nova-compute[72418]:   </sysinfo>
Aug 09 18:35:25 user nova-compute[72418]:   <os>
Aug 09 18:35:25 user nova-compute[72418]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 18:35:25 user nova-compute[72418]:     <smbios mode="sysinfo"/>
Aug 09 18:35:25 user nova-compute[72418]:   </os>
Aug 09 18:35:25 user nova-compute[72418]:   <features>
Aug 09 18:35:25 user nova-compute[72418]:     <acpi/>
Aug 09 18:35:25 user nova-compute[72418]:     <apic/>
Aug 09 18:35:25 user nova-compute[72418]:     <vmcoreinfo/>
Aug 09 18:35:25 user nova-compute[72418]:   </features>
Aug 09 18:35:25 user nova-compute[72418]:   <clock offset="utc">
Aug 09 18:35:25 user nova-compute[72418]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 18:35:25 user nova-compute[72418]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 18:35:25 user nova-compute[72418]:     <timer name="hpet" present="no"/>
Aug 09 18:35:25 user nova-compute[72418]:   </clock>
Aug 09 18:35:25 user nova-compute[72418]:   <cpu mode="custom" match="exact">
Aug 09 18:35:25 user nova-compute[72418]:     <model>Nehalem</model>
Aug 09 18:35:25 user nova-compute[72418]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 18:35:25 user nova-compute[72418]:   </cpu>
Aug 09 18:35:25 user nova-compute[72418]:   <devices>
Aug 09 18:35:25 user nova-compute[72418]:     <disk type="block" device="disk">
Aug 09 18:35:25 user nova-compute[72418]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:35:25 user nova-compute[72418]:       <source dev="/dev/sdh"/>
Aug 09 18:35:25 user nova-compute[72418]:       <target dev="vda" bus="virtio"/>
Aug 09 18:35:25 user nova-compute[72418]:       <serial>dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40</serial>
Aug 09 18:35:25 user nova-compute[72418]:     </disk>
Aug 09 18:35:25 user nova-compute[72418]:     <disk type="file" device="disk">
Aug 09 18:35:25 user nova-compute[72418]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 18:35:25 user nova-compute[72418]:       <source file="/opt/stack/data/nova/instances/e24ebafb-73cb-42ea-a0b6-2263badd573f/disk.rescue"/>
Aug 09 18:35:25 user nova-compute[72418]:       <target dev="vdb" bus="virtio"/>
Aug 09 18:35:25 user nova-compute[72418]:       <boot order="1"/>
Aug 09 18:35:25 user nova-compute[72418]:     </disk>
Aug 09 18:35:25 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:35:25 user nova-compute[72418]:       <mac address="fa:16:3e:4f:13:a9"/>
Aug 09 18:35:25 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:35:25 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:35:25 user nova-compute[72418]:       <target dev="tapaf96e29f-e6"/>
Aug 09 18:35:25 user nova-compute[72418]:     </interface>
Aug 09 18:35:25 user nova-compute[72418]:     <serial type="pty">
Aug 09 18:35:25 user nova-compute[72418]:       <log file="/opt/stack/data/nova/instances/e24ebafb-73cb-42ea-a0b6-2263badd573f/console.log" append="off"/>
Aug 09 18:35:25 user nova-compute[72418]:     </serial>
Aug 09 18:35:25 user nova-compute[72418]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 18:35:25 user nova-compute[72418]:     <video>
Aug 09 18:35:25 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:35:25 user nova-compute[72418]:     </video>
Aug 09 18:35:25 user nova-compute[72418]:     <rng model="virtio">
Aug 09 18:35:25 user nova-compute[72418]:       <backend model="random">/dev/urandom</backend>
Aug 09 18:35:25 user nova-compute[72418]:     </rng>
Aug 09 18:35:25 user nova-compute[72418]:     <controller type="usb" index="0" model="none"/>
Aug 09 18:35:25 user nova-compute[72418]:     <memballoon model="virtio">
Aug 09 18:35:25 user nova-compute[72418]:       <stats period="10"/>
Aug 09 18:35:25 user nova-compute[72418]:     </memballoon>
Aug 09 18:35:25 user nova-compute[72418]:   </devices>
Aug 09 18:35:25 user nova-compute[72418]: </domain>
Aug 09 18:35:25 user nova-compute[72418]:  {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 18:35:26 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Instance destroyed successfully.
Aug 09 18:35:26 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:35:26 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:35:26 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] No VIF found with MAC fa:16:3e:4f:13:a9, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:35:26 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:26 user nova-compute[72418]: DEBUG nova.compute.manager [req-8649d336-5dfc-48ac-80a4-34b0173f7f82 req-f4cd3b8b-248c-47d4-83f9-a52e3aadaef4 service nova] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Received event network-vif-plugged-af96e29f-e6ad-495f-9703-9597a81cb2ef {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:35:26 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-8649d336-5dfc-48ac-80a4-34b0173f7f82 req-f4cd3b8b-248c-47d4-83f9-a52e3aadaef4 service nova] Acquiring lock "e24ebafb-73cb-42ea-a0b6-2263badd573f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:35:26 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-8649d336-5dfc-48ac-80a4-34b0173f7f82 req-f4cd3b8b-248c-47d4-83f9-a52e3aadaef4 service nova] Lock "e24ebafb-73cb-42ea-a0b6-2263badd573f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:35:26 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-8649d336-5dfc-48ac-80a4-34b0173f7f82 req-f4cd3b8b-248c-47d4-83f9-a52e3aadaef4 service nova] Lock "e24ebafb-73cb-42ea-a0b6-2263badd573f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:35:26 user nova-compute[72418]: DEBUG nova.compute.manager [req-8649d336-5dfc-48ac-80a4-34b0173f7f82 req-f4cd3b8b-248c-47d4-83f9-a52e3aadaef4 service nova] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] No waiting events found dispatching network-vif-plugged-af96e29f-e6ad-495f-9703-9597a81cb2ef {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:35:26 user nova-compute[72418]: WARNING nova.compute.manager [req-8649d336-5dfc-48ac-80a4-34b0173f7f82 req-f4cd3b8b-248c-47d4-83f9-a52e3aadaef4 service nova] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Received unexpected event network-vif-plugged-af96e29f-e6ad-495f-9703-9597a81cb2ef for instance with vm_state active and task_state rescuing.
Aug 09 18:35:27 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:27 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:27 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:27 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:27 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:27 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:28 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:28 user nova-compute[72418]: DEBUG nova.compute.manager [req-a3e69754-b8fa-4db3-bc36-92b041be2fdc req-7ccd76cc-9db7-4d66-b14f-91f2d4d6811a service nova] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Received event network-vif-plugged-af96e29f-e6ad-495f-9703-9597a81cb2ef {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:35:28 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a3e69754-b8fa-4db3-bc36-92b041be2fdc req-7ccd76cc-9db7-4d66-b14f-91f2d4d6811a service nova] Acquiring lock "e24ebafb-73cb-42ea-a0b6-2263badd573f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:35:28 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a3e69754-b8fa-4db3-bc36-92b041be2fdc req-7ccd76cc-9db7-4d66-b14f-91f2d4d6811a service nova] Lock "e24ebafb-73cb-42ea-a0b6-2263badd573f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:35:28 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a3e69754-b8fa-4db3-bc36-92b041be2fdc req-7ccd76cc-9db7-4d66-b14f-91f2d4d6811a service nova] Lock "e24ebafb-73cb-42ea-a0b6-2263badd573f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:35:28 user nova-compute[72418]: DEBUG nova.compute.manager [req-a3e69754-b8fa-4db3-bc36-92b041be2fdc req-7ccd76cc-9db7-4d66-b14f-91f2d4d6811a service nova] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] No waiting events found dispatching network-vif-plugged-af96e29f-e6ad-495f-9703-9597a81cb2ef {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:35:28 user nova-compute[72418]: WARNING nova.compute.manager [req-a3e69754-b8fa-4db3-bc36-92b041be2fdc req-7ccd76cc-9db7-4d66-b14f-91f2d4d6811a service nova] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Received unexpected event network-vif-plugged-af96e29f-e6ad-495f-9703-9597a81cb2ef for instance with vm_state active and task_state rescuing.
Aug 09 18:35:28 user nova-compute[72418]: DEBUG nova.compute.manager [req-a3e69754-b8fa-4db3-bc36-92b041be2fdc req-7ccd76cc-9db7-4d66-b14f-91f2d4d6811a service nova] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Received event network-vif-plugged-af96e29f-e6ad-495f-9703-9597a81cb2ef {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:35:28 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a3e69754-b8fa-4db3-bc36-92b041be2fdc req-7ccd76cc-9db7-4d66-b14f-91f2d4d6811a service nova] Acquiring lock "e24ebafb-73cb-42ea-a0b6-2263badd573f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:35:28 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a3e69754-b8fa-4db3-bc36-92b041be2fdc req-7ccd76cc-9db7-4d66-b14f-91f2d4d6811a service nova] Lock "e24ebafb-73cb-42ea-a0b6-2263badd573f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:35:28 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a3e69754-b8fa-4db3-bc36-92b041be2fdc req-7ccd76cc-9db7-4d66-b14f-91f2d4d6811a service nova] Lock "e24ebafb-73cb-42ea-a0b6-2263badd573f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:35:28 user nova-compute[72418]: DEBUG nova.compute.manager [req-a3e69754-b8fa-4db3-bc36-92b041be2fdc req-7ccd76cc-9db7-4d66-b14f-91f2d4d6811a service nova] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] No waiting events found dispatching network-vif-plugged-af96e29f-e6ad-495f-9703-9597a81cb2ef {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:35:28 user nova-compute[72418]: WARNING nova.compute.manager [req-a3e69754-b8fa-4db3-bc36-92b041be2fdc req-7ccd76cc-9db7-4d66-b14f-91f2d4d6811a service nova] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Received unexpected event network-vif-plugged-af96e29f-e6ad-495f-9703-9597a81cb2ef for instance with vm_state active and task_state rescuing.
Aug 09 18:35:29 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Acquiring lock "0659fd5c-cb05-441e-94b6-9d05f7135893" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:35:29 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "0659fd5c-cb05-441e-94b6-9d05f7135893" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:35:29 user nova-compute[72418]: DEBUG nova.compute.manager [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Starting instance... {{(pid=72418) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 18:35:29 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:35:29 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:35:29 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72418) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 18:35:29 user nova-compute[72418]: INFO nova.compute.claims [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Claim successful on node user
Aug 09 18:35:29 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Removed pending event for e24ebafb-73cb-42ea-a0b6-2263badd573f due to event {{(pid=72418) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 18:35:29 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691606129.806444, e24ebafb-73cb-42ea-a0b6-2263badd573f => Resumed> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:35:29 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] VM Resumed (Lifecycle Event)
Aug 09 18:35:29 user nova-compute[72418]: DEBUG nova.compute.manager [None req-3a0a3629-e1c3-4265-8103-3bd1015693c9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:35:29 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:35:29 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:35:29 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:35:29 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 09 18:35:29 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691606129.8095045, e24ebafb-73cb-42ea-a0b6-2263badd573f => Started> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:35:29 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] VM Started (Lifecycle Event)
Aug 09 18:35:29 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:35:29 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:35:29 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:35:29 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.439s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:35:29 user nova-compute[72418]: DEBUG nova.compute.manager [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Start building networks asynchronously for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 18:35:29 user nova-compute[72418]: DEBUG nova.compute.manager [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Allocating IP information in the background. {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 18:35:29 user nova-compute[72418]: DEBUG nova.network.neutron [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] allocate_for_instance() {{(pid=72418) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 18:35:29 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 18:35:30 user nova-compute[72418]: DEBUG nova.compute.manager [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Start building block device mappings for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 18:35:30 user nova-compute[72418]: INFO nova.virt.block_device [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Booting with volume e52e5369-5c8f-4793-a8fc-9df310f4572b at /dev/vda
Aug 09 18:35:30 user nova-compute[72418]: DEBUG nova.policy [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'edc9ed6980274b978caf0666a9b31379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b6e36a5b61456092ce7de9212c3c82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72418) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 18:35:30 user nova-compute[72418]: DEBUG os_brick.utils [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:35:30 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:30 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:30 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[adecf9c7-8b56-4064-86c7-4ae05181d1f2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ad56b243ad71\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:35:30 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:30 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:30 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[de03663d-093f-4ae5-b6b2-7ddaeae0351a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:35:30 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:30 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:30 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a813ec-bc2f-47a4-aed3-733ba49d73f4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:35:30 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[def94b09-9e04-4c6f-841e-99f26793570b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:35:30 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Running cmd (subprocess): nvme version {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:30 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] 'nvme version' failed. Not Retrying. {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:35:30 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] nvme not present on system {{(pid=72418) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 18:35:30 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:30 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:35:30 user nova-compute[72418]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 18:35:30 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d6c098-bb39-4938-9a85-85a2ee53d17a]: (4, '') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:35:30 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72418) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 18:35:30 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 18:35:30 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] LIGHTOS: no hostnqn found. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 18:35:30 user nova-compute[72418]: DEBUG os_brick.utils [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ad56b243ad71', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:35:30 user nova-compute[72418]: DEBUG nova.virt.block_device [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Updating existing volume attachment record: 8405d2ca-150b-4eb4-98ae-32567a41b298 {{(pid=72418) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 18:35:30 user nova-compute[72418]: DEBUG nova.network.neutron [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Successfully created port: 0cd6232b-ea64-4978-bc0e-0e84995fd9a4 {{(pid=72418) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 18:35:31 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:31 user nova-compute[72418]: DEBUG nova.network.neutron [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Successfully updated port: 0cd6232b-ea64-4978-bc0e-0e84995fd9a4 {{(pid=72418) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 18:35:31 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Acquiring lock "refresh_cache-0659fd5c-cb05-441e-94b6-9d05f7135893" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:35:31 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Acquired lock "refresh_cache-0659fd5c-cb05-441e-94b6-9d05f7135893" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:35:31 user nova-compute[72418]: DEBUG nova.network.neutron [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:35:31 user nova-compute[72418]: DEBUG nova.compute.manager [req-b45f6f14-c94c-4226-b76f-cdd0263fb523 req-2c4c2bcc-7bc2-40f6-8bdc-be00ace46701 service nova] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Received event network-changed-0cd6232b-ea64-4978-bc0e-0e84995fd9a4 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:35:31 user nova-compute[72418]: DEBUG nova.compute.manager [req-b45f6f14-c94c-4226-b76f-cdd0263fb523 req-2c4c2bcc-7bc2-40f6-8bdc-be00ace46701 service nova] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Refreshing instance network info cache due to event network-changed-0cd6232b-ea64-4978-bc0e-0e84995fd9a4. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:35:31 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-b45f6f14-c94c-4226-b76f-cdd0263fb523 req-2c4c2bcc-7bc2-40f6-8bdc-be00ace46701 service nova] Acquiring lock "refresh_cache-0659fd5c-cb05-441e-94b6-9d05f7135893" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:35:31 user nova-compute[72418]: DEBUG nova.network.neutron [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Instance cache missing network info. {{(pid=72418) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 18:35:32 user nova-compute[72418]: DEBUG nova.network.neutron [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Updating instance_info_cache with network_info: [{"id": "0cd6232b-ea64-4978-bc0e-0e84995fd9a4", "address": "fa:16:3e:65:a1:d2", "network": {"id": "bd36ef30-e57d-473f-97bc-c51b5db08aa7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-425133239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78b6e36a5b61456092ce7de9212c3c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd6232b-ea", "ovs_interfaceid": "0cd6232b-ea64-4978-bc0e-0e84995fd9a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:35:32 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Releasing lock "refresh_cache-0659fd5c-cb05-441e-94b6-9d05f7135893" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:35:32 user nova-compute[72418]: DEBUG nova.compute.manager [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Instance network_info: |[{"id": "0cd6232b-ea64-4978-bc0e-0e84995fd9a4", "address": "fa:16:3e:65:a1:d2", "network": {"id": "bd36ef30-e57d-473f-97bc-c51b5db08aa7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-425133239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78b6e36a5b61456092ce7de9212c3c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd6232b-ea", "ovs_interfaceid": "0cd6232b-ea64-4978-bc0e-0e84995fd9a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 18:35:32 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-b45f6f14-c94c-4226-b76f-cdd0263fb523 req-2c4c2bcc-7bc2-40f6-8bdc-be00ace46701 service nova] Acquired lock "refresh_cache-0659fd5c-cb05-441e-94b6-9d05f7135893" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:35:32 user nova-compute[72418]: DEBUG nova.network.neutron [req-b45f6f14-c94c-4226-b76f-cdd0263fb523 req-2c4c2bcc-7bc2-40f6-8bdc-be00ace46701 service nova] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Refreshing network info cache for port 0cd6232b-ea64-4978-bc0e-0e84995fd9a4 {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:35:32 user nova-compute[72418]: DEBUG nova.network.neutron [req-b45f6f14-c94c-4226-b76f-cdd0263fb523 req-2c4c2bcc-7bc2-40f6-8bdc-be00ace46701 service nova] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Updated VIF entry in instance network info cache for port 0cd6232b-ea64-4978-bc0e-0e84995fd9a4. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:35:32 user nova-compute[72418]: DEBUG nova.network.neutron [req-b45f6f14-c94c-4226-b76f-cdd0263fb523 req-2c4c2bcc-7bc2-40f6-8bdc-be00ace46701 service nova] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Updating instance_info_cache with network_info: [{"id": "0cd6232b-ea64-4978-bc0e-0e84995fd9a4", "address": "fa:16:3e:65:a1:d2", "network": {"id": "bd36ef30-e57d-473f-97bc-c51b5db08aa7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-425133239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78b6e36a5b61456092ce7de9212c3c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd6232b-ea", "ovs_interfaceid": "0cd6232b-ea64-4978-bc0e-0e84995fd9a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:35:32 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-b45f6f14-c94c-4226-b76f-cdd0263fb523 req-2c4c2bcc-7bc2-40f6-8bdc-be00ace46701 service nova] Releasing lock "refresh_cache-0659fd5c-cb05-441e-94b6-9d05f7135893" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:35:35 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:36 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:37 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:38 user nova-compute[72418]: DEBUG nova.compute.manager [req-e69f6614-a9a5-4a54-a1b6-ead2f16bd397 req-9431c74b-617a-47a3-9c9d-7d3aa66fb2af service nova] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Received event network-changed-6a5e7c25-876c-403d-b3d3-9859c970030d {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:35:38 user nova-compute[72418]: DEBUG nova.compute.manager [req-e69f6614-a9a5-4a54-a1b6-ead2f16bd397 req-9431c74b-617a-47a3-9c9d-7d3aa66fb2af service nova] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Refreshing instance network info cache due to event network-changed-6a5e7c25-876c-403d-b3d3-9859c970030d. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:35:38 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-e69f6614-a9a5-4a54-a1b6-ead2f16bd397 req-9431c74b-617a-47a3-9c9d-7d3aa66fb2af service nova] Acquiring lock "refresh_cache-4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:35:38 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-e69f6614-a9a5-4a54-a1b6-ead2f16bd397 req-9431c74b-617a-47a3-9c9d-7d3aa66fb2af service nova] Acquired lock "refresh_cache-4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:35:38 user nova-compute[72418]: DEBUG nova.network.neutron [req-e69f6614-a9a5-4a54-a1b6-ead2f16bd397 req-9431c74b-617a-47a3-9c9d-7d3aa66fb2af service nova] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Refreshing network info cache for port 6a5e7c25-876c-403d-b3d3-9859c970030d {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:35:39 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-019162b1-a388-4716-87fa-0cecb245b2f5 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Acquiring lock "4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:35:39 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-019162b1-a388-4716-87fa-0cecb245b2f5 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:35:39 user nova-compute[72418]: DEBUG nova.objects.instance [None req-019162b1-a388-4716-87fa-0cecb245b2f5 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lazy-loading 'flavor' on Instance uuid 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:35:39 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-019162b1-a388-4716-87fa-0cecb245b2f5 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Ignoring supplied device name: /dev/vdb
Aug 09 18:35:39 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-019162b1-a388-4716-87fa-0cecb245b2f5 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.162s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:35:39 user nova-compute[72418]: DEBUG nova.network.neutron [req-e69f6614-a9a5-4a54-a1b6-ead2f16bd397 req-9431c74b-617a-47a3-9c9d-7d3aa66fb2af service nova] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Updated VIF entry in instance network info cache for port 6a5e7c25-876c-403d-b3d3-9859c970030d. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:35:39 user nova-compute[72418]: DEBUG nova.network.neutron [req-e69f6614-a9a5-4a54-a1b6-ead2f16bd397 req-9431c74b-617a-47a3-9c9d-7d3aa66fb2af service nova] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Updating instance_info_cache with network_info: [{"id": "6a5e7c25-876c-403d-b3d3-9859c970030d", "address": "fa:16:3e:b0:f3:60", "network": {"id": "34f771ea-9846-4f27-94a0-c00494d053ab", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-973491744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eee663228cbc483896e4fd409c4aa135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a5e7c25-87", "ovs_interfaceid": "6a5e7c25-876c-403d-b3d3-9859c970030d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:35:39 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-e69f6614-a9a5-4a54-a1b6-ead2f16bd397 req-9431c74b-617a-47a3-9c9d-7d3aa66fb2af service nova] Releasing lock "refresh_cache-4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:35:39 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-019162b1-a388-4716-87fa-0cecb245b2f5 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Acquiring lock "4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:35:39 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-019162b1-a388-4716-87fa-0cecb245b2f5 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:35:39 user nova-compute[72418]: INFO nova.compute.manager [None req-019162b1-a388-4716-87fa-0cecb245b2f5 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Attaching volume 7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6 to /dev/vdb
Aug 09 18:35:39 user nova-compute[72418]: DEBUG os_brick.utils [None req-019162b1-a388-4716-87fa-0cecb245b2f5 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:35:39 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:39 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:39 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c10f6f9-2431-43b5-bda9-bdeaf434735b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ad56b243ad71\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:35:39 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:39 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:39 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c2b47f-521e-47f3-bd15-36d32d2a6510]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:35:39 user nova-compute[72418]: DEBUG nova.compute.manager [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Start spawning the instance on the hypervisor. {{(pid=72418) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 18:35:39 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Creating instance directory {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 18:35:39 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Creating image(s)
Aug 09 18:35:39 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Did not create local disks {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 18:35:39 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Ensure instance console log exists: /opt/stack/data/nova/instances/0659fd5c-cb05-441e-94b6-9d05f7135893/console.log {{(pid=72418) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Start _get_guest_xml network_info=[{"id": "0cd6232b-ea64-4978-bc0e-0e84995fd9a4", "address": "fa:16:3e:65:a1:d2", "network": {"id": "bd36ef30-e57d-473f-97bc-c51b5db08aa7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-425133239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78b6e36a5b61456092ce7de9212c3c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd6232b-ea", "ovs_interfaceid": "0cd6232b-ea64-4978-bc0e-0e84995fd9a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '8405d2ca-150b-4eb4-98ae-32567a41b298', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jgrEVDUS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0659fd5c-cb05-441e-94b6-9d05f7135893', 'attached_at': '', 'detached_at': '', 'volume_id': 'e52e5369-5c8f-4793-a8fc-9df310f4572b', 'serial': 'e52e5369-5c8f-4793-a8fc-9df310f4572b'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9777bd-4fed-440a-a9d4-a3a8eeec751a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[18626c62-94d5-47f5-8c5f-196681cbfac4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-019162b1-a388-4716-87fa-0cecb245b2f5 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Running cmd (subprocess): nvme version {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-019162b1-a388-4716-87fa-0cecb245b2f5 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] 'nvme version' failed. Not Retrying. {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.nvmeof [None req-019162b1-a388-4716-87fa-0cecb245b2f5 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] nvme not present on system {{(pid=72418) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:40 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:35:40 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:35:40 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] CPU controller missing on host. {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:35:40 user nova-compute[72418]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 18:35:40 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[deeacfb0-ec58-4fb7-aa7e-0721f5e5e5d6]: (4, '') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-019162b1-a388-4716-87fa-0cecb245b2f5 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72418) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-019162b1-a388-4716-87fa-0cecb245b2f5 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-019162b1-a388-4716-87fa-0cecb245b2f5 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] LIGHTOS: no hostnqn found. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG os_brick.utils [None req-019162b1-a388-4716-87fa-0cecb245b2f5 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] <== get_connector_properties: return (175ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ad56b243ad71', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG nova.virt.block_device [None req-019162b1-a388-4716-87fa-0cecb245b2f5 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Updating existing volume attachment record: 0a426aa9-6a57-47bd-a2e5-902d86fc13cb {{(pid=72418) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] CPU controller found on host. {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72418) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T18:17:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Flavor limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Image limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Flavor pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Image pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Got 1 possible topologies {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Calling os-brick to attach iSCSI Volume {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jgrEVDUS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:35:40 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:35:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:35:40 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:35:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:35:40 user nova-compute[72418]: INFO os_brick.initiator.connectors.iscsi [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 18:35:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b -p 172.16.0.220:3260 {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b -p 172.16.0.220:3260" returned: 21 in 0.031s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ad3618-8bdc-4516-98e3-dc4ca61b8131]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 18:35:40 user nova-compute[72418]:  {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b -p 172.16.0.220:3260 --interface default --op new {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcdb1ec4-dde7-4aa5-8381-9263a02aab00]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b] added\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b] added
Aug 09 18:35:40 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.041s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[8695ded1-f638-48c7-a367-2fb8670ad48f]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[922db6f7-5846-46c6-a868-d3b14a002059]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jgrEVDUS {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jgrEVDUS" returned: 0 in 0.026s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68a3c70-3b0f-44a3-ad0c-a45476433cd3]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jgrEVDUS'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed17ffb-a3af-4a25-a31b-bd7e045f26bf]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[2afa442b-1263-41e7-86e5-49100b626658]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:35:40 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:35:40 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:35:40 user nova-compute[72418]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:35:40 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:35:40 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:35:40 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:35:40 user nova-compute[72418]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:35:40 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b -p 172.16.0.220:3260 --login {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c01b840-393e-41c4-adcf-53e6d3cb4f24]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b, portal: 172.16.0.220,3260]
Aug 09 18:35:40 user nova-compute[72418]: Login to [iface: default, target: iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b, portal: 172.16.0.220,3260] successful.
Aug 09 18:35:40 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0cc6bc7-1b37-4ca4-bbf6-60bf38fbf4c1]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3672a34-458b-4d73-8c30-78305c38e05a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:35:40 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:35:40 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:35:40 user nova-compute[72418]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:35:40 user nova-compute[72418]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)
Aug 09 18:35:40 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:35:40 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:35:40 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:35:40 user nova-compute[72418]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:35:40 user nova-compute[72418]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)
Aug 09 18:35:40 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.459s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Connected to 172.16.0.220:3260 {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] HCTL ('36', '-', '-', 0) found on session 32 with lun 0 {{(pid=72418) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72418) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd16f95-fc94-4b50-a09f-ffa20df7771f]: (4, ('- - 0', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72418) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 18:35:40 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jgrEVDUS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 18:35:41 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:41 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:41 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.500s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:35:41 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] <== connect_volume: return (1501ms) {'type': 'block', 'scsi_wwn': '26164306633663066', 'path': '/dev/sde'} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:35:41 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164306633663066', 'path': '/dev/sde'} {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 18:35:41 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:35:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-935482357',display_name='tempest-ServerActionsTestOtherA-server-935482357',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-935482357',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZ8H8MvJhas/vPLXexc9KvUsV16Uhsl6uYTaDGrZC9aE3rBb3x7zoV+NqPR5zKzOIkCqtgn8ZVvU3tdtAtEAYrB/yDbEIXvY0hEVuVM8ww17BzMc60Vtn0IN61LmfWZ8Q==',key_name='tempest-keypair-882054128',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='78b6e36a5b61456092ce7de9212c3c82',ramdisk_id='',reservation_id='r-kxlskkmt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1039384122',owner_user_name='tempest-ServerActionsTestOtherA-1039384122-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:35:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='edc9ed6980274b978caf0666a9b31379',uuid=0659fd5c-cb05-441e-94b6-9d05f7135893,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0cd6232b-ea64-4978-bc0e-0e84995fd9a4", "address": "fa:16:3e:65:a1:d2", "network": {"id": "bd36ef30-e57d-473f-97bc-c51b5db08aa7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-425133239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78b6e36a5b61456092ce7de9212c3c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd6232b-ea", "ovs_interfaceid": "0cd6232b-ea64-4978-bc0e-0e84995fd9a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:35:41 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Converting VIF {"id": "0cd6232b-ea64-4978-bc0e-0e84995fd9a4", "address": "fa:16:3e:65:a1:d2", "network": {"id": "bd36ef30-e57d-473f-97bc-c51b5db08aa7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-425133239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78b6e36a5b61456092ce7de9212c3c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd6232b-ea", "ovs_interfaceid": "0cd6232b-ea64-4978-bc0e-0e84995fd9a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:35:41 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:a1:d2,bridge_name='br-int',has_traffic_filtering=True,id=0cd6232b-ea64-4978-bc0e-0e84995fd9a4,network=Network(bd36ef30-e57d-473f-97bc-c51b5db08aa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cd6232b-ea') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:35:41 user nova-compute[72418]: DEBUG nova.objects.instance [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lazy-loading 'pci_devices' on Instance uuid 0659fd5c-cb05-441e-94b6-9d05f7135893 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:35:41 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] End _get_guest_xml xml=<domain type="kvm">
Aug 09 18:35:41 user nova-compute[72418]:   <uuid>0659fd5c-cb05-441e-94b6-9d05f7135893</uuid>
Aug 09 18:35:41 user nova-compute[72418]:   <name>instance-0000001d</name>
Aug 09 18:35:41 user nova-compute[72418]:   <memory>524288</memory>
Aug 09 18:35:41 user nova-compute[72418]:   <vcpu>1</vcpu>
Aug 09 18:35:41 user nova-compute[72418]:   <metadata>
Aug 09 18:35:41 user nova-compute[72418]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:35:41 user nova-compute[72418]:       <nova:package version="0.0.0"/>
Aug 09 18:35:41 user nova-compute[72418]:       <nova:name>tempest-ServerActionsTestOtherA-server-935482357</nova:name>
Aug 09 18:35:41 user nova-compute[72418]:       <nova:creationTime>2023-08-09 18:35:40</nova:creationTime>
Aug 09 18:35:41 user nova-compute[72418]:       <nova:flavor name="m1.tiny">
Aug 09 18:35:41 user nova-compute[72418]:         <nova:memory>512</nova:memory>
Aug 09 18:35:41 user nova-compute[72418]:         <nova:disk>1</nova:disk>
Aug 09 18:35:41 user nova-compute[72418]:         <nova:swap>0</nova:swap>
Aug 09 18:35:41 user nova-compute[72418]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:35:41 user nova-compute[72418]:         <nova:vcpus>1</nova:vcpus>
Aug 09 18:35:41 user nova-compute[72418]:       </nova:flavor>
Aug 09 18:35:41 user nova-compute[72418]:       <nova:owner>
Aug 09 18:35:41 user nova-compute[72418]:         <nova:user uuid="edc9ed6980274b978caf0666a9b31379">tempest-ServerActionsTestOtherA-1039384122-project-member</nova:user>
Aug 09 18:35:41 user nova-compute[72418]:         <nova:project uuid="78b6e36a5b61456092ce7de9212c3c82">tempest-ServerActionsTestOtherA-1039384122</nova:project>
Aug 09 18:35:41 user nova-compute[72418]:       </nova:owner>
Aug 09 18:35:41 user nova-compute[72418]:       <nova:ports>
Aug 09 18:35:41 user nova-compute[72418]:         <nova:port uuid="0cd6232b-ea64-4978-bc0e-0e84995fd9a4">
Aug 09 18:35:41 user nova-compute[72418]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 09 18:35:41 user nova-compute[72418]:         </nova:port>
Aug 09 18:35:41 user nova-compute[72418]:       </nova:ports>
Aug 09 18:35:41 user nova-compute[72418]:     </nova:instance>
Aug 09 18:35:41 user nova-compute[72418]:   </metadata>
Aug 09 18:35:41 user nova-compute[72418]:   <sysinfo type="smbios">
Aug 09 18:35:41 user nova-compute[72418]:     <system>
Aug 09 18:35:41 user nova-compute[72418]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 18:35:41 user nova-compute[72418]:       <entry name="product">OpenStack Nova</entry>
Aug 09 18:35:41 user nova-compute[72418]:       <entry name="version">0.0.0</entry>
Aug 09 18:35:41 user nova-compute[72418]:       <entry name="serial">0659fd5c-cb05-441e-94b6-9d05f7135893</entry>
Aug 09 18:35:41 user nova-compute[72418]:       <entry name="uuid">0659fd5c-cb05-441e-94b6-9d05f7135893</entry>
Aug 09 18:35:41 user nova-compute[72418]:       <entry name="family">Virtual Machine</entry>
Aug 09 18:35:41 user nova-compute[72418]:     </system>
Aug 09 18:35:41 user nova-compute[72418]:   </sysinfo>
Aug 09 18:35:41 user nova-compute[72418]:   <os>
Aug 09 18:35:41 user nova-compute[72418]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 18:35:41 user nova-compute[72418]:     <boot dev="hd"/>
Aug 09 18:35:41 user nova-compute[72418]:     <smbios mode="sysinfo"/>
Aug 09 18:35:41 user nova-compute[72418]:   </os>
Aug 09 18:35:41 user nova-compute[72418]:   <features>
Aug 09 18:35:41 user nova-compute[72418]:     <acpi/>
Aug 09 18:35:41 user nova-compute[72418]:     <apic/>
Aug 09 18:35:41 user nova-compute[72418]:     <vmcoreinfo/>
Aug 09 18:35:41 user nova-compute[72418]:   </features>
Aug 09 18:35:41 user nova-compute[72418]:   <clock offset="utc">
Aug 09 18:35:41 user nova-compute[72418]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 18:35:41 user nova-compute[72418]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 18:35:41 user nova-compute[72418]:     <timer name="hpet" present="no"/>
Aug 09 18:35:41 user nova-compute[72418]:   </clock>
Aug 09 18:35:41 user nova-compute[72418]:   <cpu mode="custom" match="exact">
Aug 09 18:35:41 user nova-compute[72418]:     <model>Nehalem</model>
Aug 09 18:35:41 user nova-compute[72418]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 18:35:41 user nova-compute[72418]:   </cpu>
Aug 09 18:35:41 user nova-compute[72418]:   <devices>
Aug 09 18:35:41 user nova-compute[72418]:     <disk type="block" device="disk">
Aug 09 18:35:41 user nova-compute[72418]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:35:41 user nova-compute[72418]:       <source dev="/dev/sde"/>
Aug 09 18:35:41 user nova-compute[72418]:       <target dev="vda" bus="virtio"/>
Aug 09 18:35:41 user nova-compute[72418]:       <serial>e52e5369-5c8f-4793-a8fc-9df310f4572b</serial>
Aug 09 18:35:41 user nova-compute[72418]:     </disk>
Aug 09 18:35:41 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:35:41 user nova-compute[72418]:       <mac address="fa:16:3e:65:a1:d2"/>
Aug 09 18:35:41 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:35:41 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:35:41 user nova-compute[72418]:       <target dev="tap0cd6232b-ea"/>
Aug 09 18:35:41 user nova-compute[72418]:     </interface>
Aug 09 18:35:41 user nova-compute[72418]:     <serial type="pty">
Aug 09 18:35:41 user nova-compute[72418]:       <log file="/opt/stack/data/nova/instances/0659fd5c-cb05-441e-94b6-9d05f7135893/console.log" append="off"/>
Aug 09 18:35:41 user nova-compute[72418]:     </serial>
Aug 09 18:35:41 user nova-compute[72418]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 18:35:41 user nova-compute[72418]:     <video>
Aug 09 18:35:41 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:35:41 user nova-compute[72418]:     </video>
Aug 09 18:35:41 user nova-compute[72418]:     <rng model="virtio">
Aug 09 18:35:41 user nova-compute[72418]:       <backend model="random">/dev/urandom</backend>
Aug 09 18:35:41 user nova-compute[72418]:     </rng>
Aug 09 18:35:41 user nova-compute[72418]:     <controller type="usb" index="0" model="none"/>
Aug 09 18:35:41 user nova-compute[72418]:     <memballoon model="virtio">
Aug 09 18:35:41 user nova-compute[72418]:       <stats period="10"/>
Aug 09 18:35:41 user nova-compute[72418]:     </memballoon>
Aug 09 18:35:41 user nova-compute[72418]:   </devices>
Aug 09 18:35:41 user nova-compute[72418]: </domain>
Aug 09 18:35:41 user nova-compute[72418]:  {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 18:35:41 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:35:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-935482357',display_name='tempest-ServerActionsTestOtherA-server-935482357',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-935482357',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZ8H8MvJhas/vPLXexc9KvUsV16Uhsl6uYTaDGrZC9aE3rBb3x7zoV+NqPR5zKzOIkCqtgn8ZVvU3tdtAtEAYrB/yDbEIXvY0hEVuVM8ww17BzMc60Vtn0IN61LmfWZ8Q==',key_name='tempest-keypair-882054128',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='78b6e36a5b61456092ce7de9212c3c82',ramdisk_id='',reservation_id='r-kxlskkmt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1039384122',owner_user_name='tempest-ServerActionsTestOtherA-1039384122-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:35:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='edc9ed6980274b978caf0666a9b31379',uuid=0659fd5c-cb05-441e-94b6-9d05f7135893,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0cd6232b-ea64-4978-bc0e-0e84995fd9a4", "address": "fa:16:3e:65:a1:d2", "network": {"id": "bd36ef30-e57d-473f-97bc-c51b5db08aa7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-425133239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78b6e36a5b61456092ce7de9212c3c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd6232b-ea", "ovs_interfaceid": "0cd6232b-ea64-4978-bc0e-0e84995fd9a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:35:41 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Converting VIF {"id": "0cd6232b-ea64-4978-bc0e-0e84995fd9a4", "address": "fa:16:3e:65:a1:d2", "network": {"id": "bd36ef30-e57d-473f-97bc-c51b5db08aa7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-425133239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78b6e36a5b61456092ce7de9212c3c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd6232b-ea", "ovs_interfaceid": "0cd6232b-ea64-4978-bc0e-0e84995fd9a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:35:41 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:a1:d2,bridge_name='br-int',has_traffic_filtering=True,id=0cd6232b-ea64-4978-bc0e-0e84995fd9a4,network=Network(bd36ef30-e57d-473f-97bc-c51b5db08aa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cd6232b-ea') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:35:41 user nova-compute[72418]: DEBUG os_vif [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:a1:d2,bridge_name='br-int',has_traffic_filtering=True,id=0cd6232b-ea64-4978-bc0e-0e84995fd9a4,network=Network(bd36ef30-e57d-473f-97bc-c51b5db08aa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cd6232b-ea') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:35:41 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:41 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:35:41 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:35:41 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:41 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0cd6232b-ea, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:35:41 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0cd6232b-ea, col_values=(('external_ids', {'iface-id': '0cd6232b-ea64-4978-bc0e-0e84995fd9a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:a1:d2', 'vm-uuid': '0659fd5c-cb05-441e-94b6-9d05f7135893'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:35:41 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:41 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:35:41 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:41 user nova-compute[72418]: INFO os_vif [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:a1:d2,bridge_name='br-int',has_traffic_filtering=True,id=0cd6232b-ea64-4978-bc0e-0e84995fd9a4,network=Network(bd36ef30-e57d-473f-97bc-c51b5db08aa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cd6232b-ea')
Aug 09 18:35:41 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:35:41 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] No VIF found with MAC fa:16:3e:65:a1:d2, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:35:43 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:43 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:43 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:43 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:43 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:43 user nova-compute[72418]: DEBUG nova.compute.manager [req-c604b28a-00ba-4219-8811-9ce9074eccb0 req-4be7da70-9df6-452b-b2eb-a13431a1cc55 service nova] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Received event network-vif-plugged-0cd6232b-ea64-4978-bc0e-0e84995fd9a4 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:35:43 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-c604b28a-00ba-4219-8811-9ce9074eccb0 req-4be7da70-9df6-452b-b2eb-a13431a1cc55 service nova] Acquiring lock "0659fd5c-cb05-441e-94b6-9d05f7135893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:35:43 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-c604b28a-00ba-4219-8811-9ce9074eccb0 req-4be7da70-9df6-452b-b2eb-a13431a1cc55 service nova] Lock "0659fd5c-cb05-441e-94b6-9d05f7135893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:35:43 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-c604b28a-00ba-4219-8811-9ce9074eccb0 req-4be7da70-9df6-452b-b2eb-a13431a1cc55 service nova] Lock "0659fd5c-cb05-441e-94b6-9d05f7135893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:35:43 user nova-compute[72418]: DEBUG nova.compute.manager [req-c604b28a-00ba-4219-8811-9ce9074eccb0 req-4be7da70-9df6-452b-b2eb-a13431a1cc55 service nova] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] No waiting events found dispatching network-vif-plugged-0cd6232b-ea64-4978-bc0e-0e84995fd9a4 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:35:43 user nova-compute[72418]: WARNING nova.compute.manager [req-c604b28a-00ba-4219-8811-9ce9074eccb0 req-4be7da70-9df6-452b-b2eb-a13431a1cc55 service nova] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Received unexpected event network-vif-plugged-0cd6232b-ea64-4978-bc0e-0e84995fd9a4 for instance with vm_state building and task_state spawning.
Aug 09 18:35:45 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691606145.7470791, 0659fd5c-cb05-441e-94b6-9d05f7135893 => Resumed> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:35:45 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] VM Resumed (Lifecycle Event)
Aug 09 18:35:45 user nova-compute[72418]: DEBUG nova.compute.manager [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Instance event wait completed in 0 seconds for  {{(pid=72418) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 18:35:45 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Guest created on hypervisor {{(pid=72418) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 18:35:45 user nova-compute[72418]: DEBUG nova.compute.manager [req-999af6f7-2fa5-4ddd-a2f6-8d6538fba0c6 req-40a92b16-c373-4875-a0e6-d834918cf7fd service nova] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Received event network-vif-plugged-0cd6232b-ea64-4978-bc0e-0e84995fd9a4 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:35:45 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-999af6f7-2fa5-4ddd-a2f6-8d6538fba0c6 req-40a92b16-c373-4875-a0e6-d834918cf7fd service nova] Acquiring lock "0659fd5c-cb05-441e-94b6-9d05f7135893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:35:45 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-999af6f7-2fa5-4ddd-a2f6-8d6538fba0c6 req-40a92b16-c373-4875-a0e6-d834918cf7fd service nova] Lock "0659fd5c-cb05-441e-94b6-9d05f7135893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:35:45 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-999af6f7-2fa5-4ddd-a2f6-8d6538fba0c6 req-40a92b16-c373-4875-a0e6-d834918cf7fd service nova] Lock "0659fd5c-cb05-441e-94b6-9d05f7135893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:35:45 user nova-compute[72418]: DEBUG nova.compute.manager [req-999af6f7-2fa5-4ddd-a2f6-8d6538fba0c6 req-40a92b16-c373-4875-a0e6-d834918cf7fd service nova] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] No waiting events found dispatching network-vif-plugged-0cd6232b-ea64-4978-bc0e-0e84995fd9a4 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:35:45 user nova-compute[72418]: WARNING nova.compute.manager [req-999af6f7-2fa5-4ddd-a2f6-8d6538fba0c6 req-40a92b16-c373-4875-a0e6-d834918cf7fd service nova] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Received unexpected event network-vif-plugged-0cd6232b-ea64-4978-bc0e-0e84995fd9a4 for instance with vm_state building and task_state spawning.
Aug 09 18:35:45 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Instance spawned successfully.
Aug 09 18:35:45 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 18:35:45 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:35:45 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:35:45 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:35:45 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691606145.7506843, 0659fd5c-cb05-441e-94b6-9d05f7135893 => Started> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:35:45 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] VM Started (Lifecycle Event)
Aug 09 18:35:45 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Found default for hw_cdrom_bus of ide {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:35:45 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Found default for hw_disk_bus of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:35:45 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Found default for hw_input_bus of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:35:45 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Found default for hw_pointer_model of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:35:45 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Found default for hw_video_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:35:45 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Found default for hw_vif_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:35:45 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:35:45 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:35:45 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:35:45 user nova-compute[72418]: INFO nova.compute.manager [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Took 5.90 seconds to spawn the instance on the hypervisor.
Aug 09 18:35:45 user nova-compute[72418]: DEBUG nova.compute.manager [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:35:45 user nova-compute[72418]: INFO nova.compute.manager [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Took 16.54 seconds to build instance.
Aug 09 18:35:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-2f17ca40-0ebf-4977-b854-aeec9e2b19ad tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "0659fd5c-cb05-441e-94b6-9d05f7135893" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.634s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:35:46 user nova-compute[72418]: DEBUG nova.compute.manager [None req-4cc03963-5bb0-4c91-8b65-be4df42a0653 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:35:46 user nova-compute[72418]: INFO nova.compute.manager [None req-4cc03963-5bb0-4c91-8b65-be4df42a0653 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] instance snapshotting
Aug 09 18:35:46 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-4cc03963-5bb0-4c91-8b65-be4df42a0653 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Beginning live snapshot process
Aug 09 18:35:46 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-4cc03963-5bb0-4c91-8b65-be4df42a0653 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9e974b-b993-4f4e-9446-14941c39f109/disk --force-share --output=json -f qcow2 {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:47 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-4cc03963-5bb0-4c91-8b65-be4df42a0653 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9e974b-b993-4f4e-9446-14941c39f109/disk --force-share --output=json -f qcow2" returned: 0 in 0.196s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:47 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-4cc03963-5bb0-4c91-8b65-be4df42a0653 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9e974b-b993-4f4e-9446-14941c39f109/disk --force-share --output=json -f qcow2 {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:47 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-4cc03963-5bb0-4c91-8b65-be4df42a0653 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9e974b-b993-4f4e-9446-14941c39f109/disk --force-share --output=json -f qcow2" returned: 0 in 0.209s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:47 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-4cc03963-5bb0-4c91-8b65-be4df42a0653 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:47 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-4cc03963-5bb0-4c91-8b65-be4df42a0653 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.194s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:47 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-4cc03963-5bb0-4c91-8b65-be4df42a0653 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp_y59v6pk/65b46fc2209d444dbccea6eff5732a3a.delta 1073741824 {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:47 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-4cc03963-5bb0-4c91-8b65-be4df42a0653 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp_y59v6pk/65b46fc2209d444dbccea6eff5732a3a.delta 1073741824" returned: 0 in 0.059s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:47 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-4cc03963-5bb0-4c91-8b65-be4df42a0653 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 09 18:35:48 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:48 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-4cc03963-5bb0-4c91-8b65-be4df42a0653 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=72418) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 18:35:48 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-4cc03963-5bb0-4c91-8b65-be4df42a0653 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] COPY block job progress, current cursor: 75366400 final cursor: 75563008 {{(pid=72418) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 18:35:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-4cc03963-5bb0-4c91-8b65-be4df42a0653 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=72418) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 18:35:49 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-4cc03963-5bb0-4c91-8b65-be4df42a0653 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 09 18:35:49 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:49 user nova-compute[72418]: DEBUG nova.privsep.utils [None req-4cc03963-5bb0-4c91-8b65-be4df42a0653 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72418) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 18:35:49 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-4cc03963-5bb0-4c91-8b65-be4df42a0653 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp_y59v6pk/65b46fc2209d444dbccea6eff5732a3a.delta /opt/stack/data/nova/instances/snapshots/tmp_y59v6pk/65b46fc2209d444dbccea6eff5732a3a {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-4cc03963-5bb0-4c91-8b65-be4df42a0653 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp_y59v6pk/65b46fc2209d444dbccea6eff5732a3a.delta /opt/stack/data/nova/instances/snapshots/tmp_y59v6pk/65b46fc2209d444dbccea6eff5732a3a" returned: 0 in 0.645s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:50 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-4cc03963-5bb0-4c91-8b65-be4df42a0653 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Snapshot extracted, beginning image upload
Aug 09 18:35:50 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-019162b1-a388-4716-87fa-0cecb245b2f5 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Calling os-brick to attach iSCSI Volume {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 18:35:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-019162b1-a388-4716-87fa-0cecb245b2f5 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ACpuUXzW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:35:50 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-019162b1-a388-4716-87fa-0cecb245b2f5 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:35:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-019162b1-a388-4716-87fa-0cecb245b2f5 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:35:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-019162b1-a388-4716-87fa-0cecb245b2f5 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:35:50 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-019162b1-a388-4716-87fa-0cecb245b2f5 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:35:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-019162b1-a388-4716-87fa-0cecb245b2f5 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:35:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-019162b1-a388-4716-87fa-0cecb245b2f5 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:35:50 user nova-compute[72418]: INFO os_brick.initiator.connectors.iscsi [None req-019162b1-a388-4716-87fa-0cecb245b2f5 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 18:35:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6 -p 172.16.0.220:3260 {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:50 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2c9684-a329-476d-b991-0ef2404375eb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:35:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-019162b1-a388-4716-87fa-0cecb245b2f5 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 18:35:50 user nova-compute[72418]:  {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:35:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6 -p 172.16.0.220:3260 --interface default --op new {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:50 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b4e94e-1f8a-4fd7-82e2-7c92b51081a4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6] added\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:35:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-019162b1-a388-4716-87fa-0cecb245b2f5 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6] added
Aug 09 18:35:50 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:35:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:50 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb73e4d-4054-4cad-a3c9-ea0575e0b753]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:35:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-019162b1-a388-4716-87fa-0cecb245b2f5 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:35:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:50 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ecc48a8-f5a0-42da-8ddc-796368db2d6d]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:35:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-019162b1-a388-4716-87fa-0cecb245b2f5 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:35:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ACpuUXzW {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ACpuUXzW" returned: 0 in 0.024s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:50 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1286e21-fdc2-436a-8205-60698654c783]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:35:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-019162b1-a388-4716-87fa-0cecb245b2f5 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ACpuUXzW'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:35:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:50 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56151ba-135a-42c9-8b48-75371ff005a6]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:35:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-019162b1-a388-4716-87fa-0cecb245b2f5 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:35:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:50 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[2588d252-3915-438c-8e8d-094c978b9def]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:35:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-019162b1-a388-4716-87fa-0cecb245b2f5 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:35:50 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:35:50 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:35:50 user nova-compute[72418]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:35:50 user nova-compute[72418]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)
Aug 09 18:35:50 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:35:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-019162b1-a388-4716-87fa-0cecb245b2f5 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:35:50 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:35:50 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:35:50 user nova-compute[72418]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:35:50 user nova-compute[72418]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)
Aug 09 18:35:50 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:35:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6 -p 172.16.0.220:3260 --login {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6 -p 172.16.0.220:3260 --login" returned: 0 in 0.128s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:50 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d574f2-527e-432c-b7de-ae05227fd4d5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:35:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-019162b1-a388-4716-87fa-0cecb245b2f5 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6, portal: 172.16.0.220,3260]
Aug 09 18:35:50 user nova-compute[72418]: Login to [iface: default, target: iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6, portal: 172.16.0.220,3260] successful.
Aug 09 18:35:50 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:35:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:50 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf6c1e3-c6f6-4b34-91aa-4050edb005b1]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:35:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-019162b1-a388-4716-87fa-0cecb245b2f5 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:35:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:50 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb71767-3487-4a9f-871f-171a06ec7a9f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:35:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-019162b1-a388-4716-87fa-0cecb245b2f5 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:35:50 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:35:50 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:35:50 user nova-compute[72418]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:35:50 user nova-compute[72418]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)
Aug 09 18:35:50 user nova-compute[72418]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6 (non-flash)
Aug 09 18:35:50 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:35:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-019162b1-a388-4716-87fa-0cecb245b2f5 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:35:50 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:35:50 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:35:50 user nova-compute[72418]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:35:50 user nova-compute[72418]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)
Aug 09 18:35:50 user nova-compute[72418]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6 (non-flash)
Aug 09 18:35:50 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:35:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-019162b1-a388-4716-87fa-0cecb245b2f5 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.458s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:35:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-019162b1-a388-4716-87fa-0cecb245b2f5 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Connected to 172.16.0.220:3260 {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 18:35:50 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-019162b1-a388-4716-87fa-0cecb245b2f5 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] HCTL ('37', '-', '-', 0) found on session 33 with lun 0 {{(pid=72418) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 18:35:50 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-019162b1-a388-4716-87fa-0cecb245b2f5 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72418) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 18:35:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.032s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:50 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a449538-5ce3-4b4c-9156-4b3485a82653]: (4, ('- - 0', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:35:50 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-019162b1-a388-4716-87fa-0cecb245b2f5 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Searching for a device in session 33 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72418) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 18:35:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-019162b1-a388-4716-87fa-0cecb245b2f5 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ACpuUXzW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 18:35:51 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Acquiring lock "97f49889-df0b-48c1-97ce-5c331b6a65ce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:35:51 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "97f49889-df0b-48c1-97ce-5c331b6a65ce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:35:51 user nova-compute[72418]: DEBUG nova.compute.manager [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Starting instance... {{(pid=72418) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 18:35:51 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:35:51 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:35:51 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72418) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 18:35:51 user nova-compute[72418]: INFO nova.compute.claims [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Claim successful on node user
Aug 09 18:35:51 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:51 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-019162b1-a388-4716-87fa-0cecb245b2f5 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.516s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:35:51 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-019162b1-a388-4716-87fa-0cecb245b2f5 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] <== connect_volume: return (1518ms) {'type': 'block', 'scsi_wwn': '23834323962386131', 'path': '/dev/sdf'} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:35:51 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-019162b1-a388-4716-87fa-0cecb245b2f5 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834323962386131', 'path': '/dev/sdf'} {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 18:35:51 user nova-compute[72418]: DEBUG nova.objects.instance [None req-019162b1-a388-4716-87fa-0cecb245b2f5 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lazy-loading 'flavor' on Instance uuid 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:35:51 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:35:51 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-019162b1-a388-4716-87fa-0cecb245b2f5 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 18:35:51 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:35:51 user nova-compute[72418]:   <source dev="/dev/sdf"/>
Aug 09 18:35:51 user nova-compute[72418]:   <target dev="vdb" bus="virtio"/>
Aug 09 18:35:51 user nova-compute[72418]:   <serial>7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6</serial>
Aug 09 18:35:51 user nova-compute[72418]: </disk>
Aug 09 18:35:51 user nova-compute[72418]:  {{(pid=72418) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 18:35:52 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:35:52 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.681s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:35:52 user nova-compute[72418]: DEBUG nova.compute.manager [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Start building networks asynchronously for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 18:35:52 user nova-compute[72418]: DEBUG nova.compute.manager [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Allocating IP information in the background. {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 18:35:52 user nova-compute[72418]: DEBUG nova.network.neutron [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] allocate_for_instance() {{(pid=72418) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 18:35:52 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 18:35:52 user nova-compute[72418]: DEBUG nova.compute.manager [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Start building block device mappings for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 18:35:52 user nova-compute[72418]: DEBUG nova.policy [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '236307357ebf43bc8150f86f832260ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5242fb37f9664dbf9a8b50449f8dd129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72418) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 18:35:52 user nova-compute[72418]: DEBUG nova.compute.manager [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Start spawning the instance on the hypervisor. {{(pid=72418) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 18:35:52 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Creating instance directory {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 18:35:52 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Creating image(s)
Aug 09 18:35:52 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Acquiring lock "/opt/stack/data/nova/instances/97f49889-df0b-48c1-97ce-5c331b6a65ce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:35:52 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "/opt/stack/data/nova/instances/97f49889-df0b-48c1-97ce-5c331b6a65ce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.004s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:35:52 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "/opt/stack/data/nova/instances/97f49889-df0b-48c1-97ce-5c331b6a65ce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:35:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:52 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-019162b1-a388-4716-87fa-0cecb245b2f5 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:35:52 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-019162b1-a388-4716-87fa-0cecb245b2f5 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:35:52 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-019162b1-a388-4716-87fa-0cecb245b2f5 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] No VIF found with MAC fa:16:3e:b0:f3:60, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:35:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.220s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:52 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Acquiring lock "458773cfa7230b717e41c60277832e9f83806d71" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:35:52 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:35:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:52 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-019162b1-a388-4716-87fa-0cecb245b2f5 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.027s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:35:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.186s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/97f49889-df0b-48c1-97ce-5c331b6a65ce/disk 1073741824 {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/97f49889-df0b-48c1-97ce-5c331b6a65ce/disk 1073741824" returned: 0 in 0.059s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:52 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:35:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.156s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:53 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Checking if we can resize image /opt/stack/data/nova/instances/97f49889-df0b-48c1-97ce-5c331b6a65ce/disk. size=1073741824 {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 18:35:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f49889-df0b-48c1-97ce-5c331b6a65ce/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:53 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:53 user nova-compute[72418]: DEBUG nova.network.neutron [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Successfully created port: 07c05457-6d05-4961-9642-02b3db4901c4 {{(pid=72418) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 18:35:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f49889-df0b-48c1-97ce-5c331b6a65ce/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:53 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Cannot resize image /opt/stack/data/nova/instances/97f49889-df0b-48c1-97ce-5c331b6a65ce/disk to a smaller size. {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 18:35:53 user nova-compute[72418]: DEBUG nova.objects.instance [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lazy-loading 'migration_context' on Instance uuid 97f49889-df0b-48c1-97ce-5c331b6a65ce {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:35:53 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Created local disks {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 18:35:53 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Ensure instance console log exists: /opt/stack/data/nova/instances/97f49889-df0b-48c1-97ce-5c331b6a65ce/console.log {{(pid=72418) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 18:35:53 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:35:53 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:35:53 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:35:53 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-4cc03963-5bb0-4c91-8b65-be4df42a0653 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Snapshot image upload complete
Aug 09 18:35:53 user nova-compute[72418]: INFO nova.compute.manager [None req-4cc03963-5bb0-4c91-8b65-be4df42a0653 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Took 6.81 seconds to snapshot the instance on the hypervisor.
Aug 09 18:35:53 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:54 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:35:54 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:35:54 user nova-compute[72418]: DEBUG nova.network.neutron [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Successfully updated port: 07c05457-6d05-4961-9642-02b3db4901c4 {{(pid=72418) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 18:35:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Acquiring lock "refresh_cache-97f49889-df0b-48c1-97ce-5c331b6a65ce" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:35:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Acquired lock "refresh_cache-97f49889-df0b-48c1-97ce-5c331b6a65ce" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:35:54 user nova-compute[72418]: DEBUG nova.network.neutron [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:35:54 user nova-compute[72418]: DEBUG nova.compute.manager [req-bef8dba8-f605-486a-a5cf-1b168ba31a65 req-6edca7f7-2a76-4977-8519-477222ddeb68 service nova] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Received event network-changed-07c05457-6d05-4961-9642-02b3db4901c4 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:35:54 user nova-compute[72418]: DEBUG nova.compute.manager [req-bef8dba8-f605-486a-a5cf-1b168ba31a65 req-6edca7f7-2a76-4977-8519-477222ddeb68 service nova] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Refreshing instance network info cache due to event network-changed-07c05457-6d05-4961-9642-02b3db4901c4. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:35:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-bef8dba8-f605-486a-a5cf-1b168ba31a65 req-6edca7f7-2a76-4977-8519-477222ddeb68 service nova] Acquiring lock "refresh_cache-97f49889-df0b-48c1-97ce-5c331b6a65ce" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:35:54 user nova-compute[72418]: DEBUG nova.network.neutron [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Instance cache missing network info. {{(pid=72418) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 18:35:54 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:35:54 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72418) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 18:35:55 user nova-compute[72418]: DEBUG nova.network.neutron [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Updating instance_info_cache with network_info: [{"id": "07c05457-6d05-4961-9642-02b3db4901c4", "address": "fa:16:3e:4c:1c:62", "network": {"id": "7621f03d-76ac-49da-89a8-0753bb11e329", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596253708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5242fb37f9664dbf9a8b50449f8dd129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07c05457-6d", "ovs_interfaceid": "07c05457-6d05-4961-9642-02b3db4901c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:35:55 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Releasing lock "refresh_cache-97f49889-df0b-48c1-97ce-5c331b6a65ce" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:35:55 user nova-compute[72418]: DEBUG nova.compute.manager [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Instance network_info: |[{"id": "07c05457-6d05-4961-9642-02b3db4901c4", "address": "fa:16:3e:4c:1c:62", "network": {"id": "7621f03d-76ac-49da-89a8-0753bb11e329", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596253708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5242fb37f9664dbf9a8b50449f8dd129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07c05457-6d", "ovs_interfaceid": "07c05457-6d05-4961-9642-02b3db4901c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 18:35:55 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-bef8dba8-f605-486a-a5cf-1b168ba31a65 req-6edca7f7-2a76-4977-8519-477222ddeb68 service nova] Acquired lock "refresh_cache-97f49889-df0b-48c1-97ce-5c331b6a65ce" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:35:55 user nova-compute[72418]: DEBUG nova.network.neutron [req-bef8dba8-f605-486a-a5cf-1b168ba31a65 req-6edca7f7-2a76-4977-8519-477222ddeb68 service nova] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Refreshing network info cache for port 07c05457-6d05-4961-9642-02b3db4901c4 {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:35:55 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Start _get_guest_xml network_info=[{"id": "07c05457-6d05-4961-9642-02b3db4901c4", "address": "fa:16:3e:4c:1c:62", "network": {"id": "7621f03d-76ac-49da-89a8-0753bb11e329", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596253708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5242fb37f9664dbf9a8b50449f8dd129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07c05457-6d", "ovs_interfaceid": "07c05457-6d05-4961-9642-02b3db4901c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 18:35:55 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:35:55 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:35:55 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 18:35:55 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] CPU controller missing on host. {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 18:35:55 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 18:35:55 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] CPU controller found on host. {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 18:35:55 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72418) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 18:35:55 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T18:17:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 18:35:55 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Flavor limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 18:35:55 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Image limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 18:35:55 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Flavor pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 18:35:55 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Image pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 18:35:55 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 18:35:55 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 18:35:55 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 18:35:55 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Got 1 possible topologies {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 18:35:55 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 18:35:55 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 18:35:55 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:35:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-25939957',display_name='tempest-AttachVolumeTestJSON-server-25939957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-25939957',id=30,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAmy2QDCRjOg3oBY/Nf3FiX2HYTtdLvJkmnrKflpbuqVI2A7KTCLJCCiM2G7hBQoHuAN1kX7YgQCgbSbufrN4ld9s5IJ+ac8+tDzrQeZN/DcFEpF8Ng87foE92lpsE/bMQ==',key_name='tempest-keypair-936032845',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5242fb37f9664dbf9a8b50449f8dd129',ramdisk_id='',reservation_id='r-wh0ygz73',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1480837700',owner_user_name='tempest-AttachVolumeTestJSON-1480837700-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:35:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='236307357ebf43bc8150f86f832260ba',uuid=97f49889-df0b-48c1-97ce-5c331b6a65ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07c05457-6d05-4961-9642-02b3db4901c4", "address": "fa:16:3e:4c:1c:62", "network": {"id": "7621f03d-76ac-49da-89a8-0753bb11e329", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596253708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5242fb37f9664dbf9a8b50449f8dd129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07c05457-6d", "ovs_interfaceid": "07c05457-6d05-4961-9642-02b3db4901c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:35:55 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Converting VIF {"id": "07c05457-6d05-4961-9642-02b3db4901c4", "address": "fa:16:3e:4c:1c:62", "network": {"id": "7621f03d-76ac-49da-89a8-0753bb11e329", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596253708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5242fb37f9664dbf9a8b50449f8dd129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07c05457-6d", "ovs_interfaceid": "07c05457-6d05-4961-9642-02b3db4901c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:35:55 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:1c:62,bridge_name='br-int',has_traffic_filtering=True,id=07c05457-6d05-4961-9642-02b3db4901c4,network=Network(7621f03d-76ac-49da-89a8-0753bb11e329),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07c05457-6d') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:35:55 user nova-compute[72418]: DEBUG nova.objects.instance [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lazy-loading 'pci_devices' on Instance uuid 97f49889-df0b-48c1-97ce-5c331b6a65ce {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:35:55 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] End _get_guest_xml xml=<domain type="kvm">
Aug 09 18:35:55 user nova-compute[72418]:   <uuid>97f49889-df0b-48c1-97ce-5c331b6a65ce</uuid>
Aug 09 18:35:55 user nova-compute[72418]:   <name>instance-0000001e</name>
Aug 09 18:35:55 user nova-compute[72418]:   <memory>524288</memory>
Aug 09 18:35:55 user nova-compute[72418]:   <vcpu>1</vcpu>
Aug 09 18:35:55 user nova-compute[72418]:   <metadata>
Aug 09 18:35:55 user nova-compute[72418]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:35:55 user nova-compute[72418]:       <nova:package version="0.0.0"/>
Aug 09 18:35:55 user nova-compute[72418]:       <nova:name>tempest-AttachVolumeTestJSON-server-25939957</nova:name>
Aug 09 18:35:55 user nova-compute[72418]:       <nova:creationTime>2023-08-09 18:35:55</nova:creationTime>
Aug 09 18:35:55 user nova-compute[72418]:       <nova:flavor name="m1.tiny">
Aug 09 18:35:55 user nova-compute[72418]:         <nova:memory>512</nova:memory>
Aug 09 18:35:55 user nova-compute[72418]:         <nova:disk>1</nova:disk>
Aug 09 18:35:55 user nova-compute[72418]:         <nova:swap>0</nova:swap>
Aug 09 18:35:55 user nova-compute[72418]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:35:55 user nova-compute[72418]:         <nova:vcpus>1</nova:vcpus>
Aug 09 18:35:55 user nova-compute[72418]:       </nova:flavor>
Aug 09 18:35:55 user nova-compute[72418]:       <nova:owner>
Aug 09 18:35:55 user nova-compute[72418]:         <nova:user uuid="236307357ebf43bc8150f86f832260ba">tempest-AttachVolumeTestJSON-1480837700-project-member</nova:user>
Aug 09 18:35:55 user nova-compute[72418]:         <nova:project uuid="5242fb37f9664dbf9a8b50449f8dd129">tempest-AttachVolumeTestJSON-1480837700</nova:project>
Aug 09 18:35:55 user nova-compute[72418]:       </nova:owner>
Aug 09 18:35:55 user nova-compute[72418]:       <nova:root type="image" uuid="8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e"/>
Aug 09 18:35:55 user nova-compute[72418]:       <nova:ports>
Aug 09 18:35:55 user nova-compute[72418]:         <nova:port uuid="07c05457-6d05-4961-9642-02b3db4901c4">
Aug 09 18:35:55 user nova-compute[72418]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 18:35:55 user nova-compute[72418]:         </nova:port>
Aug 09 18:35:55 user nova-compute[72418]:       </nova:ports>
Aug 09 18:35:55 user nova-compute[72418]:     </nova:instance>
Aug 09 18:35:55 user nova-compute[72418]:   </metadata>
Aug 09 18:35:55 user nova-compute[72418]:   <sysinfo type="smbios">
Aug 09 18:35:55 user nova-compute[72418]:     <system>
Aug 09 18:35:55 user nova-compute[72418]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 18:35:55 user nova-compute[72418]:       <entry name="product">OpenStack Nova</entry>
Aug 09 18:35:55 user nova-compute[72418]:       <entry name="version">0.0.0</entry>
Aug 09 18:35:55 user nova-compute[72418]:       <entry name="serial">97f49889-df0b-48c1-97ce-5c331b6a65ce</entry>
Aug 09 18:35:55 user nova-compute[72418]:       <entry name="uuid">97f49889-df0b-48c1-97ce-5c331b6a65ce</entry>
Aug 09 18:35:55 user nova-compute[72418]:       <entry name="family">Virtual Machine</entry>
Aug 09 18:35:55 user nova-compute[72418]:     </system>
Aug 09 18:35:55 user nova-compute[72418]:   </sysinfo>
Aug 09 18:35:55 user nova-compute[72418]:   <os>
Aug 09 18:35:55 user nova-compute[72418]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 18:35:55 user nova-compute[72418]:     <boot dev="hd"/>
Aug 09 18:35:55 user nova-compute[72418]:     <smbios mode="sysinfo"/>
Aug 09 18:35:55 user nova-compute[72418]:   </os>
Aug 09 18:35:55 user nova-compute[72418]:   <features>
Aug 09 18:35:55 user nova-compute[72418]:     <acpi/>
Aug 09 18:35:55 user nova-compute[72418]:     <apic/>
Aug 09 18:35:55 user nova-compute[72418]:     <vmcoreinfo/>
Aug 09 18:35:55 user nova-compute[72418]:   </features>
Aug 09 18:35:55 user nova-compute[72418]:   <clock offset="utc">
Aug 09 18:35:55 user nova-compute[72418]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 18:35:55 user nova-compute[72418]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 18:35:55 user nova-compute[72418]:     <timer name="hpet" present="no"/>
Aug 09 18:35:55 user nova-compute[72418]:   </clock>
Aug 09 18:35:55 user nova-compute[72418]:   <cpu mode="custom" match="exact">
Aug 09 18:35:55 user nova-compute[72418]:     <model>Nehalem</model>
Aug 09 18:35:55 user nova-compute[72418]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 18:35:55 user nova-compute[72418]:   </cpu>
Aug 09 18:35:55 user nova-compute[72418]:   <devices>
Aug 09 18:35:55 user nova-compute[72418]:     <disk type="file" device="disk">
Aug 09 18:35:55 user nova-compute[72418]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 18:35:55 user nova-compute[72418]:       <source file="/opt/stack/data/nova/instances/97f49889-df0b-48c1-97ce-5c331b6a65ce/disk"/>
Aug 09 18:35:55 user nova-compute[72418]:       <target dev="vda" bus="virtio"/>
Aug 09 18:35:55 user nova-compute[72418]:     </disk>
Aug 09 18:35:55 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:35:55 user nova-compute[72418]:       <mac address="fa:16:3e:4c:1c:62"/>
Aug 09 18:35:55 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:35:55 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:35:55 user nova-compute[72418]:       <target dev="tap07c05457-6d"/>
Aug 09 18:35:55 user nova-compute[72418]:     </interface>
Aug 09 18:35:55 user nova-compute[72418]:     <serial type="pty">
Aug 09 18:35:55 user nova-compute[72418]:       <log file="/opt/stack/data/nova/instances/97f49889-df0b-48c1-97ce-5c331b6a65ce/console.log" append="off"/>
Aug 09 18:35:55 user nova-compute[72418]:     </serial>
Aug 09 18:35:55 user nova-compute[72418]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 18:35:55 user nova-compute[72418]:     <video>
Aug 09 18:35:55 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:35:55 user nova-compute[72418]:     </video>
Aug 09 18:35:55 user nova-compute[72418]:     <rng model="virtio">
Aug 09 18:35:55 user nova-compute[72418]:       <backend model="random">/dev/urandom</backend>
Aug 09 18:35:55 user nova-compute[72418]:     </rng>
Aug 09 18:35:55 user nova-compute[72418]:     <controller type="usb" index="0" model="none"/>
Aug 09 18:35:55 user nova-compute[72418]:     <memballoon model="virtio">
Aug 09 18:35:55 user nova-compute[72418]:       <stats period="10"/>
Aug 09 18:35:55 user nova-compute[72418]:     </memballoon>
Aug 09 18:35:55 user nova-compute[72418]:   </devices>
Aug 09 18:35:55 user nova-compute[72418]: </domain>
Aug 09 18:35:55 user nova-compute[72418]:  {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 18:35:55 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:35:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-25939957',display_name='tempest-AttachVolumeTestJSON-server-25939957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-25939957',id=30,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAmy2QDCRjOg3oBY/Nf3FiX2HYTtdLvJkmnrKflpbuqVI2A7KTCLJCCiM2G7hBQoHuAN1kX7YgQCgbSbufrN4ld9s5IJ+ac8+tDzrQeZN/DcFEpF8Ng87foE92lpsE/bMQ==',key_name='tempest-keypair-936032845',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5242fb37f9664dbf9a8b50449f8dd129',ramdisk_id='',reservation_id='r-wh0ygz73',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1480837700',owner_user_name='tempest-AttachVolumeTestJSON-1480837700-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:35:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='236307357ebf43bc8150f86f832260ba',uuid=97f49889-df0b-48c1-97ce-5c331b6a65ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07c05457-6d05-4961-9642-02b3db4901c4", "address": "fa:16:3e:4c:1c:62", "network": {"id": "7621f03d-76ac-49da-89a8-0753bb11e329", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596253708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5242fb37f9664dbf9a8b50449f8dd129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07c05457-6d", "ovs_interfaceid": "07c05457-6d05-4961-9642-02b3db4901c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:35:55 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Converting VIF {"id": "07c05457-6d05-4961-9642-02b3db4901c4", "address": "fa:16:3e:4c:1c:62", "network": {"id": "7621f03d-76ac-49da-89a8-0753bb11e329", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596253708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5242fb37f9664dbf9a8b50449f8dd129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07c05457-6d", "ovs_interfaceid": "07c05457-6d05-4961-9642-02b3db4901c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:35:55 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:1c:62,bridge_name='br-int',has_traffic_filtering=True,id=07c05457-6d05-4961-9642-02b3db4901c4,network=Network(7621f03d-76ac-49da-89a8-0753bb11e329),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07c05457-6d') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:35:55 user nova-compute[72418]: DEBUG os_vif [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:1c:62,bridge_name='br-int',has_traffic_filtering=True,id=07c05457-6d05-4961-9642-02b3db4901c4,network=Network(7621f03d-76ac-49da-89a8-0753bb11e329),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07c05457-6d') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:35:55 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:55 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:35:55 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:35:55 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:55 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap07c05457-6d, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:35:55 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap07c05457-6d, col_values=(('external_ids', {'iface-id': '07c05457-6d05-4961-9642-02b3db4901c4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:1c:62', 'vm-uuid': '97f49889-df0b-48c1-97ce-5c331b6a65ce'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:35:55 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:55 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:35:55 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:55 user nova-compute[72418]: INFO os_vif [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:1c:62,bridge_name='br-int',has_traffic_filtering=True,id=07c05457-6d05-4961-9642-02b3db4901c4,network=Network(7621f03d-76ac-49da-89a8-0753bb11e329),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07c05457-6d')
Aug 09 18:35:55 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:35:55 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] No VIF found with MAC fa:16:3e:4c:1c:62, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:35:55 user nova-compute[72418]: DEBUG nova.network.neutron [req-bef8dba8-f605-486a-a5cf-1b168ba31a65 req-6edca7f7-2a76-4977-8519-477222ddeb68 service nova] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Updated VIF entry in instance network info cache for port 07c05457-6d05-4961-9642-02b3db4901c4. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:35:55 user nova-compute[72418]: DEBUG nova.network.neutron [req-bef8dba8-f605-486a-a5cf-1b168ba31a65 req-6edca7f7-2a76-4977-8519-477222ddeb68 service nova] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Updating instance_info_cache with network_info: [{"id": "07c05457-6d05-4961-9642-02b3db4901c4", "address": "fa:16:3e:4c:1c:62", "network": {"id": "7621f03d-76ac-49da-89a8-0753bb11e329", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596253708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5242fb37f9664dbf9a8b50449f8dd129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07c05457-6d", "ovs_interfaceid": "07c05457-6d05-4961-9642-02b3db4901c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:35:55 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-bef8dba8-f605-486a-a5cf-1b168ba31a65 req-6edca7f7-2a76-4977-8519-477222ddeb68 service nova] Releasing lock "refresh_cache-97f49889-df0b-48c1-97ce-5c331b6a65ce" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:35:55 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:35:56 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Acquiring lock "873654d4-9cf2-4dde-859c-ad26d05d6e0a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:35:56 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "873654d4-9cf2-4dde-859c-ad26d05d6e0a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:35:56 user nova-compute[72418]: DEBUG nova.compute.manager [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Starting instance... {{(pid=72418) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 18:35:56 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:35:56 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:35:56 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72418) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 18:35:56 user nova-compute[72418]: INFO nova.compute.claims [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Claim successful on node user
Aug 09 18:35:56 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:56 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:56 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:56 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:56 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:35:56 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:35:57 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:35:57 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:35:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.890s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:35:57 user nova-compute[72418]: DEBUG nova.compute.manager [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Start building networks asynchronously for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 18:35:57 user nova-compute[72418]: DEBUG nova.compute.manager [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Allocating IP information in the background. {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 18:35:57 user nova-compute[72418]: DEBUG nova.network.neutron [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] allocate_for_instance() {{(pid=72418) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 18:35:57 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 18:35:57 user nova-compute[72418]: DEBUG nova.compute.manager [req-e2366729-b803-4849-b51e-dd6d443b176f req-b00b4ccb-c08e-4e28-a975-f33cd53bc07c service nova] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Received event network-vif-plugged-07c05457-6d05-4961-9642-02b3db4901c4 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:35:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-e2366729-b803-4849-b51e-dd6d443b176f req-b00b4ccb-c08e-4e28-a975-f33cd53bc07c service nova] Acquiring lock "97f49889-df0b-48c1-97ce-5c331b6a65ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:35:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-e2366729-b803-4849-b51e-dd6d443b176f req-b00b4ccb-c08e-4e28-a975-f33cd53bc07c service nova] Lock "97f49889-df0b-48c1-97ce-5c331b6a65ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:35:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-e2366729-b803-4849-b51e-dd6d443b176f req-b00b4ccb-c08e-4e28-a975-f33cd53bc07c service nova] Lock "97f49889-df0b-48c1-97ce-5c331b6a65ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:35:57 user nova-compute[72418]: DEBUG nova.compute.manager [req-e2366729-b803-4849-b51e-dd6d443b176f req-b00b4ccb-c08e-4e28-a975-f33cd53bc07c service nova] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] No waiting events found dispatching network-vif-plugged-07c05457-6d05-4961-9642-02b3db4901c4 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:35:57 user nova-compute[72418]: WARNING nova.compute.manager [req-e2366729-b803-4849-b51e-dd6d443b176f req-b00b4ccb-c08e-4e28-a975-f33cd53bc07c service nova] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Received unexpected event network-vif-plugged-07c05457-6d05-4961-9642-02b3db4901c4 for instance with vm_state building and task_state spawning.
Aug 09 18:35:57 user nova-compute[72418]: DEBUG nova.compute.manager [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Start building block device mappings for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 18:35:57 user nova-compute[72418]: DEBUG nova.policy [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2af66759bfa54ffba6174c4f95a83789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce18df915bca48109597ad4aa8f1d116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72418) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 18:35:57 user nova-compute[72418]: DEBUG nova.compute.manager [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Start spawning the instance on the hypervisor. {{(pid=72418) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 18:35:57 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Creating instance directory {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 18:35:57 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Creating image(s)
Aug 09 18:35:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Acquiring lock "/opt/stack/data/nova/instances/873654d4-9cf2-4dde-859c-ad26d05d6e0a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:35:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "/opt/stack/data/nova/instances/873654d4-9cf2-4dde-859c-ad26d05d6e0a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:35:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "/opt/stack/data/nova/instances/873654d4-9cf2-4dde-859c-ad26d05d6e0a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:35:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Acquiring lock "232a6438132c52ece060772b37bf5ee692b43908" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:35:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "232a6438132c52ece060772b37bf5ee692b43908" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:35:57 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:57 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:57 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/232a6438132c52ece060772b37bf5ee692b43908.part --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:58 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:35:58 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:35:58 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:35:58 user nova-compute[72418]: DEBUG nova.network.neutron [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Successfully created port: 396cd02b-9a02-4b77-b06b-6253ca90f538 {{(pid=72418) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 18:35:58 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Acquiring lock "4e1a095f-a2e7-4ab6-bb7e-38cda890d567" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:35:58 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Lock "4e1a095f-a2e7-4ab6-bb7e-38cda890d567" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:35:58 user nova-compute[72418]: DEBUG nova.compute.manager [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Starting instance... {{(pid=72418) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 18:35:58 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:35:58 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Starting heal instance info cache {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 18:35:58 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Rebuilding the list of instances to heal {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 18:35:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/232a6438132c52ece060772b37bf5ee692b43908.part --force-share --output=json" returned: 0 in 0.193s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:58 user nova-compute[72418]: DEBUG nova.virt.images [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] 0a633be0-827f-4c6d-a40e-5896a0bc9bcf was qcow2, converting to raw {{(pid=72418) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 18:35:58 user nova-compute[72418]: DEBUG nova.privsep.utils [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72418) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 18:35:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/232a6438132c52ece060772b37bf5ee692b43908.part /opt/stack/data/nova/instances/_base/232a6438132c52ece060772b37bf5ee692b43908.converted {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:58 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Skipping network cache update for instance because it is Building. {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 09 18:35:59 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Skipping network cache update for instance because it is Building. {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 09 18:35:59 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:35:59 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:35:59 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72418) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 18:35:59 user nova-compute[72418]: INFO nova.compute.claims [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Claim successful on node user
Aug 09 18:35:59 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "refresh_cache-6af7918a-ce90-45ab-93d8-684e1489e891" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:35:59 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquired lock "refresh_cache-6af7918a-ce90-45ab-93d8-684e1489e891" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:35:59 user nova-compute[72418]: DEBUG nova.network.neutron [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Forcefully refreshing network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 18:35:59 user nova-compute[72418]: DEBUG nova.objects.instance [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lazy-loading 'info_cache' on Instance uuid 6af7918a-ce90-45ab-93d8-684e1489e891 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:35:59 user nova-compute[72418]: DEBUG nova.network.neutron [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Port ea92909f-40d7-48a8-be09-50439674945c binding to destination host user is already ACTIVE {{(pid=72418) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 09 18:35:59 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Acquiring lock "refresh_cache-03ad5bab-ab32-47fc-b7e8-b32282b9c20d" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:35:59 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Acquired lock "refresh_cache-03ad5bab-ab32-47fc-b7e8-b32282b9c20d" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:35:59 user nova-compute[72418]: DEBUG nova.network.neutron [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:35:59 user nova-compute[72418]: DEBUG nova.compute.manager [req-86aae4c3-c1e8-486d-ad98-de585304ed84 req-74dd2367-dfd4-439d-98ac-f9b8d6083495 service nova] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Received event network-vif-plugged-07c05457-6d05-4961-9642-02b3db4901c4 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:35:59 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-86aae4c3-c1e8-486d-ad98-de585304ed84 req-74dd2367-dfd4-439d-98ac-f9b8d6083495 service nova] Acquiring lock "97f49889-df0b-48c1-97ce-5c331b6a65ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:35:59 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-86aae4c3-c1e8-486d-ad98-de585304ed84 req-74dd2367-dfd4-439d-98ac-f9b8d6083495 service nova] Lock "97f49889-df0b-48c1-97ce-5c331b6a65ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:35:59 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-86aae4c3-c1e8-486d-ad98-de585304ed84 req-74dd2367-dfd4-439d-98ac-f9b8d6083495 service nova] Lock "97f49889-df0b-48c1-97ce-5c331b6a65ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:35:59 user nova-compute[72418]: DEBUG nova.compute.manager [req-86aae4c3-c1e8-486d-ad98-de585304ed84 req-74dd2367-dfd4-439d-98ac-f9b8d6083495 service nova] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] No waiting events found dispatching network-vif-plugged-07c05457-6d05-4961-9642-02b3db4901c4 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:35:59 user nova-compute[72418]: WARNING nova.compute.manager [req-86aae4c3-c1e8-486d-ad98-de585304ed84 req-74dd2367-dfd4-439d-98ac-f9b8d6083495 service nova] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Received unexpected event network-vif-plugged-07c05457-6d05-4961-9642-02b3db4901c4 for instance with vm_state building and task_state spawning.
Aug 09 18:35:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/232a6438132c52ece060772b37bf5ee692b43908.part /opt/stack/data/nova/instances/_base/232a6438132c52ece060772b37bf5ee692b43908.converted" returned: 0 in 0.761s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/232a6438132c52ece060772b37bf5ee692b43908.converted --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/232a6438132c52ece060772b37bf5ee692b43908.converted --force-share --output=json" returned: 0 in 0.163s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:35:59 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "232a6438132c52ece060772b37bf5ee692b43908" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.292s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:35:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/232a6438132c52ece060772b37bf5ee692b43908 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:35:59 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691606159.932046, 97f49889-df0b-48c1-97ce-5c331b6a65ce => Resumed> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:35:59 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] VM Resumed (Lifecycle Event)
Aug 09 18:35:59 user nova-compute[72418]: DEBUG nova.compute.manager [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Instance event wait completed in 0 seconds for  {{(pid=72418) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 18:35:59 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Guest created on hypervisor {{(pid=72418) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 18:35:59 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Instance spawned successfully.
Aug 09 18:35:59 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 18:35:59 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:35:59 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:36:00 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:36:00 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691606159.9327662, 97f49889-df0b-48c1-97ce-5c331b6a65ce => Started> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:36:00 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] VM Started (Lifecycle Event)
Aug 09 18:36:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Found default for hw_cdrom_bus of ide {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Found default for hw_disk_bus of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Found default for hw_input_bus of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Found default for hw_pointer_model of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Found default for hw_video_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Found default for hw_vif_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/232a6438132c52ece060772b37bf5ee692b43908 --force-share --output=json" returned: 0 in 0.177s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Acquiring lock "232a6438132c52ece060772b37bf5ee692b43908" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "232a6438132c52ece060772b37bf5ee692b43908" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/232a6438132c52ece060772b37bf5ee692b43908 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG nova.network.neutron [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Updating instance_info_cache with network_info: [{"id": "ea92909f-40d7-48a8-be09-50439674945c", "address": "fa:16:3e:3e:5e:e7", "network": {"id": "8354f86b-1e91-42ca-9847-769bb0aadcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-664289957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405587d223d54c5ab4f72a1994ac2862", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea92909f-40", "ovs_interfaceid": "ea92909f-40d7-48a8-be09-50439674945c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Releasing lock "refresh_cache-03ad5bab-ab32-47fc-b7e8-b32282b9c20d" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:36:00 user nova-compute[72418]: INFO nova.compute.manager [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Took 7.70 seconds to spawn the instance on the hypervisor.
Aug 09 18:36:00 user nova-compute[72418]: DEBUG nova.compute.manager [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Creating tmpfile /opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/tmpy9sg6u2q to verify with other compute node that the instance is on the same shared storage. {{(pid=72418) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 09 18:36:00 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:36:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/232a6438132c52ece060772b37bf5ee692b43908 --force-share --output=json" returned: 0 in 0.163s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/232a6438132c52ece060772b37bf5ee692b43908,backing_fmt=raw /opt/stack/data/nova/instances/873654d4-9cf2-4dde-859c-ad26d05d6e0a/disk 1073741824 {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:00 user nova-compute[72418]: INFO nova.compute.manager [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Took 8.95 seconds to build instance.
Aug 09 18:36:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/232a6438132c52ece060772b37bf5ee692b43908,backing_fmt=raw /opt/stack/data/nova/instances/873654d4-9cf2-4dde-859c-ad26d05d6e0a/disk 1073741824" returned: 0 in 0.066s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "232a6438132c52ece060772b37bf5ee692b43908" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/232a6438132c52ece060772b37bf5ee692b43908 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-5b47fdf1-b8a8-49d0-92fb-f976772f817d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "97f49889-df0b-48c1-97ce-5c331b6a65ce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.156s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.353s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG nova.compute.manager [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Start building networks asynchronously for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG nova.network.neutron [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Updating instance_info_cache with network_info: [{"id": "2b44ecc4-13c5-43ba-8425-5f42d86bc716", "address": "fa:16:3e:8d:41:82", "network": {"id": "15a49d9b-3c0d-449b-9473-29f219960e2c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c68622cd79472ba6ad14a6876aeaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b44ecc4-13", "ovs_interfaceid": "2b44ecc4-13c5-43ba-8425-5f42d86bc716", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/232a6438132c52ece060772b37bf5ee692b43908 --force-share --output=json" returned: 0 in 0.141s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG nova.objects.instance [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lazy-loading 'migration_context' on Instance uuid 873654d4-9cf2-4dde-859c-ad26d05d6e0a {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Created local disks {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Ensure instance console log exists: /opt/stack/data/nova/instances/873654d4-9cf2-4dde-859c-ad26d05d6e0a/console.log {{(pid=72418) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Releasing lock "refresh_cache-6af7918a-ce90-45ab-93d8-684e1489e891" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Updated the network info_cache for instance {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG nova.compute.manager [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Allocating IP information in the background. {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG nova.network.neutron [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] allocate_for_instance() {{(pid=72418) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 18:36:00 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 18:36:00 user nova-compute[72418]: DEBUG nova.compute.manager [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Start building block device mappings for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG nova.compute.manager [req-bbeb3717-4e5a-4a81-a274-b207a84c6196 req-47d709be-266a-4f8e-bede-14274e95b0ee service nova] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Received event network-vif-unplugged-ea92909f-40d7-48a8-be09-50439674945c {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-bbeb3717-4e5a-4a81-a274-b207a84c6196 req-47d709be-266a-4f8e-bede-14274e95b0ee service nova] Acquiring lock "03ad5bab-ab32-47fc-b7e8-b32282b9c20d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-bbeb3717-4e5a-4a81-a274-b207a84c6196 req-47d709be-266a-4f8e-bede-14274e95b0ee service nova] Lock "03ad5bab-ab32-47fc-b7e8-b32282b9c20d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-bbeb3717-4e5a-4a81-a274-b207a84c6196 req-47d709be-266a-4f8e-bede-14274e95b0ee service nova] Lock "03ad5bab-ab32-47fc-b7e8-b32282b9c20d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG nova.compute.manager [req-bbeb3717-4e5a-4a81-a274-b207a84c6196 req-47d709be-266a-4f8e-bede-14274e95b0ee service nova] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] No waiting events found dispatching network-vif-unplugged-ea92909f-40d7-48a8-be09-50439674945c {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:36:00 user nova-compute[72418]: WARNING nova.compute.manager [req-bbeb3717-4e5a-4a81-a274-b207a84c6196 req-47d709be-266a-4f8e-bede-14274e95b0ee service nova] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Received unexpected event network-vif-unplugged-ea92909f-40d7-48a8-be09-50439674945c for instance with vm_state resized and task_state resize_reverting.
Aug 09 18:36:00 user nova-compute[72418]: DEBUG nova.compute.manager [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Start spawning the instance on the hypervisor. {{(pid=72418) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Creating instance directory {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 18:36:00 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Creating image(s)
Aug 09 18:36:00 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Acquiring lock "/opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Lock "/opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Lock "/opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG nova.policy [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8ec7129a7bf6444ab241ca8dc20211fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d09208fba747f29a90f95c5bb5ee4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72418) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Auditing locally available compute resources for user (node: user) {{(pid=72418) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.177s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Acquiring lock "458773cfa7230b717e41c60277832e9f83806d71" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.008s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:36:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.140s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/disk 1073741824 {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/disk 1073741824" returned: 0 in 0.071s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:01 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Instance destroyed successfully.
Aug 09 18:36:01 user nova-compute[72418]: DEBUG nova.objects.instance [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lazy-loading 'resources' on Instance uuid 03ad5bab-ab32-47fc-b7e8-b32282b9c20d {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:30:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1873430052',display_name='tempest-ServerActionsTestOtherB-server-1873430052',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1873430052',id=22,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIcobG4HnuTYOQnNQv/MwdYT3LE/RLnOlgxtm9ZW7mVchwGrvFEE/XUOIJNiUK2ZNsyoG2e4ALumseJiS6y2HeRcRosbaQtxOHGtF7A55P++8WqVj1ISNQq63FhVymDdqQ==',key_name='tempest-keypair-1241971956',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:34:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='405587d223d54c5ab4f72a1994ac2862',ramdisk_id='',reservation_id='r-y3ado2eg',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1643003262',owner_user_name='tempest-ServerActionsTestOtherB-1643003262-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:34:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8174362ccd88488d867db28e18906a62',uuid=03ad5bab-ab32-47fc-b7e8-b32282b9c20d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "ea92909f-40d7-48a8-be09-50439674945c", "address": "fa:16:3e:3e:5e:e7", "network": {"id": "8354f86b-1e91-42ca-9847-769bb0aadcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-664289957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405587d223d54c5ab4f72a1994ac2862", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea92909f-40", "ovs_interfaceid": "ea92909f-40d7-48a8-be09-50439674945c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Converting VIF {"id": "ea92909f-40d7-48a8-be09-50439674945c", "address": "fa:16:3e:3e:5e:e7", "network": {"id": "8354f86b-1e91-42ca-9847-769bb0aadcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-664289957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405587d223d54c5ab4f72a1994ac2862", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea92909f-40", "ovs_interfaceid": "ea92909f-40d7-48a8-be09-50439674945c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:5e:e7,bridge_name='br-int',has_traffic_filtering=True,id=ea92909f-40d7-48a8-be09-50439674945c,network=Network(8354f86b-1e91-42ca-9847-769bb0aadcd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea92909f-40') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG os_vif [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:5e:e7,bridge_name='br-int',has_traffic_filtering=True,id=ea92909f-40d7-48a8-be09-50439674945c,network=Network(8354f86b-1e91-42ca-9847-769bb0aadcd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea92909f-40') {{(pid=72418) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea92909f-40, bridge=br-int, if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:36:01 user nova-compute[72418]: INFO os_vif [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:5e:e7,bridge_name='br-int',has_traffic_filtering=True,id=ea92909f-40d7-48a8-be09-50439674945c,network=Network(8354f86b-1e91-42ca-9847-769bb0aadcd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea92909f-40')
Aug 09 18:36:01 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] calling os-brick to detach iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, {'target_iqns': ['iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EzlWwnfa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:36:01 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:36:01 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71', 0)] {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG nova.network.neutron [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Successfully updated port: 396cd02b-9a02-4b77-b06b-6253ca90f538 {{(pid=72418) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.171s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/disk. size=1073741824 {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[199c0900-7184-40d0-94ce-30907758528a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Acquiring lock "refresh_cache-873654d4-9cf2-4dde-859c-ad26d05d6e0a" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Acquired lock "refresh_cache-873654d4-9cf2-4dde-859c-ad26d05d6e0a" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG nova.network.neutron [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[0663c715-4c57-4f8c-91ec-0759ae69b620]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:36:01 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:36:01 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:36:01 user nova-compute[72418]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:36:01 user nova-compute[72418]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)
Aug 09 18:36:01 user nova-compute[72418]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6 (non-flash)
Aug 09 18:36:01 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:36:01 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:36:01 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:36:01 user nova-compute[72418]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:36:01 user nova-compute[72418]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)
Aug 09 18:36:01 user nova-compute[72418]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6 (non-flash)
Aug 09 18:36:01 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f42f82ce290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71'): ({'sdd'}, set())}) {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Removing single pathed devices sdd {{(pid=72418) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.032s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e72d2b-9ddf-4b07-8112-6c20c2f67750]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Cannot resize image /opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/disk to a smaller size. {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG nova.objects.instance [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Lazy-loading 'migration_context' on Instance uuid 4e1a095f-a2e7-4ab6-bb7e-38cda890d567 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa009f71-c61b-4ca5-9922-cfbbc75341ca]: (4, ('ok\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Flushing IO for device /dev/sdd {{(pid=72418) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Created local disks {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Ensure instance console log exists: /opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/console.log {{(pid=72418) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.028s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[453f030a-a2be-44e0-a310-5a062b8d0e68]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72418) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9ac169-5dc1-42ee-966b-d7fa2ebd446a]: (4, ('1', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] SCSI volumes sdd have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71')] {{(pid=72418) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG nova.network.neutron [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Instance cache missing network info. {{(pid=72418) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[958dc338-c852-46a2-b7df-599b2e5a06b6]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --logout {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --logout" returned: 0 in 0.089s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee33713d-4944-4909-871d-91093840343e]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71, portal: 172.16.0.220,3260]
Aug 09 18:36:01 user nova-compute[72418]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71, portal: 172.16.0.220,3260] successful.
Aug 09 18:36:01 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --op delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[49380fba-fb47-4d9f-a1b3-6786800eb530]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.506s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] <== disconnect_volume: return (508ms) None {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Disconnected iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:01 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c53f871-2be9-4119-b5c0-d5081e2f4388/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c53f871-2be9-4119-b5c0-d5081e2f4388/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c53f871-2be9-4119-b5c0-d5081e2f4388/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:02 user nova-compute[72418]: DEBUG nova.network.neutron [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Updating instance_info_cache with network_info: [{"id": "396cd02b-9a02-4b77-b06b-6253ca90f538", "address": "fa:16:3e:47:8e:5a", "network": {"id": "0fbd02ef-7c74-46c2-a09c-3b69be222ffa", "bridge": "br-int", "label": "tempest-TestStampPattern-85008345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce18df915bca48109597ad4aa8f1d116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap396cd02b-9a", "ovs_interfaceid": "396cd02b-9a02-4b77-b06b-6253ca90f538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:36:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c53f871-2be9-4119-b5c0-d5081e2f4388/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:02 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:36:02 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:36:02 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Error from libvirt while getting description of instance-00000016: [Error Code 42] Domain not found: no domain with matching uuid '03ad5bab-ab32-47fc-b7e8-b32282b9c20d' (instance-00000016): libvirt.libvirtError: Domain not found: no domain with matching uuid '03ad5bab-ab32-47fc-b7e8-b32282b9c20d' (instance-00000016)
Aug 09 18:36:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9e974b-b993-4f4e-9446-14941c39f109/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:02 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Releasing lock "refresh_cache-873654d4-9cf2-4dde-859c-ad26d05d6e0a" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:36:02 user nova-compute[72418]: DEBUG nova.compute.manager [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Instance network_info: |[{"id": "396cd02b-9a02-4b77-b06b-6253ca90f538", "address": "fa:16:3e:47:8e:5a", "network": {"id": "0fbd02ef-7c74-46c2-a09c-3b69be222ffa", "bridge": "br-int", "label": "tempest-TestStampPattern-85008345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce18df915bca48109597ad4aa8f1d116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap396cd02b-9a", "ovs_interfaceid": "396cd02b-9a02-4b77-b06b-6253ca90f538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 18:36:02 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Start _get_guest_xml network_info=[{"id": "396cd02b-9a02-4b77-b06b-6253ca90f538", "address": "fa:16:3e:47:8e:5a", "network": {"id": "0fbd02ef-7c74-46c2-a09c-3b69be222ffa", "bridge": "br-int", "label": "tempest-TestStampPattern-85008345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce18df915bca48109597ad4aa8f1d116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap396cd02b-9a", "ovs_interfaceid": "396cd02b-9a02-4b77-b06b-6253ca90f538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='051b0918c9b4c6c7b5552bbe8ccfc5f7',container_format='bare',created_at=2023-08-09T18:35:46Z,direct_url=<?>,disk_format='qcow2',id=0a633be0-827f-4c6d-a40e-5896a0bc9bcf,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-421756622',owner='ce18df915bca48109597ad4aa8f1d116',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-09T18:35:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '0a633be0-827f-4c6d-a40e-5896a0bc9bcf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 18:36:02 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:36:02 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:36:02 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 18:36:02 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] CPU controller missing on host. {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 18:36:02 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 18:36:02 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] CPU controller found on host. {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 18:36:02 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72418) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 18:36:02 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T18:17:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='051b0918c9b4c6c7b5552bbe8ccfc5f7',container_format='bare',created_at=2023-08-09T18:35:46Z,direct_url=<?>,disk_format='qcow2',id=0a633be0-827f-4c6d-a40e-5896a0bc9bcf,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-421756622',owner='ce18df915bca48109597ad4aa8f1d116',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-09T18:35:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 18:36:02 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Flavor limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 18:36:02 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Image limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 18:36:02 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Flavor pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 18:36:02 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Image pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 18:36:02 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 18:36:02 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 18:36:02 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 18:36:02 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Got 1 possible topologies {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 18:36:02 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 18:36:02 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 18:36:02 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:35:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-42037781',display_name='tempest-TestStampPattern-server-42037781',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-42037781',id=31,image_ref='0a633be0-827f-4c6d-a40e-5896a0bc9bcf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyuC2STmNW21KgmVvu2UdySlXVI+0J2CQB6cC/06BFGS91M3K5pktxtEHOvDqMzVGj1CpM11aZmLQ8ny2sqKin/VSPS9fza7lm5UGhSckLWpV1uBCIlOPx80Bbo9A16oA==',key_name='tempest-TestStampPattern-872776389',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce18df915bca48109597ad4aa8f1d116',ramdisk_id='',reservation_id='r-i1popns8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='2c9e974b-b993-4f4e-9446-14941c39f109',image_min_disk='1',image_min_ram='0',image_owner_id='ce18df915bca48109597ad4aa8f1d116',image_owner_project_name='tempest-TestStampPattern-1349806997',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1349806997-project-member',image_user_id='2af66759bfa54ffba6174c4f95a83789',network_allocated='True',owner_project_name='tempest-TestStampPattern-1349806997',owner_user_name='tempest-TestStampPattern-1349806997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:35:57Z,user_data=None,user_id='2af66759bfa54ffba6174c4f95a83789',uuid=873654d4-9cf2-4dde-859c-ad26d05d6e0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "396cd02b-9a02-4b77-b06b-6253ca90f538", "address": "fa:16:3e:47:8e:5a", "network": {"id": "0fbd02ef-7c74-46c2-a09c-3b69be222ffa", "bridge": "br-int", "label": "tempest-TestStampPattern-85008345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce18df915bca48109597ad4aa8f1d116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap396cd02b-9a", "ovs_interfaceid": "396cd02b-9a02-4b77-b06b-6253ca90f538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:36:02 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Converting VIF {"id": "396cd02b-9a02-4b77-b06b-6253ca90f538", "address": "fa:16:3e:47:8e:5a", "network": {"id": "0fbd02ef-7c74-46c2-a09c-3b69be222ffa", "bridge": "br-int", "label": "tempest-TestStampPattern-85008345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce18df915bca48109597ad4aa8f1d116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap396cd02b-9a", "ovs_interfaceid": "396cd02b-9a02-4b77-b06b-6253ca90f538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:36:02 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:8e:5a,bridge_name='br-int',has_traffic_filtering=True,id=396cd02b-9a02-4b77-b06b-6253ca90f538,network=Network(0fbd02ef-7c74-46c2-a09c-3b69be222ffa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap396cd02b-9a') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:36:02 user nova-compute[72418]: DEBUG nova.objects.instance [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lazy-loading 'pci_devices' on Instance uuid 873654d4-9cf2-4dde-859c-ad26d05d6e0a {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:36:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9e974b-b993-4f4e-9446-14941c39f109/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9e974b-b993-4f4e-9446-14941c39f109/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:02 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] End _get_guest_xml xml=<domain type="kvm">
Aug 09 18:36:02 user nova-compute[72418]:   <uuid>873654d4-9cf2-4dde-859c-ad26d05d6e0a</uuid>
Aug 09 18:36:02 user nova-compute[72418]:   <name>instance-0000001f</name>
Aug 09 18:36:02 user nova-compute[72418]:   <memory>524288</memory>
Aug 09 18:36:02 user nova-compute[72418]:   <vcpu>1</vcpu>
Aug 09 18:36:02 user nova-compute[72418]:   <metadata>
Aug 09 18:36:02 user nova-compute[72418]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:36:02 user nova-compute[72418]:       <nova:package version="0.0.0"/>
Aug 09 18:36:02 user nova-compute[72418]:       <nova:name>tempest-TestStampPattern-server-42037781</nova:name>
Aug 09 18:36:02 user nova-compute[72418]:       <nova:creationTime>2023-08-09 18:36:02</nova:creationTime>
Aug 09 18:36:02 user nova-compute[72418]:       <nova:flavor name="m1.tiny">
Aug 09 18:36:02 user nova-compute[72418]:         <nova:memory>512</nova:memory>
Aug 09 18:36:02 user nova-compute[72418]:         <nova:disk>1</nova:disk>
Aug 09 18:36:02 user nova-compute[72418]:         <nova:swap>0</nova:swap>
Aug 09 18:36:02 user nova-compute[72418]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:36:02 user nova-compute[72418]:         <nova:vcpus>1</nova:vcpus>
Aug 09 18:36:02 user nova-compute[72418]:       </nova:flavor>
Aug 09 18:36:02 user nova-compute[72418]:       <nova:owner>
Aug 09 18:36:02 user nova-compute[72418]:         <nova:user uuid="2af66759bfa54ffba6174c4f95a83789">tempest-TestStampPattern-1349806997-project-member</nova:user>
Aug 09 18:36:02 user nova-compute[72418]:         <nova:project uuid="ce18df915bca48109597ad4aa8f1d116">tempest-TestStampPattern-1349806997</nova:project>
Aug 09 18:36:02 user nova-compute[72418]:       </nova:owner>
Aug 09 18:36:02 user nova-compute[72418]:       <nova:root type="image" uuid="0a633be0-827f-4c6d-a40e-5896a0bc9bcf"/>
Aug 09 18:36:02 user nova-compute[72418]:       <nova:ports>
Aug 09 18:36:02 user nova-compute[72418]:         <nova:port uuid="396cd02b-9a02-4b77-b06b-6253ca90f538">
Aug 09 18:36:02 user nova-compute[72418]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 09 18:36:02 user nova-compute[72418]:         </nova:port>
Aug 09 18:36:02 user nova-compute[72418]:       </nova:ports>
Aug 09 18:36:02 user nova-compute[72418]:     </nova:instance>
Aug 09 18:36:02 user nova-compute[72418]:   </metadata>
Aug 09 18:36:02 user nova-compute[72418]:   <sysinfo type="smbios">
Aug 09 18:36:02 user nova-compute[72418]:     <system>
Aug 09 18:36:02 user nova-compute[72418]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 18:36:02 user nova-compute[72418]:       <entry name="product">OpenStack Nova</entry>
Aug 09 18:36:02 user nova-compute[72418]:       <entry name="version">0.0.0</entry>
Aug 09 18:36:02 user nova-compute[72418]:       <entry name="serial">873654d4-9cf2-4dde-859c-ad26d05d6e0a</entry>
Aug 09 18:36:02 user nova-compute[72418]:       <entry name="uuid">873654d4-9cf2-4dde-859c-ad26d05d6e0a</entry>
Aug 09 18:36:02 user nova-compute[72418]:       <entry name="family">Virtual Machine</entry>
Aug 09 18:36:02 user nova-compute[72418]:     </system>
Aug 09 18:36:02 user nova-compute[72418]:   </sysinfo>
Aug 09 18:36:02 user nova-compute[72418]:   <os>
Aug 09 18:36:02 user nova-compute[72418]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 18:36:02 user nova-compute[72418]:     <boot dev="hd"/>
Aug 09 18:36:02 user nova-compute[72418]:     <smbios mode="sysinfo"/>
Aug 09 18:36:02 user nova-compute[72418]:   </os>
Aug 09 18:36:02 user nova-compute[72418]:   <features>
Aug 09 18:36:02 user nova-compute[72418]:     <acpi/>
Aug 09 18:36:02 user nova-compute[72418]:     <apic/>
Aug 09 18:36:02 user nova-compute[72418]:     <vmcoreinfo/>
Aug 09 18:36:02 user nova-compute[72418]:   </features>
Aug 09 18:36:02 user nova-compute[72418]:   <clock offset="utc">
Aug 09 18:36:02 user nova-compute[72418]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 18:36:02 user nova-compute[72418]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 18:36:02 user nova-compute[72418]:     <timer name="hpet" present="no"/>
Aug 09 18:36:02 user nova-compute[72418]:   </clock>
Aug 09 18:36:02 user nova-compute[72418]:   <cpu mode="custom" match="exact">
Aug 09 18:36:02 user nova-compute[72418]:     <model>Nehalem</model>
Aug 09 18:36:02 user nova-compute[72418]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 18:36:02 user nova-compute[72418]:   </cpu>
Aug 09 18:36:02 user nova-compute[72418]:   <devices>
Aug 09 18:36:02 user nova-compute[72418]:     <disk type="file" device="disk">
Aug 09 18:36:02 user nova-compute[72418]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 18:36:02 user nova-compute[72418]:       <source file="/opt/stack/data/nova/instances/873654d4-9cf2-4dde-859c-ad26d05d6e0a/disk"/>
Aug 09 18:36:02 user nova-compute[72418]:       <target dev="vda" bus="virtio"/>
Aug 09 18:36:02 user nova-compute[72418]:     </disk>
Aug 09 18:36:02 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:36:02 user nova-compute[72418]:       <mac address="fa:16:3e:47:8e:5a"/>
Aug 09 18:36:02 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:36:02 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:36:02 user nova-compute[72418]:       <target dev="tap396cd02b-9a"/>
Aug 09 18:36:02 user nova-compute[72418]:     </interface>
Aug 09 18:36:02 user nova-compute[72418]:     <serial type="pty">
Aug 09 18:36:02 user nova-compute[72418]:       <log file="/opt/stack/data/nova/instances/873654d4-9cf2-4dde-859c-ad26d05d6e0a/console.log" append="off"/>
Aug 09 18:36:02 user nova-compute[72418]:     </serial>
Aug 09 18:36:02 user nova-compute[72418]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 18:36:02 user nova-compute[72418]:     <video>
Aug 09 18:36:02 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:36:02 user nova-compute[72418]:     </video>
Aug 09 18:36:02 user nova-compute[72418]:     <rng model="virtio">
Aug 09 18:36:02 user nova-compute[72418]:       <backend model="random">/dev/urandom</backend>
Aug 09 18:36:02 user nova-compute[72418]:     </rng>
Aug 09 18:36:02 user nova-compute[72418]:     <controller type="usb" index="0" model="none"/>
Aug 09 18:36:02 user nova-compute[72418]:     <memballoon model="virtio">
Aug 09 18:36:02 user nova-compute[72418]:       <stats period="10"/>
Aug 09 18:36:02 user nova-compute[72418]:     </memballoon>
Aug 09 18:36:02 user nova-compute[72418]:   </devices>
Aug 09 18:36:02 user nova-compute[72418]: </domain>
Aug 09 18:36:02 user nova-compute[72418]:  {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 18:36:02 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:35:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-42037781',display_name='tempest-TestStampPattern-server-42037781',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-42037781',id=31,image_ref='0a633be0-827f-4c6d-a40e-5896a0bc9bcf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyuC2STmNW21KgmVvu2UdySlXVI+0J2CQB6cC/06BFGS91M3K5pktxtEHOvDqMzVGj1CpM11aZmLQ8ny2sqKin/VSPS9fza7lm5UGhSckLWpV1uBCIlOPx80Bbo9A16oA==',key_name='tempest-TestStampPattern-872776389',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce18df915bca48109597ad4aa8f1d116',ramdisk_id='',reservation_id='r-i1popns8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='2c9e974b-b993-4f4e-9446-14941c39f109',image_min_disk='1',image_min_ram='0',image_owner_id='ce18df915bca48109597ad4aa8f1d116',image_owner_project_name='tempest-TestStampPattern-1349806997',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1349806997-project-member',image_user_id='2af66759bfa54ffba6174c4f95a83789',network_allocated='True',owner_project_name='tempest-TestStampPattern-1349806997',owner_user_name='tempest-TestStampPattern-1349806997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:35:57Z,user_data=None,user_id='2af66759bfa54ffba6174c4f95a83789',uuid=873654d4-9cf2-4dde-859c-ad26d05d6e0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "396cd02b-9a02-4b77-b06b-6253ca90f538", "address": "fa:16:3e:47:8e:5a", "network": {"id": "0fbd02ef-7c74-46c2-a09c-3b69be222ffa", "bridge": "br-int", "label": "tempest-TestStampPattern-85008345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce18df915bca48109597ad4aa8f1d116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap396cd02b-9a", "ovs_interfaceid": "396cd02b-9a02-4b77-b06b-6253ca90f538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:36:02 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Converting VIF {"id": "396cd02b-9a02-4b77-b06b-6253ca90f538", "address": "fa:16:3e:47:8e:5a", "network": {"id": "0fbd02ef-7c74-46c2-a09c-3b69be222ffa", "bridge": "br-int", "label": "tempest-TestStampPattern-85008345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce18df915bca48109597ad4aa8f1d116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap396cd02b-9a", "ovs_interfaceid": "396cd02b-9a02-4b77-b06b-6253ca90f538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:36:02 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:8e:5a,bridge_name='br-int',has_traffic_filtering=True,id=396cd02b-9a02-4b77-b06b-6253ca90f538,network=Network(0fbd02ef-7c74-46c2-a09c-3b69be222ffa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap396cd02b-9a') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:36:02 user nova-compute[72418]: DEBUG os_vif [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:8e:5a,bridge_name='br-int',has_traffic_filtering=True,id=396cd02b-9a02-4b77-b06b-6253ca90f538,network=Network(0fbd02ef-7c74-46c2-a09c-3b69be222ffa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap396cd02b-9a') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:36:02 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:36:02 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:36:02 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:36:02 user nova-compute[72418]: DEBUG nova.network.neutron [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Successfully created port: e6df16f7-7151-450f-bbf8-dc3be066011e {{(pid=72418) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 18:36:02 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:36:02 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap396cd02b-9a, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:36:02 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap396cd02b-9a, col_values=(('external_ids', {'iface-id': '396cd02b-9a02-4b77-b06b-6253ca90f538', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:8e:5a', 'vm-uuid': '873654d4-9cf2-4dde-859c-ad26d05d6e0a'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:36:02 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:36:02 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:36:02 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:36:02 user nova-compute[72418]: INFO os_vif [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:8e:5a,bridge_name='br-int',has_traffic_filtering=True,id=396cd02b-9a02-4b77-b06b-6253ca90f538,network=Network(0fbd02ef-7c74-46c2-a09c-3b69be222ffa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap396cd02b-9a')
Aug 09 18:36:02 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:36:02 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] No VIF found with MAC fa:16:3e:47:8e:5a, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:36:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9e974b-b993-4f4e-9446-14941c39f109/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json" returned: 0 in 0.159s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:02 user nova-compute[72418]: DEBUG nova.compute.manager [req-bdc96c9d-87b6-43b7-a119-55e923605122 req-bb6f63a0-3194-4939-a922-70aa1a393eaa service nova] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Received event network-changed-396cd02b-9a02-4b77-b06b-6253ca90f538 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:36:02 user nova-compute[72418]: DEBUG nova.compute.manager [req-bdc96c9d-87b6-43b7-a119-55e923605122 req-bb6f63a0-3194-4939-a922-70aa1a393eaa service nova] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Refreshing instance network info cache due to event network-changed-396cd02b-9a02-4b77-b06b-6253ca90f538. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:36:02 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-bdc96c9d-87b6-43b7-a119-55e923605122 req-bb6f63a0-3194-4939-a922-70aa1a393eaa service nova] Acquiring lock "refresh_cache-873654d4-9cf2-4dde-859c-ad26d05d6e0a" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:36:02 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-bdc96c9d-87b6-43b7-a119-55e923605122 req-bb6f63a0-3194-4939-a922-70aa1a393eaa service nova] Acquired lock "refresh_cache-873654d4-9cf2-4dde-859c-ad26d05d6e0a" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:36:02 user nova-compute[72418]: DEBUG nova.network.neutron [req-bdc96c9d-87b6-43b7-a119-55e923605122 req-bb6f63a0-3194-4939-a922-70aa1a393eaa service nova] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Refreshing network info cache for port 396cd02b-9a02-4b77-b06b-6253ca90f538 {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:36:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:36:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:36:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:36:03 user nova-compute[72418]: DEBUG nova.objects.instance [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lazy-loading 'migration_context' on Instance uuid 03ad5bab-ab32-47fc-b7e8-b32282b9c20d {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:36:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:03 user nova-compute[72418]: DEBUG nova.network.neutron [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Successfully updated port: e6df16f7-7151-450f-bbf8-dc3be066011e {{(pid=72418) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 18:36:03 user nova-compute[72418]: DEBUG nova.network.neutron [req-bdc96c9d-87b6-43b7-a119-55e923605122 req-bb6f63a0-3194-4939-a922-70aa1a393eaa service nova] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Updated VIF entry in instance network info cache for port 396cd02b-9a02-4b77-b06b-6253ca90f538. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:36:03 user nova-compute[72418]: DEBUG nova.network.neutron [req-bdc96c9d-87b6-43b7-a119-55e923605122 req-bb6f63a0-3194-4939-a922-70aa1a393eaa service nova] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Updating instance_info_cache with network_info: [{"id": "396cd02b-9a02-4b77-b06b-6253ca90f538", "address": "fa:16:3e:47:8e:5a", "network": {"id": "0fbd02ef-7c74-46c2-a09c-3b69be222ffa", "bridge": "br-int", "label": "tempest-TestStampPattern-85008345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce18df915bca48109597ad4aa8f1d116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap396cd02b-9a", "ovs_interfaceid": "396cd02b-9a02-4b77-b06b-6253ca90f538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:36:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Acquiring lock "refresh_cache-4e1a095f-a2e7-4ab6-bb7e-38cda890d567" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:36:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Acquired lock "refresh_cache-4e1a095f-a2e7-4ab6-bb7e-38cda890d567" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:36:03 user nova-compute[72418]: DEBUG nova.network.neutron [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:36:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-bdc96c9d-87b6-43b7-a119-55e923605122 req-bb6f63a0-3194-4939-a922-70aa1a393eaa service nova] Releasing lock "refresh_cache-873654d4-9cf2-4dde-859c-ad26d05d6e0a" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:36:03 user nova-compute[72418]: DEBUG nova.compute.manager [req-bdc96c9d-87b6-43b7-a119-55e923605122 req-bb6f63a0-3194-4939-a922-70aa1a393eaa service nova] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Received event network-vif-plugged-ea92909f-40d7-48a8-be09-50439674945c {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:36:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-bdc96c9d-87b6-43b7-a119-55e923605122 req-bb6f63a0-3194-4939-a922-70aa1a393eaa service nova] Acquiring lock "03ad5bab-ab32-47fc-b7e8-b32282b9c20d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:36:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-bdc96c9d-87b6-43b7-a119-55e923605122 req-bb6f63a0-3194-4939-a922-70aa1a393eaa service nova] Lock "03ad5bab-ab32-47fc-b7e8-b32282b9c20d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:36:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-bdc96c9d-87b6-43b7-a119-55e923605122 req-bb6f63a0-3194-4939-a922-70aa1a393eaa service nova] Lock "03ad5bab-ab32-47fc-b7e8-b32282b9c20d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:36:03 user nova-compute[72418]: DEBUG nova.compute.manager [req-bdc96c9d-87b6-43b7-a119-55e923605122 req-bb6f63a0-3194-4939-a922-70aa1a393eaa service nova] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] No waiting events found dispatching network-vif-plugged-ea92909f-40d7-48a8-be09-50439674945c {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:36:03 user nova-compute[72418]: WARNING nova.compute.manager [req-bdc96c9d-87b6-43b7-a119-55e923605122 req-bb6f63a0-3194-4939-a922-70aa1a393eaa service nova] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Received unexpected event network-vif-plugged-ea92909f-40d7-48a8-be09-50439674945c for instance with vm_state resized and task_state resize_reverting.
Aug 09 18:36:03 user nova-compute[72418]: DEBUG nova.network.neutron [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Instance cache missing network info. {{(pid=72418) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 18:36:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:03 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:36:03 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:36:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f49889-df0b-48c1-97ce-5c331b6a65ce/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f49889-df0b-48c1-97ce-5c331b6a65ce/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f49889-df0b-48c1-97ce-5c331b6a65ce/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG nova.network.neutron [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Updating instance_info_cache with network_info: [{"id": "e6df16f7-7151-450f-bbf8-dc3be066011e", "address": "fa:16:3e:42:1f:2f", "network": {"id": "aa563713-99b7-4830-bbc5-5390076a264d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1029161501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99d09208fba747f29a90f95c5bb5ee4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6df16f7-71", "ovs_interfaceid": "e6df16f7-7151-450f-bbf8-dc3be066011e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 1.018s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Releasing lock "refresh_cache-4e1a095f-a2e7-4ab6-bb7e-38cda890d567" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG nova.compute.manager [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Instance network_info: |[{"id": "e6df16f7-7151-450f-bbf8-dc3be066011e", "address": "fa:16:3e:42:1f:2f", "network": {"id": "aa563713-99b7-4830-bbc5-5390076a264d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1029161501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99d09208fba747f29a90f95c5bb5ee4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6df16f7-71", "ovs_interfaceid": "e6df16f7-7151-450f-bbf8-dc3be066011e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Start _get_guest_xml network_info=[{"id": "e6df16f7-7151-450f-bbf8-dc3be066011e", "address": "fa:16:3e:42:1f:2f", "network": {"id": "aa563713-99b7-4830-bbc5-5390076a264d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1029161501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99d09208fba747f29a90f95c5bb5ee4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6df16f7-71", "ovs_interfaceid": "e6df16f7-7151-450f-bbf8-dc3be066011e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 18:36:04 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:36:04 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:36:04 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] CPU controller missing on host. {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] CPU controller found on host. {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72418) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T18:17:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Flavor limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Image limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Flavor pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Image pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Got 1 possible topologies {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:35:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-282255292',display_name='tempest-ServerStableDeviceRescueTest-server-282255292',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-282255292',id=32,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgi7F7Tiv948MGw/JMyBSz5f1UT2yZOhFMKoN0Kxyc1NKE7bns5u1xaa+LItbZrpXzqSR4y26XuN7XvDcLQtVjZPLJIQgwHu1xdN7N2Gz0+VfLK4SeEyvDU0D1TyNj8Uw==',key_name='tempest-keypair-376055827',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99d09208fba747f29a90f95c5bb5ee4b',ramdisk_id='',reservation_id='r-10tk9714',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-307010011',owner_user_name='tempest-ServerStableDeviceRescueTest-307010011-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:36:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ec7129a7bf6444ab241ca8dc20211fd',uuid=4e1a095f-a2e7-4ab6-bb7e-38cda890d567,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6df16f7-7151-450f-bbf8-dc3be066011e", "address": "fa:16:3e:42:1f:2f", "network": {"id": "aa563713-99b7-4830-bbc5-5390076a264d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1029161501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99d09208fba747f29a90f95c5bb5ee4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6df16f7-71", "ovs_interfaceid": "e6df16f7-7151-450f-bbf8-dc3be066011e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Converting VIF {"id": "e6df16f7-7151-450f-bbf8-dc3be066011e", "address": "fa:16:3e:42:1f:2f", "network": {"id": "aa563713-99b7-4830-bbc5-5390076a264d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1029161501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99d09208fba747f29a90f95c5bb5ee4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6df16f7-71", "ovs_interfaceid": "e6df16f7-7151-450f-bbf8-dc3be066011e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:1f:2f,bridge_name='br-int',has_traffic_filtering=True,id=e6df16f7-7151-450f-bbf8-dc3be066011e,network=Network(aa563713-99b7-4830-bbc5-5390076a264d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6df16f7-71') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG nova.objects.instance [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Lazy-loading 'pci_devices' on Instance uuid 4e1a095f-a2e7-4ab6-bb7e-38cda890d567 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG nova.compute.manager [req-355d5386-5cf9-4c51-8b6b-3bdc02facf50 req-1ed7fc67-68d6-4775-87a5-6cac35e0f9ec service nova] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Received event network-vif-plugged-396cd02b-9a02-4b77-b06b-6253ca90f538 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-355d5386-5cf9-4c51-8b6b-3bdc02facf50 req-1ed7fc67-68d6-4775-87a5-6cac35e0f9ec service nova] Acquiring lock "873654d4-9cf2-4dde-859c-ad26d05d6e0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-355d5386-5cf9-4c51-8b6b-3bdc02facf50 req-1ed7fc67-68d6-4775-87a5-6cac35e0f9ec service nova] Lock "873654d4-9cf2-4dde-859c-ad26d05d6e0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-355d5386-5cf9-4c51-8b6b-3bdc02facf50 req-1ed7fc67-68d6-4775-87a5-6cac35e0f9ec service nova] Lock "873654d4-9cf2-4dde-859c-ad26d05d6e0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG nova.compute.manager [req-355d5386-5cf9-4c51-8b6b-3bdc02facf50 req-1ed7fc67-68d6-4775-87a5-6cac35e0f9ec service nova] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] No waiting events found dispatching network-vif-plugged-396cd02b-9a02-4b77-b06b-6253ca90f538 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:36:04 user nova-compute[72418]: WARNING nova.compute.manager [req-355d5386-5cf9-4c51-8b6b-3bdc02facf50 req-1ed7fc67-68d6-4775-87a5-6cac35e0f9ec service nova] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Received unexpected event network-vif-plugged-396cd02b-9a02-4b77-b06b-6253ca90f538 for instance with vm_state building and task_state spawning.
Aug 09 18:36:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f49889-df0b-48c1-97ce-5c331b6a65ce/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] End _get_guest_xml xml=<domain type="kvm">
Aug 09 18:36:04 user nova-compute[72418]:   <uuid>4e1a095f-a2e7-4ab6-bb7e-38cda890d567</uuid>
Aug 09 18:36:04 user nova-compute[72418]:   <name>instance-00000020</name>
Aug 09 18:36:04 user nova-compute[72418]:   <memory>524288</memory>
Aug 09 18:36:04 user nova-compute[72418]:   <vcpu>1</vcpu>
Aug 09 18:36:04 user nova-compute[72418]:   <metadata>
Aug 09 18:36:04 user nova-compute[72418]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:36:04 user nova-compute[72418]:       <nova:package version="0.0.0"/>
Aug 09 18:36:04 user nova-compute[72418]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-282255292</nova:name>
Aug 09 18:36:04 user nova-compute[72418]:       <nova:creationTime>2023-08-09 18:36:04</nova:creationTime>
Aug 09 18:36:04 user nova-compute[72418]:       <nova:flavor name="m1.tiny">
Aug 09 18:36:04 user nova-compute[72418]:         <nova:memory>512</nova:memory>
Aug 09 18:36:04 user nova-compute[72418]:         <nova:disk>1</nova:disk>
Aug 09 18:36:04 user nova-compute[72418]:         <nova:swap>0</nova:swap>
Aug 09 18:36:04 user nova-compute[72418]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:36:04 user nova-compute[72418]:         <nova:vcpus>1</nova:vcpus>
Aug 09 18:36:04 user nova-compute[72418]:       </nova:flavor>
Aug 09 18:36:04 user nova-compute[72418]:       <nova:owner>
Aug 09 18:36:04 user nova-compute[72418]:         <nova:user uuid="8ec7129a7bf6444ab241ca8dc20211fd">tempest-ServerStableDeviceRescueTest-307010011-project-member</nova:user>
Aug 09 18:36:04 user nova-compute[72418]:         <nova:project uuid="99d09208fba747f29a90f95c5bb5ee4b">tempest-ServerStableDeviceRescueTest-307010011</nova:project>
Aug 09 18:36:04 user nova-compute[72418]:       </nova:owner>
Aug 09 18:36:04 user nova-compute[72418]:       <nova:root type="image" uuid="8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e"/>
Aug 09 18:36:04 user nova-compute[72418]:       <nova:ports>
Aug 09 18:36:04 user nova-compute[72418]:         <nova:port uuid="e6df16f7-7151-450f-bbf8-dc3be066011e">
Aug 09 18:36:04 user nova-compute[72418]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 09 18:36:04 user nova-compute[72418]:         </nova:port>
Aug 09 18:36:04 user nova-compute[72418]:       </nova:ports>
Aug 09 18:36:04 user nova-compute[72418]:     </nova:instance>
Aug 09 18:36:04 user nova-compute[72418]:   </metadata>
Aug 09 18:36:04 user nova-compute[72418]:   <sysinfo type="smbios">
Aug 09 18:36:04 user nova-compute[72418]:     <system>
Aug 09 18:36:04 user nova-compute[72418]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 18:36:04 user nova-compute[72418]:       <entry name="product">OpenStack Nova</entry>
Aug 09 18:36:04 user nova-compute[72418]:       <entry name="version">0.0.0</entry>
Aug 09 18:36:04 user nova-compute[72418]:       <entry name="serial">4e1a095f-a2e7-4ab6-bb7e-38cda890d567</entry>
Aug 09 18:36:04 user nova-compute[72418]:       <entry name="uuid">4e1a095f-a2e7-4ab6-bb7e-38cda890d567</entry>
Aug 09 18:36:04 user nova-compute[72418]:       <entry name="family">Virtual Machine</entry>
Aug 09 18:36:04 user nova-compute[72418]:     </system>
Aug 09 18:36:04 user nova-compute[72418]:   </sysinfo>
Aug 09 18:36:04 user nova-compute[72418]:   <os>
Aug 09 18:36:04 user nova-compute[72418]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 18:36:04 user nova-compute[72418]:     <boot dev="hd"/>
Aug 09 18:36:04 user nova-compute[72418]:     <smbios mode="sysinfo"/>
Aug 09 18:36:04 user nova-compute[72418]:   </os>
Aug 09 18:36:04 user nova-compute[72418]:   <features>
Aug 09 18:36:04 user nova-compute[72418]:     <acpi/>
Aug 09 18:36:04 user nova-compute[72418]:     <apic/>
Aug 09 18:36:04 user nova-compute[72418]:     <vmcoreinfo/>
Aug 09 18:36:04 user nova-compute[72418]:   </features>
Aug 09 18:36:04 user nova-compute[72418]:   <clock offset="utc">
Aug 09 18:36:04 user nova-compute[72418]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 18:36:04 user nova-compute[72418]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 18:36:04 user nova-compute[72418]:     <timer name="hpet" present="no"/>
Aug 09 18:36:04 user nova-compute[72418]:   </clock>
Aug 09 18:36:04 user nova-compute[72418]:   <cpu mode="custom" match="exact">
Aug 09 18:36:04 user nova-compute[72418]:     <model>Nehalem</model>
Aug 09 18:36:04 user nova-compute[72418]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 18:36:04 user nova-compute[72418]:   </cpu>
Aug 09 18:36:04 user nova-compute[72418]:   <devices>
Aug 09 18:36:04 user nova-compute[72418]:     <disk type="file" device="disk">
Aug 09 18:36:04 user nova-compute[72418]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 18:36:04 user nova-compute[72418]:       <source file="/opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/disk"/>
Aug 09 18:36:04 user nova-compute[72418]:       <target dev="vda" bus="virtio"/>
Aug 09 18:36:04 user nova-compute[72418]:     </disk>
Aug 09 18:36:04 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:36:04 user nova-compute[72418]:       <mac address="fa:16:3e:42:1f:2f"/>
Aug 09 18:36:04 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:36:04 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:36:04 user nova-compute[72418]:       <target dev="tape6df16f7-71"/>
Aug 09 18:36:04 user nova-compute[72418]:     </interface>
Aug 09 18:36:04 user nova-compute[72418]:     <serial type="pty">
Aug 09 18:36:04 user nova-compute[72418]:       <log file="/opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/console.log" append="off"/>
Aug 09 18:36:04 user nova-compute[72418]:     </serial>
Aug 09 18:36:04 user nova-compute[72418]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 18:36:04 user nova-compute[72418]:     <video>
Aug 09 18:36:04 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:36:04 user nova-compute[72418]:     </video>
Aug 09 18:36:04 user nova-compute[72418]:     <rng model="virtio">
Aug 09 18:36:04 user nova-compute[72418]:       <backend model="random">/dev/urandom</backend>
Aug 09 18:36:04 user nova-compute[72418]:     </rng>
Aug 09 18:36:04 user nova-compute[72418]:     <controller type="usb" index="0" model="none"/>
Aug 09 18:36:04 user nova-compute[72418]:     <memballoon model="virtio">
Aug 09 18:36:04 user nova-compute[72418]:       <stats period="10"/>
Aug 09 18:36:04 user nova-compute[72418]:     </memballoon>
Aug 09 18:36:04 user nova-compute[72418]:   </devices>
Aug 09 18:36:04 user nova-compute[72418]: </domain>
Aug 09 18:36:04 user nova-compute[72418]:  {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:35:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-282255292',display_name='tempest-ServerStableDeviceRescueTest-server-282255292',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-282255292',id=32,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgi7F7Tiv948MGw/JMyBSz5f1UT2yZOhFMKoN0Kxyc1NKE7bns5u1xaa+LItbZrpXzqSR4y26XuN7XvDcLQtVjZPLJIQgwHu1xdN7N2Gz0+VfLK4SeEyvDU0D1TyNj8Uw==',key_name='tempest-keypair-376055827',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99d09208fba747f29a90f95c5bb5ee4b',ramdisk_id='',reservation_id='r-10tk9714',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-307010011',owner_user_name='tempest-ServerStableDeviceRescueTest-307010011-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:36:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ec7129a7bf6444ab241ca8dc20211fd',uuid=4e1a095f-a2e7-4ab6-bb7e-38cda890d567,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6df16f7-7151-450f-bbf8-dc3be066011e", "address": "fa:16:3e:42:1f:2f", "network": {"id": "aa563713-99b7-4830-bbc5-5390076a264d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1029161501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99d09208fba747f29a90f95c5bb5ee4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6df16f7-71", "ovs_interfaceid": "e6df16f7-7151-450f-bbf8-dc3be066011e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Converting VIF {"id": "e6df16f7-7151-450f-bbf8-dc3be066011e", "address": "fa:16:3e:42:1f:2f", "network": {"id": "aa563713-99b7-4830-bbc5-5390076a264d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1029161501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99d09208fba747f29a90f95c5bb5ee4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6df16f7-71", "ovs_interfaceid": "e6df16f7-7151-450f-bbf8-dc3be066011e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:1f:2f,bridge_name='br-int',has_traffic_filtering=True,id=e6df16f7-7151-450f-bbf8-dc3be066011e,network=Network(aa563713-99b7-4830-bbc5-5390076a264d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6df16f7-71') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG os_vif [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:1f:2f,bridge_name='br-int',has_traffic_filtering=True,id=e6df16f7-7151-450f-bbf8-dc3be066011e,network=Network(aa563713-99b7-4830-bbc5-5390076a264d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6df16f7-71') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape6df16f7-71, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape6df16f7-71, col_values=(('external_ids', {'iface-id': 'e6df16f7-7151-450f-bbf8-dc3be066011e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:1f:2f', 'vm-uuid': '4e1a095f-a2e7-4ab6-bb7e-38cda890d567'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:36:04 user nova-compute[72418]: INFO os_vif [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:1f:2f,bridge_name='br-int',has_traffic_filtering=True,id=e6df16f7-7151-450f-bbf8-dc3be066011e,network=Network(aa563713-99b7-4830-bbc5-5390076a264d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6df16f7-71')
Aug 09 18:36:04 user nova-compute[72418]: INFO nova.compute.manager [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Swapping old allocation on dict_keys(['50628e48-0a01-4c3f-9ff5-2a66453cd194']) held by migration 553b15ef-7e30-4e6b-b878-f0338d7a7d98 for instance
Aug 09 18:36:04 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] No VIF found with MAC fa:16:3e:42:1f:2f, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Overwriting current allocation {'allocations': {'50628e48-0a01-4c3f-9ff5-2a66453cd194': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 36}}, 'project_id': '405587d223d54c5ab4f72a1994ac2862', 'user_id': '8174362ccd88488d867db28e18906a62', 'consumer_generation': 1} on consumer 03ad5bab-ab32-47fc-b7e8-b32282b9c20d {{(pid=72418) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Acquiring lock "refresh_cache-03ad5bab-ab32-47fc-b7e8-b32282b9c20d" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Acquired lock "refresh_cache-03ad5bab-ab32-47fc-b7e8-b32282b9c20d" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG nova.network.neutron [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e24ebafb-73cb-42ea-a0b6-2263badd573f/disk.rescue --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG nova.compute.manager [req-7deb3f70-8721-4653-b26a-e52415264cd5 req-e8b59061-0234-40a2-ae2d-79431aaeaaa7 service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Received event network-changed-e6df16f7-7151-450f-bbf8-dc3be066011e {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG nova.compute.manager [req-7deb3f70-8721-4653-b26a-e52415264cd5 req-e8b59061-0234-40a2-ae2d-79431aaeaaa7 service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Refreshing instance network info cache due to event network-changed-e6df16f7-7151-450f-bbf8-dc3be066011e. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-7deb3f70-8721-4653-b26a-e52415264cd5 req-e8b59061-0234-40a2-ae2d-79431aaeaaa7 service nova] Acquiring lock "refresh_cache-4e1a095f-a2e7-4ab6-bb7e-38cda890d567" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-7deb3f70-8721-4653-b26a-e52415264cd5 req-e8b59061-0234-40a2-ae2d-79431aaeaaa7 service nova] Acquired lock "refresh_cache-4e1a095f-a2e7-4ab6-bb7e-38cda890d567" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:36:04 user nova-compute[72418]: DEBUG nova.network.neutron [req-7deb3f70-8721-4653-b26a-e52415264cd5 req-e8b59061-0234-40a2-ae2d-79431aaeaaa7 service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Refreshing network info cache for port e6df16f7-7151-450f-bbf8-dc3be066011e {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:36:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e24ebafb-73cb-42ea-a0b6-2263badd573f/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e24ebafb-73cb-42ea-a0b6-2263badd573f/disk.rescue --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e24ebafb-73cb-42ea-a0b6-2263badd573f/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e582b61c-d998-4a3f-8392-a7f0e94a4dec/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e582b61c-d998-4a3f-8392-a7f0e94a4dec/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e582b61c-d998-4a3f-8392-a7f0e94a4dec/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e582b61c-d998-4a3f-8392-a7f0e94a4dec/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:05 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:36:05 user nova-compute[72418]: DEBUG nova.network.neutron [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Updating instance_info_cache with network_info: [{"id": "ea92909f-40d7-48a8-be09-50439674945c", "address": "fa:16:3e:3e:5e:e7", "network": {"id": "8354f86b-1e91-42ca-9847-769bb0aadcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-664289957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405587d223d54c5ab4f72a1994ac2862", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea92909f-40", "ovs_interfaceid": "ea92909f-40d7-48a8-be09-50439674945c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:36:05 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Releasing lock "refresh_cache-03ad5bab-ab32-47fc-b7e8-b32282b9c20d" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:36:05 user nova-compute[72418]: DEBUG os_brick.utils [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:36:08 user nova-compute[72418]: DEBUG nova.network.neutron [req-7deb3f70-8721-4653-b26a-e52415264cd5 req-e8b59061-0234-40a2-ae2d-79431aaeaaa7 service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Updated VIF entry in instance network info cache for port e6df16f7-7151-450f-bbf8-dc3be066011e. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:36:08 user nova-compute[72418]: DEBUG nova.network.neutron [req-7deb3f70-8721-4653-b26a-e52415264cd5 req-e8b59061-0234-40a2-ae2d-79431aaeaaa7 service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Updating instance_info_cache with network_info: [{"id": "e6df16f7-7151-450f-bbf8-dc3be066011e", "address": "fa:16:3e:42:1f:2f", "network": {"id": "aa563713-99b7-4830-bbc5-5390076a264d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1029161501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99d09208fba747f29a90f95c5bb5ee4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6df16f7-71", "ovs_interfaceid": "e6df16f7-7151-450f-bbf8-dc3be066011e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:36:08 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691606166.7214, 873654d4-9cf2-4dde-859c-ad26d05d6e0a => Resumed> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:36:08 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] VM Resumed (Lifecycle Event)
Aug 09 18:36:08 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:08 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:08 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c83983-ccc6-42ca-a7d5-c625ed22d8cb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ad56b243ad71\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:36:08 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:36:08 user nova-compute[72418]: DEBUG nova.compute.manager [req-8f3cf668-32fc-4c9f-be0e-63d45cd3e9a4 req-94d1dcc9-f15b-482f-b3b5-7680e51fb224 service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Received event network-vif-plugged-e6df16f7-7151-450f-bbf8-dc3be066011e {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:36:08 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-8f3cf668-32fc-4c9f-be0e-63d45cd3e9a4 req-94d1dcc9-f15b-482f-b3b5-7680e51fb224 service nova] Acquiring lock "4e1a095f-a2e7-4ab6-bb7e-38cda890d567-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:36:08 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-8f3cf668-32fc-4c9f-be0e-63d45cd3e9a4 req-94d1dcc9-f15b-482f-b3b5-7680e51fb224 service nova] Lock "4e1a095f-a2e7-4ab6-bb7e-38cda890d567-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:36:08 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-8f3cf668-32fc-4c9f-be0e-63d45cd3e9a4 req-94d1dcc9-f15b-482f-b3b5-7680e51fb224 service nova] Lock "4e1a095f-a2e7-4ab6-bb7e-38cda890d567-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:36:08 user nova-compute[72418]: DEBUG nova.compute.manager [req-8f3cf668-32fc-4c9f-be0e-63d45cd3e9a4 req-94d1dcc9-f15b-482f-b3b5-7680e51fb224 service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] No waiting events found dispatching network-vif-plugged-e6df16f7-7151-450f-bbf8-dc3be066011e {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:36:08 user nova-compute[72418]: WARNING nova.compute.manager [req-8f3cf668-32fc-4c9f-be0e-63d45cd3e9a4 req-94d1dcc9-f15b-482f-b3b5-7680e51fb224 service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Received unexpected event network-vif-plugged-e6df16f7-7151-450f-bbf8-dc3be066011e for instance with vm_state building and task_state spawning.
Aug 09 18:36:08 user nova-compute[72418]: DEBUG nova.compute.manager [req-d8170588-7260-43a3-b66d-a13310ee1d6f req-3aaa1599-db64-4d4d-b4bf-ab8db6da7913 service nova] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Received event network-vif-plugged-396cd02b-9a02-4b77-b06b-6253ca90f538 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:36:08 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-d8170588-7260-43a3-b66d-a13310ee1d6f req-3aaa1599-db64-4d4d-b4bf-ab8db6da7913 service nova] Acquiring lock "873654d4-9cf2-4dde-859c-ad26d05d6e0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:36:08 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-d8170588-7260-43a3-b66d-a13310ee1d6f req-3aaa1599-db64-4d4d-b4bf-ab8db6da7913 service nova] Lock "873654d4-9cf2-4dde-859c-ad26d05d6e0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:36:08 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-d8170588-7260-43a3-b66d-a13310ee1d6f req-3aaa1599-db64-4d4d-b4bf-ab8db6da7913 service nova] Lock "873654d4-9cf2-4dde-859c-ad26d05d6e0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:36:08 user nova-compute[72418]: DEBUG nova.compute.manager [req-d8170588-7260-43a3-b66d-a13310ee1d6f req-3aaa1599-db64-4d4d-b4bf-ab8db6da7913 service nova] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] No waiting events found dispatching network-vif-plugged-396cd02b-9a02-4b77-b06b-6253ca90f538 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:36:08 user nova-compute[72418]: WARNING nova.compute.manager [req-d8170588-7260-43a3-b66d-a13310ee1d6f req-3aaa1599-db64-4d4d-b4bf-ab8db6da7913 service nova] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Received unexpected event network-vif-plugged-396cd02b-9a02-4b77-b06b-6253ca90f538 for instance with vm_state building and task_state spawning.
Aug 09 18:36:08 user nova-compute[72418]: DEBUG nova.compute.manager [req-f72462b1-315c-44b8-b7b9-1399282534f4 req-85804977-23e2-4980-a0a7-c189b6e10df1 service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Received event network-vif-plugged-e6df16f7-7151-450f-bbf8-dc3be066011e {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:36:08 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-f72462b1-315c-44b8-b7b9-1399282534f4 req-85804977-23e2-4980-a0a7-c189b6e10df1 service nova] Acquiring lock "4e1a095f-a2e7-4ab6-bb7e-38cda890d567-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:36:08 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-f72462b1-315c-44b8-b7b9-1399282534f4 req-85804977-23e2-4980-a0a7-c189b6e10df1 service nova] Lock "4e1a095f-a2e7-4ab6-bb7e-38cda890d567-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:36:08 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-f72462b1-315c-44b8-b7b9-1399282534f4 req-85804977-23e2-4980-a0a7-c189b6e10df1 service nova] Lock "4e1a095f-a2e7-4ab6-bb7e-38cda890d567-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:36:08 user nova-compute[72418]: DEBUG nova.compute.manager [req-f72462b1-315c-44b8-b7b9-1399282534f4 req-85804977-23e2-4980-a0a7-c189b6e10df1 service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] No waiting events found dispatching network-vif-plugged-e6df16f7-7151-450f-bbf8-dc3be066011e {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:36:08 user nova-compute[72418]: WARNING nova.compute.manager [req-f72462b1-315c-44b8-b7b9-1399282534f4 req-85804977-23e2-4980-a0a7-c189b6e10df1 service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Received unexpected event network-vif-plugged-e6df16f7-7151-450f-bbf8-dc3be066011e for instance with vm_state building and task_state spawning.
Aug 09 18:36:08 user nova-compute[72418]: DEBUG nova.compute.manager [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Instance event wait completed in 0 seconds for  {{(pid=72418) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 18:36:08 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Guest created on hypervisor {{(pid=72418) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 18:36:08 user nova-compute[72418]: DEBUG nova.compute.manager [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Instance event wait completed in 0 seconds for  {{(pid=72418) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 18:36:08 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Guest created on hypervisor {{(pid=72418) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 18:36:08 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-7deb3f70-8721-4653-b26a-e52415264cd5 req-e8b59061-0234-40a2-ae2d-79431aaeaaa7 service nova] Releasing lock "refresh_cache-4e1a095f-a2e7-4ab6-bb7e-38cda890d567" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:36:08 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:36:08 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:08 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:36:08 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:08 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[347dfd6d-e185-4df1-9d81-86dc558e5456]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:36:08 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Instance spawned successfully.
Aug 09 18:36:08 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:08 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 18:36:08 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:36:08 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:36:08 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Hypervisor/Node resource view: name=user free_ram=7406MB free_disk=25.194637298583984GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72418) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 18:36:08 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:36:08 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:36:08 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:36:08 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691606166.7216628, 873654d4-9cf2-4dde-859c-ad26d05d6e0a => Started> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:36:08 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] VM Started (Lifecycle Event)
Aug 09 18:36:08 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Instance spawned successfully.
Aug 09 18:36:08 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 18:36:08 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Found default for hw_input_bus of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:36:08 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Found default for hw_pointer_model of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:36:08 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.051s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:08 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef239ed-fc2f-4846-bd74-4b7960eb7263]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:36:08 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb26116-6c0d-43c9-9b17-37672f5b115f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:36:08 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Running cmd (subprocess): nvme version {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:08 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] 'nvme version' failed. Not Retrying. {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:36:08 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] nvme not present on system {{(pid=72418) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 18:36:08 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:36:08 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:08 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:36:08 user nova-compute[72418]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 18:36:08 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f784a98-bf77-4678-922b-a38ea487f21f]: (4, '') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:36:08 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72418) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 18:36:08 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 18:36:08 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] LIGHTOS: no hostnqn found. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 18:36:08 user nova-compute[72418]: DEBUG os_brick.utils [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] <== get_connector_properties: return (3302ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ad56b243ad71', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:36:08 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Found default for hw_cdrom_bus of ide {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:36:08 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Found default for hw_disk_bus of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:36:08 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Found default for hw_input_bus of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:36:08 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Found default for hw_pointer_model of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:36:08 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Found default for hw_video_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:36:08 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Found default for hw_vif_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:36:08 user nova-compute[72418]: INFO nova.compute.manager [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Took 11.40 seconds to spawn the instance on the hypervisor.
Aug 09 18:36:08 user nova-compute[72418]: DEBUG nova.compute.manager [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:36:09 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:36:09 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:36:09 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691606168.389183, 4e1a095f-a2e7-4ab6-bb7e-38cda890d567 => Resumed> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:36:09 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] VM Resumed (Lifecycle Event)
Aug 09 18:36:09 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 6af7918a-ce90-45ab-93d8-684e1489e891 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:36:09 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 8fe41968-a219-4a5a-afdb-32eb2082bb40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:36:09 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 01c46b33-6788-44a5-a43c-88ee4acc4d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:36:09 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance e019064c-955e-4f80-9b00-6b32b3835d58 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:36:09 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance c46f2599-93f8-412e-9918-7ace8a9f19dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:36:09 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 1c53f871-2be9-4119-b5c0-d5081e2f4388 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:36:09 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance e582b61c-d998-4a3f-8392-a7f0e94a4dec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:36:09 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 2c9e974b-b993-4f4e-9446-14941c39f109 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:36:09 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance e24ebafb-73cb-42ea-a0b6-2263badd573f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:36:09 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:36:09 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 03ad5bab-ab32-47fc-b7e8-b32282b9c20d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:36:09 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 0659fd5c-cb05-441e-94b6-9d05f7135893 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:36:09 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 97f49889-df0b-48c1-97ce-5c331b6a65ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:36:09 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 873654d4-9cf2-4dde-859c-ad26d05d6e0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:36:09 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 4e1a095f-a2e7-4ab6-bb7e-38cda890d567 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:36:09 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 18:36:09 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 18:36:09 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:36:09 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:36:09 user nova-compute[72418]: INFO nova.compute.manager [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Took 8.31 seconds to spawn the instance on the hypervisor.
Aug 09 18:36:09 user nova-compute[72418]: DEBUG nova.compute.manager [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:36:09 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:36:09 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691606168.3899581, 4e1a095f-a2e7-4ab6-bb7e-38cda890d567 => Started> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:36:09 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] VM Started (Lifecycle Event)
Aug 09 18:36:09 user nova-compute[72418]: INFO nova.compute.manager [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Took 12.91 seconds to build instance.
Aug 09 18:36:09 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:36:09 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:36:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-0b6affe7-9ace-418b-8928-0c9b2866f2e2 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "873654d4-9cf2-4dde-859c-ad26d05d6e0a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.106s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:36:09 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:36:09 user nova-compute[72418]: INFO nova.compute.manager [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Took 10.22 seconds to build instance.
Aug 09 18:36:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-cb38e8e2-bfbb-4167-ac30-3a2f37fa76cd tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Lock "4e1a095f-a2e7-4ab6-bb7e-38cda890d567" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.346s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:36:09 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:36:09 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:36:09 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:36:09 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Compute_service record updated for user:user {{(pid=72418) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 18:36:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.838s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:36:13 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:36:14 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:36:16 user nova-compute[72418]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691606161.133214, 03ad5bab-ab32-47fc-b7e8-b32282b9c20d => Stopped> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:36:16 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] VM Stopped (Lifecycle Event)
Aug 09 18:36:16 user nova-compute[72418]: DEBUG nova.compute.manager [None req-083cc1ed-3f0e-422e-abfc-057fd101c1f8 None None] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:36:17 user nova-compute[72418]: DEBUG nova.compute.manager [req-a59eb713-6862-4fae-95b1-570c386a0cec req-d0c170cf-33f1-4225-a78c-8256c8416bbc service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Received event network-changed-84eb2df4-6995-47c5-bf0f-387932ece66d {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:36:17 user nova-compute[72418]: DEBUG nova.compute.manager [req-a59eb713-6862-4fae-95b1-570c386a0cec req-d0c170cf-33f1-4225-a78c-8256c8416bbc service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Refreshing instance network info cache due to event network-changed-84eb2df4-6995-47c5-bf0f-387932ece66d. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:36:17 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a59eb713-6862-4fae-95b1-570c386a0cec req-d0c170cf-33f1-4225-a78c-8256c8416bbc service nova] Acquiring lock "refresh_cache-1c53f871-2be9-4119-b5c0-d5081e2f4388" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:36:17 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a59eb713-6862-4fae-95b1-570c386a0cec req-d0c170cf-33f1-4225-a78c-8256c8416bbc service nova] Acquired lock "refresh_cache-1c53f871-2be9-4119-b5c0-d5081e2f4388" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:36:17 user nova-compute[72418]: DEBUG nova.network.neutron [req-a59eb713-6862-4fae-95b1-570c386a0cec req-d0c170cf-33f1-4225-a78c-8256c8416bbc service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Refreshing network info cache for port 84eb2df4-6995-47c5-bf0f-387932ece66d {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:36:18 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:36:18 user nova-compute[72418]: DEBUG nova.network.neutron [req-a59eb713-6862-4fae-95b1-570c386a0cec req-d0c170cf-33f1-4225-a78c-8256c8416bbc service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Updated VIF entry in instance network info cache for port 84eb2df4-6995-47c5-bf0f-387932ece66d. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:36:18 user nova-compute[72418]: DEBUG nova.network.neutron [req-a59eb713-6862-4fae-95b1-570c386a0cec req-d0c170cf-33f1-4225-a78c-8256c8416bbc service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Updating instance_info_cache with network_info: [{"id": "84eb2df4-6995-47c5-bf0f-387932ece66d", "address": "fa:16:3e:d2:b0:b4", "network": {"id": "15a49d9b-3c0d-449b-9473-29f219960e2c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c68622cd79472ba6ad14a6876aeaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84eb2df4-69", "ovs_interfaceid": "84eb2df4-6995-47c5-bf0f-387932ece66d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:36:18 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a59eb713-6862-4fae-95b1-570c386a0cec req-d0c170cf-33f1-4225-a78c-8256c8416bbc service nova] Releasing lock "refresh_cache-1c53f871-2be9-4119-b5c0-d5081e2f4388" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:36:18 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-79c31679-ecc6-4119-ad62-3a984c0de650 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Acquiring lock "1c53f871-2be9-4119-b5c0-d5081e2f4388" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:36:18 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-79c31679-ecc6-4119-ad62-3a984c0de650 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "1c53f871-2be9-4119-b5c0-d5081e2f4388" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:36:18 user nova-compute[72418]: INFO nova.compute.manager [None req-79c31679-ecc6-4119-ad62-3a984c0de650 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Detaching volume 0ac09942-714e-4c2a-a7ad-637d87d7d177
Aug 09 18:36:18 user nova-compute[72418]: INFO nova.virt.block_device [None req-79c31679-ecc6-4119-ad62-3a984c0de650 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Attempting to driver detach volume 0ac09942-714e-4c2a-a7ad-637d87d7d177 from mountpoint /dev/vdb
Aug 09 18:36:18 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-79c31679-ecc6-4119-ad62-3a984c0de650 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Attempting to detach device vdb from instance 1c53f871-2be9-4119-b5c0-d5081e2f4388 from the persistent domain config. {{(pid=72418) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 18:36:18 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-79c31679-ecc6-4119-ad62-3a984c0de650 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 18:36:18 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:36:18 user nova-compute[72418]:   <source dev="/dev/sdc"/>
Aug 09 18:36:18 user nova-compute[72418]:   <target dev="vdb" bus="virtio"/>
Aug 09 18:36:18 user nova-compute[72418]:   <serial>0ac09942-714e-4c2a-a7ad-637d87d7d177</serial>
Aug 09 18:36:18 user nova-compute[72418]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 18:36:18 user nova-compute[72418]: </disk>
Aug 09 18:36:18 user nova-compute[72418]:  {{(pid=72418) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 18:36:18 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-79c31679-ecc6-4119-ad62-3a984c0de650 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Successfully detached device vdb from instance 1c53f871-2be9-4119-b5c0-d5081e2f4388 from the persistent domain config.
Aug 09 18:36:18 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-79c31679-ecc6-4119-ad62-3a984c0de650 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1c53f871-2be9-4119-b5c0-d5081e2f4388 from the live domain config. {{(pid=72418) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 18:36:18 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-79c31679-ecc6-4119-ad62-3a984c0de650 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 18:36:18 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:36:18 user nova-compute[72418]:   <source dev="/dev/sdc"/>
Aug 09 18:36:18 user nova-compute[72418]:   <target dev="vdb" bus="virtio"/>
Aug 09 18:36:18 user nova-compute[72418]:   <serial>0ac09942-714e-4c2a-a7ad-637d87d7d177</serial>
Aug 09 18:36:18 user nova-compute[72418]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 18:36:18 user nova-compute[72418]: </disk>
Aug 09 18:36:18 user nova-compute[72418]:  {{(pid=72418) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Starting finish_revert_migration {{(pid=72418) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Start _get_guest_xml network_info=[{"id": "ea92909f-40d7-48a8-be09-50439674945c", "address": "fa:16:3e:3e:5e:e7", "network": {"id": "8354f86b-1e91-42ca-9847-769bb0aadcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-664289957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405587d223d54c5ab4f72a1994ac2862", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea92909f-40", "ovs_interfaceid": "ea92909f-40d7-48a8-be09-50439674945c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'attachment_id': '0aa8025b-e506-4b31-bd9f-c9716fe9f165', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EzlWwnfa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '03ad5bab-ab32-47fc-b7e8-b32282b9c20d', 'attached_at': '2023-08-09T18:36:19.000000', 'detached_at': '', 'volume_id': '57cf2c50-486c-4ee4-a0f8-c48ad6790e71', 'serial': '57cf2c50-486c-4ee4-a0f8-c48ad6790e71'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'volume_type': None} {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 18:36:19 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:36:19 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:36:19 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] CPU controller missing on host. {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] CPU controller found on host. {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72418) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T18:17:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Flavor limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Image limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Flavor pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Image pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Got 1 possible topologies {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG nova.objects.instance [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lazy-loading 'vcpu_model' on Instance uuid 03ad5bab-ab32-47fc-b7e8-b32282b9c20d {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Calling os-brick to attach iSCSI Volume {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EzlWwnfa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:36:19 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:36:19 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:36:19 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:36:19 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:36:19 user nova-compute[72418]: INFO os_brick.initiator.connectors.iscsi [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 18:36:19 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Received event <DeviceRemovedEvent: 1691606179.3068976, 1c53f871-2be9-4119-b5c0-d5081e2f4388 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72418) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-79c31679-ecc6-4119-ad62-3a984c0de650 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1c53f871-2be9-4119-b5c0-d5081e2f4388 {{(pid=72418) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:19 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-79c31679-ecc6-4119-ad62-3a984c0de650 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Successfully detached device vdb from instance 1c53f871-2be9-4119-b5c0-d5081e2f4388 from the live domain config.
Aug 09 18:36:19 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79c31679-ecc6-4119-ad62-3a984c0de650 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] calling os-brick to detach iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-79c31679-ecc6-4119-ad62-3a984c0de650 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, {'target_iqns': ['iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ktoIFEGz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:36:19 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-79c31679-ecc6-4119-ad62-3a984c0de650 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:36:19 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-79c31679-ecc6-4119-ad62-3a984c0de650 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b95abf1-707d-4ed3-ac59-9bebad417ac9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 18:36:19 user nova-compute[72418]:  {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --interface default --op new {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb0616a-3e08-4e75-9214-d3e02021207b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71] added\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71] added
Aug 09 18:36:19 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[6443e0ef-32af-416e-a18d-544b6e257307]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[84dc0fab-143c-4900-9ef0-ccf9f33ac3ee]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EzlWwnfa {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EzlWwnfa" returned: 0 in 0.017s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfa2f7e-5ada-46e9-93e5-891f188aef16]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EzlWwnfa'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8775282-8b50-4595-b986-a2812b469b5e]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d03ce5-c6c2-4599-a86d-78b57ec45cbb]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:36:19 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:36:19 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:36:19 user nova-compute[72418]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)
Aug 09 18:36:19 user nova-compute[72418]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6 (non-flash)
Aug 09 18:36:19 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:36:19 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:36:19 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:36:19 user nova-compute[72418]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)
Aug 09 18:36:19 user nova-compute[72418]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6 (non-flash)
Aug 09 18:36:19 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --login {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f26b1b-ca8c-474f-9b72-537719ef39b1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71, portal: 172.16.0.220,3260]
Aug 09 18:36:19 user nova-compute[72418]: Login to [iface: default, target: iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71, portal: 172.16.0.220,3260] successful.
Aug 09 18:36:19 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7aa05e0-1826-4560-8df2-b11a848c51dd]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c39ce2-a47d-4042-862e-ae509d3ba165]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:36:19 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:36:19 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:36:19 user nova-compute[72418]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)
Aug 09 18:36:19 user nova-compute[72418]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6 (non-flash)
Aug 09 18:36:19 user nova-compute[72418]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:36:19 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:36:19 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:36:19 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:36:19 user nova-compute[72418]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)
Aug 09 18:36:19 user nova-compute[72418]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6 (non-flash)
Aug 09 18:36:19 user nova-compute[72418]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:36:19 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Connected to 172.16.0.220:3260 {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] HCTL ('35', '-', '-', 0) found on session 34 with lun 0 {{(pid=72418) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72418) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[e985fb43-6244-4ff9-b793-6631174bd816]: (4, ('- - 0', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72418) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EzlWwnfa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG nova.compute.manager [req-12c121d8-761d-469f-b869-443954ebd7f6 req-baab5027-9b1a-47f2-b233-e1dcd9200d94 service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Received event network-changed-84eb2df4-6995-47c5-bf0f-387932ece66d {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG nova.compute.manager [req-12c121d8-761d-469f-b869-443954ebd7f6 req-baab5027-9b1a-47f2-b233-e1dcd9200d94 service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Refreshing instance network info cache due to event network-changed-84eb2df4-6995-47c5-bf0f-387932ece66d. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-12c121d8-761d-469f-b869-443954ebd7f6 req-baab5027-9b1a-47f2-b233-e1dcd9200d94 service nova] Acquiring lock "refresh_cache-1c53f871-2be9-4119-b5c0-d5081e2f4388" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-12c121d8-761d-469f-b869-443954ebd7f6 req-baab5027-9b1a-47f2-b233-e1dcd9200d94 service nova] Acquired lock "refresh_cache-1c53f871-2be9-4119-b5c0-d5081e2f4388" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:36:19 user nova-compute[72418]: DEBUG nova.network.neutron [req-12c121d8-761d-469f-b869-443954ebd7f6 req-baab5027-9b1a-47f2-b233-e1dcd9200d94 service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Refreshing network info cache for port 84eb2df4-6995-47c5-bf0f-387932ece66d {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG nova.network.neutron [req-12c121d8-761d-469f-b869-443954ebd7f6 req-baab5027-9b1a-47f2-b233-e1dcd9200d94 service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Updated VIF entry in instance network info cache for port 84eb2df4-6995-47c5-bf0f-387932ece66d. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG nova.network.neutron [req-12c121d8-761d-469f-b869-443954ebd7f6 req-baab5027-9b1a-47f2-b233-e1dcd9200d94 service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Updating instance_info_cache with network_info: [{"id": "84eb2df4-6995-47c5-bf0f-387932ece66d", "address": "fa:16:3e:d2:b0:b4", "network": {"id": "15a49d9b-3c0d-449b-9473-29f219960e2c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c68622cd79472ba6ad14a6876aeaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84eb2df4-69", "ovs_interfaceid": "84eb2df4-6995-47c5-bf0f-387932ece66d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-12c121d8-761d-469f-b869-443954ebd7f6 req-baab5027-9b1a-47f2-b233-e1dcd9200d94 service nova] Releasing lock "refresh_cache-1c53f871-2be9-4119-b5c0-d5081e2f4388" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '26131393039383131', 'path': '/dev/sdd'} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131393039383131', 'path': '/dev/sdd'} {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-79c31679-ecc6-4119-ad62-3a984c0de650 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.319s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-79c31679-ecc6-4119-ad62-3a984c0de650 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177', 0)] {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[588540e7-9a57-40e7-ae52-32a8686ba3cc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:30:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1873430052',display_name='tempest-ServerActionsTestOtherB-server-1873430052',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1873430052',id=22,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIcobG4HnuTYOQnNQv/MwdYT3LE/RLnOlgxtm9ZW7mVchwGrvFEE/XUOIJNiUK2ZNsyoG2e4ALumseJiS6y2HeRcRosbaQtxOHGtF7A55P++8WqVj1ISNQq63FhVymDdqQ==',key_name='tempest-keypair-1241971956',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:34:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='405587d223d54c5ab4f72a1994ac2862',ramdisk_id='',reservation_id='r-y3ado2eg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1643003262',owner_user_name='tempest-ServerActionsTestOtherB-1643003262-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:35:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8174362ccd88488d867db28e18906a62',uuid=03ad5bab-ab32-47fc-b7e8-b32282b9c20d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "ea92909f-40d7-48a8-be09-50439674945c", "address": "fa:16:3e:3e:5e:e7", "network": {"id": "8354f86b-1e91-42ca-9847-769bb0aadcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-664289957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405587d223d54c5ab4f72a1994ac2862", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea92909f-40", "ovs_interfaceid": "ea92909f-40d7-48a8-be09-50439674945c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Converting VIF {"id": "ea92909f-40d7-48a8-be09-50439674945c", "address": "fa:16:3e:3e:5e:e7", "network": {"id": "8354f86b-1e91-42ca-9847-769bb0aadcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-664289957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405587d223d54c5ab4f72a1994ac2862", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea92909f-40", "ovs_interfaceid": "ea92909f-40d7-48a8-be09-50439674945c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:5e:e7,bridge_name='br-int',has_traffic_filtering=True,id=ea92909f-40d7-48a8-be09-50439674945c,network=Network(8354f86b-1e91-42ca-9847-769bb0aadcd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea92909f-40') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] End _get_guest_xml xml=<domain type="kvm">
Aug 09 18:36:20 user nova-compute[72418]:   <uuid>03ad5bab-ab32-47fc-b7e8-b32282b9c20d</uuid>
Aug 09 18:36:20 user nova-compute[72418]:   <name>instance-00000016</name>
Aug 09 18:36:20 user nova-compute[72418]:   <memory>524288</memory>
Aug 09 18:36:20 user nova-compute[72418]:   <vcpu>1</vcpu>
Aug 09 18:36:20 user nova-compute[72418]:   <metadata>
Aug 09 18:36:20 user nova-compute[72418]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:36:20 user nova-compute[72418]:       <nova:package version="0.0.0"/>
Aug 09 18:36:20 user nova-compute[72418]:       <nova:name>tempest-ServerActionsTestOtherB-server-1873430052</nova:name>
Aug 09 18:36:20 user nova-compute[72418]:       <nova:creationTime>2023-08-09 18:36:19</nova:creationTime>
Aug 09 18:36:20 user nova-compute[72418]:       <nova:flavor name="m1.tiny">
Aug 09 18:36:20 user nova-compute[72418]:         <nova:memory>512</nova:memory>
Aug 09 18:36:20 user nova-compute[72418]:         <nova:disk>1</nova:disk>
Aug 09 18:36:20 user nova-compute[72418]:         <nova:swap>0</nova:swap>
Aug 09 18:36:20 user nova-compute[72418]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:36:20 user nova-compute[72418]:         <nova:vcpus>1</nova:vcpus>
Aug 09 18:36:20 user nova-compute[72418]:       </nova:flavor>
Aug 09 18:36:20 user nova-compute[72418]:       <nova:owner>
Aug 09 18:36:20 user nova-compute[72418]:         <nova:user uuid="8174362ccd88488d867db28e18906a62">tempest-ServerActionsTestOtherB-1643003262-project-member</nova:user>
Aug 09 18:36:20 user nova-compute[72418]:         <nova:project uuid="405587d223d54c5ab4f72a1994ac2862">tempest-ServerActionsTestOtherB-1643003262</nova:project>
Aug 09 18:36:20 user nova-compute[72418]:       </nova:owner>
Aug 09 18:36:20 user nova-compute[72418]:       <nova:root type="image" uuid="8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e"/>
Aug 09 18:36:20 user nova-compute[72418]:       <nova:ports>
Aug 09 18:36:20 user nova-compute[72418]:         <nova:port uuid="ea92909f-40d7-48a8-be09-50439674945c">
Aug 09 18:36:20 user nova-compute[72418]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 18:36:20 user nova-compute[72418]:         </nova:port>
Aug 09 18:36:20 user nova-compute[72418]:       </nova:ports>
Aug 09 18:36:20 user nova-compute[72418]:     </nova:instance>
Aug 09 18:36:20 user nova-compute[72418]:   </metadata>
Aug 09 18:36:20 user nova-compute[72418]:   <sysinfo type="smbios">
Aug 09 18:36:20 user nova-compute[72418]:     <system>
Aug 09 18:36:20 user nova-compute[72418]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 18:36:20 user nova-compute[72418]:       <entry name="product">OpenStack Nova</entry>
Aug 09 18:36:20 user nova-compute[72418]:       <entry name="version">0.0.0</entry>
Aug 09 18:36:20 user nova-compute[72418]:       <entry name="serial">03ad5bab-ab32-47fc-b7e8-b32282b9c20d</entry>
Aug 09 18:36:20 user nova-compute[72418]:       <entry name="uuid">03ad5bab-ab32-47fc-b7e8-b32282b9c20d</entry>
Aug 09 18:36:20 user nova-compute[72418]:       <entry name="family">Virtual Machine</entry>
Aug 09 18:36:20 user nova-compute[72418]:     </system>
Aug 09 18:36:20 user nova-compute[72418]:   </sysinfo>
Aug 09 18:36:20 user nova-compute[72418]:   <os>
Aug 09 18:36:20 user nova-compute[72418]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 18:36:20 user nova-compute[72418]:     <boot dev="hd"/>
Aug 09 18:36:20 user nova-compute[72418]:     <smbios mode="sysinfo"/>
Aug 09 18:36:20 user nova-compute[72418]:   </os>
Aug 09 18:36:20 user nova-compute[72418]:   <features>
Aug 09 18:36:20 user nova-compute[72418]:     <acpi/>
Aug 09 18:36:20 user nova-compute[72418]:     <apic/>
Aug 09 18:36:20 user nova-compute[72418]:     <vmcoreinfo/>
Aug 09 18:36:20 user nova-compute[72418]:   </features>
Aug 09 18:36:20 user nova-compute[72418]:   <clock offset="utc">
Aug 09 18:36:20 user nova-compute[72418]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 18:36:20 user nova-compute[72418]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 18:36:20 user nova-compute[72418]:     <timer name="hpet" present="no"/>
Aug 09 18:36:20 user nova-compute[72418]:   </clock>
Aug 09 18:36:20 user nova-compute[72418]:   <cpu mode="custom" match="exact">
Aug 09 18:36:20 user nova-compute[72418]:     <model>Nehalem</model>
Aug 09 18:36:20 user nova-compute[72418]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 18:36:20 user nova-compute[72418]:   </cpu>
Aug 09 18:36:20 user nova-compute[72418]:   <devices>
Aug 09 18:36:20 user nova-compute[72418]:     <disk type="file" device="disk">
Aug 09 18:36:20 user nova-compute[72418]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 18:36:20 user nova-compute[72418]:       <source file="/opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/disk"/>
Aug 09 18:36:20 user nova-compute[72418]:       <target dev="vda" bus="virtio"/>
Aug 09 18:36:20 user nova-compute[72418]:     </disk>
Aug 09 18:36:20 user nova-compute[72418]:     <disk type="block" device="disk">
Aug 09 18:36:20 user nova-compute[72418]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:36:20 user nova-compute[72418]:       <source dev="/dev/sdd"/>
Aug 09 18:36:20 user nova-compute[72418]:       <target dev="vdb" bus="virtio"/>
Aug 09 18:36:20 user nova-compute[72418]:       <serial>57cf2c50-486c-4ee4-a0f8-c48ad6790e71</serial>
Aug 09 18:36:20 user nova-compute[72418]:     </disk>
Aug 09 18:36:20 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:36:20 user nova-compute[72418]:       <mac address="fa:16:3e:3e:5e:e7"/>
Aug 09 18:36:20 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:36:20 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:36:20 user nova-compute[72418]:       <target dev="tapea92909f-40"/>
Aug 09 18:36:20 user nova-compute[72418]:     </interface>
Aug 09 18:36:20 user nova-compute[72418]:     <serial type="pty">
Aug 09 18:36:20 user nova-compute[72418]:       <log file="/opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/console.log" append="off"/>
Aug 09 18:36:20 user nova-compute[72418]:     </serial>
Aug 09 18:36:20 user nova-compute[72418]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 18:36:20 user nova-compute[72418]:     <video>
Aug 09 18:36:20 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:36:20 user nova-compute[72418]:     </video>
Aug 09 18:36:20 user nova-compute[72418]:     <rng model="virtio">
Aug 09 18:36:20 user nova-compute[72418]:       <backend model="random">/dev/urandom</backend>
Aug 09 18:36:20 user nova-compute[72418]:     </rng>
Aug 09 18:36:20 user nova-compute[72418]:     <controller type="usb" index="0" model="none"/>
Aug 09 18:36:20 user nova-compute[72418]:     <memballoon model="virtio">
Aug 09 18:36:20 user nova-compute[72418]:       <stats period="10"/>
Aug 09 18:36:20 user nova-compute[72418]:     </memballoon>
Aug 09 18:36:20 user nova-compute[72418]:   </devices>
Aug 09 18:36:20 user nova-compute[72418]: </domain>
Aug 09 18:36:20 user nova-compute[72418]:  {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:30:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1873430052',display_name='tempest-ServerActionsTestOtherB-server-1873430052',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1873430052',id=22,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIcobG4HnuTYOQnNQv/MwdYT3LE/RLnOlgxtm9ZW7mVchwGrvFEE/XUOIJNiUK2ZNsyoG2e4ALumseJiS6y2HeRcRosbaQtxOHGtF7A55P++8WqVj1ISNQq63FhVymDdqQ==',key_name='tempest-keypair-1241971956',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:34:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='405587d223d54c5ab4f72a1994ac2862',ramdisk_id='',reservation_id='r-y3ado2eg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1643003262',owner_user_name='tempest-ServerActionsTestOtherB-1643003262-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:35:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8174362ccd88488d867db28e18906a62',uuid=03ad5bab-ab32-47fc-b7e8-b32282b9c20d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "ea92909f-40d7-48a8-be09-50439674945c", "address": "fa:16:3e:3e:5e:e7", "network": {"id": "8354f86b-1e91-42ca-9847-769bb0aadcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-664289957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405587d223d54c5ab4f72a1994ac2862", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea92909f-40", "ovs_interfaceid": "ea92909f-40d7-48a8-be09-50439674945c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Converting VIF {"id": "ea92909f-40d7-48a8-be09-50439674945c", "address": "fa:16:3e:3e:5e:e7", "network": {"id": "8354f86b-1e91-42ca-9847-769bb0aadcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-664289957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405587d223d54c5ab4f72a1994ac2862", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea92909f-40", "ovs_interfaceid": "ea92909f-40d7-48a8-be09-50439674945c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:5e:e7,bridge_name='br-int',has_traffic_filtering=True,id=ea92909f-40d7-48a8-be09-50439674945c,network=Network(8354f86b-1e91-42ca-9847-769bb0aadcd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea92909f-40') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG os_vif [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:5e:e7,bridge_name='br-int',has_traffic_filtering=True,id=ea92909f-40d7-48a8-be09-50439674945c,network=Network(8354f86b-1e91-42ca-9847-769bb0aadcd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea92909f-40') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea92909f-40, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapea92909f-40, col_values=(('external_ids', {'iface-id': 'ea92909f-40d7-48a8-be09-50439674945c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:5e:e7', 'vm-uuid': '03ad5bab-ab32-47fc-b7e8-b32282b9c20d'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[571f9c0f-13bd-4f6d-a84a-d816bde54813]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-79c31679-ecc6-4119-ad62-3a984c0de650 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:36:20 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:36:20 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:36:20 user nova-compute[72418]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)
Aug 09 18:36:20 user nova-compute[72418]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6 (non-flash)
Aug 09 18:36:20 user nova-compute[72418]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:36:20 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-79c31679-ecc6-4119-ad62-3a984c0de650 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:36:20 user nova-compute[72418]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 (non-flash)
Aug 09 18:36:20 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:36:20 user nova-compute[72418]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)
Aug 09 18:36:20 user nova-compute[72418]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6 (non-flash)
Aug 09 18:36:20 user nova-compute[72418]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:36:20 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-79c31679-ecc6-4119-ad62-3a984c0de650 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f42f859dea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177'): ({'sdc'}, set())}) {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-79c31679-ecc6-4119-ad62-3a984c0de650 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Removing single pathed devices sdc {{(pid=72418) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:36:20 user nova-compute[72418]: INFO os_vif [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:5e:e7,bridge_name='br-int',has_traffic_filtering=True,id=ea92909f-40d7-48a8-be09-50439674945c,network=Network(8354f86b-1e91-42ca-9847-769bb0aadcd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea92909f-40')
Aug 09 18:36:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8fb1a04-d1e5-4b7c-a638-098a19d33496]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ff60e9-4c89-4d7a-9029-ddc7d1e5d56d]: (4, ('ok\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-79c31679-ecc6-4119-ad62-3a984c0de650 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Flushing IO for device /dev/sdc {{(pid=72418) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.053s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[5662c3de-4f1e-4b13-8cb1-e1a7c23bdefe]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-79c31679-ecc6-4119-ad62-3a984c0de650 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72418) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.059s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[80474134-f574-48d2-99eb-978fd4f63fc1]: (4, ('1', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-79c31679-ecc6-4119-ad62-3a984c0de650 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-79c31679-ecc6-4119-ad62-3a984c0de650 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] SCSI volumes sdc have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-79c31679-ecc6-4119-ad62-3a984c0de650 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177')] {{(pid=72418) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55008b9-8396-43d4-8884-33de0dd2a4e8]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-79c31679-ecc6-4119-ad62-3a984c0de650 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 -p 172.16.0.220:3260 --logout {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bee33b6-e327-4999-8eeb-9aa37d6d8f3b]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-79c31679-ecc6-4119-ad62-3a984c0de650 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177, portal: 172.16.0.220,3260]
Aug 09 18:36:20 user nova-compute[72418]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177, portal: 172.16.0.220,3260] successful.
Aug 09 18:36:20 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:36:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 -p 172.16.0.220:3260 --op delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:21 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ac09942-714e-4c2a-a7ad-637d87d7d177 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:21 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a009e9-f936-480e-9497-c6970b72c843]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:36:21 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-79c31679-ecc6-4119-ad62-3a984c0de650 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:36:21 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-79c31679-ecc6-4119-ad62-3a984c0de650 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:36:21 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-79c31679-ecc6-4119-ad62-3a984c0de650 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] <== disconnect_volume: return (1675ms) None {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:36:21 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79c31679-ecc6-4119-ad62-3a984c0de650 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Disconnected iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 18:36:21 user nova-compute[72418]: DEBUG nova.objects.instance [None req-79c31679-ecc6-4119-ad62-3a984c0de650 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lazy-loading 'flavor' on Instance uuid 1c53f871-2be9-4119-b5c0-d5081e2f4388 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:36:21 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-79c31679-ecc6-4119-ad62-3a984c0de650 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "1c53f871-2be9-4119-b5c0-d5081e2f4388" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.488s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:36:22 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:36:22 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:36:22 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:36:22 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:36:22 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:36:22 user nova-compute[72418]: DEBUG nova.compute.manager [req-6bd0d554-dd0c-47ab-8f43-4fdcbcd29b75 req-1b76794d-3295-4859-bbe0-df33853211e9 service nova] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Received event network-vif-plugged-ea92909f-40d7-48a8-be09-50439674945c {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:36:22 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-6bd0d554-dd0c-47ab-8f43-4fdcbcd29b75 req-1b76794d-3295-4859-bbe0-df33853211e9 service nova] Acquiring lock "03ad5bab-ab32-47fc-b7e8-b32282b9c20d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:36:22 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-6bd0d554-dd0c-47ab-8f43-4fdcbcd29b75 req-1b76794d-3295-4859-bbe0-df33853211e9 service nova] Lock "03ad5bab-ab32-47fc-b7e8-b32282b9c20d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:36:22 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-6bd0d554-dd0c-47ab-8f43-4fdcbcd29b75 req-1b76794d-3295-4859-bbe0-df33853211e9 service nova] Lock "03ad5bab-ab32-47fc-b7e8-b32282b9c20d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:36:22 user nova-compute[72418]: DEBUG nova.compute.manager [req-6bd0d554-dd0c-47ab-8f43-4fdcbcd29b75 req-1b76794d-3295-4859-bbe0-df33853211e9 service nova] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] No waiting events found dispatching network-vif-plugged-ea92909f-40d7-48a8-be09-50439674945c {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:36:22 user nova-compute[72418]: WARNING nova.compute.manager [req-6bd0d554-dd0c-47ab-8f43-4fdcbcd29b75 req-1b76794d-3295-4859-bbe0-df33853211e9 service nova] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Received unexpected event network-vif-plugged-ea92909f-40d7-48a8-be09-50439674945c for instance with vm_state resized and task_state resize_reverting.
Aug 09 18:36:22 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:36:22 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:36:22 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:36:23 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:36:24 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691606184.4284751, 03ad5bab-ab32-47fc-b7e8-b32282b9c20d => Resumed> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:36:24 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] VM Resumed (Lifecycle Event)
Aug 09 18:36:24 user nova-compute[72418]: DEBUG nova.compute.manager [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Instance event wait completed in 0 seconds for  {{(pid=72418) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 18:36:24 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Instance running successfully.
Aug 09 18:36:24 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] finish_revert_migration finished successfully. {{(pid=72418) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 09 18:36:24 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:36:24 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:36:24 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 09 18:36:24 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691606184.4321911, 03ad5bab-ab32-47fc-b7e8-b32282b9c20d => Started> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:36:24 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] VM Started (Lifecycle Event)
Aug 09 18:36:24 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:36:24 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:36:24 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 09 18:36:24 user nova-compute[72418]: INFO nova.compute.manager [None req-1e751bd8-1f85-4ece-928d-d3c1b7198d1e tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Updating instance to original state: 'active'
Aug 09 18:36:24 user nova-compute[72418]: DEBUG nova.compute.manager [req-42b464ae-e393-4fcd-a831-c792d6f125ee req-de022ec5-074b-4635-9dee-25caa5cb1c7b service nova] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Received event network-vif-plugged-ea92909f-40d7-48a8-be09-50439674945c {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:36:24 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-42b464ae-e393-4fcd-a831-c792d6f125ee req-de022ec5-074b-4635-9dee-25caa5cb1c7b service nova] Acquiring lock "03ad5bab-ab32-47fc-b7e8-b32282b9c20d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:36:24 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-42b464ae-e393-4fcd-a831-c792d6f125ee req-de022ec5-074b-4635-9dee-25caa5cb1c7b service nova] Lock "03ad5bab-ab32-47fc-b7e8-b32282b9c20d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:36:24 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-42b464ae-e393-4fcd-a831-c792d6f125ee req-de022ec5-074b-4635-9dee-25caa5cb1c7b service nova] Lock "03ad5bab-ab32-47fc-b7e8-b32282b9c20d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:36:24 user nova-compute[72418]: DEBUG nova.compute.manager [req-42b464ae-e393-4fcd-a831-c792d6f125ee req-de022ec5-074b-4635-9dee-25caa5cb1c7b service nova] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] No waiting events found dispatching network-vif-plugged-ea92909f-40d7-48a8-be09-50439674945c {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:36:24 user nova-compute[72418]: WARNING nova.compute.manager [req-42b464ae-e393-4fcd-a831-c792d6f125ee req-de022ec5-074b-4635-9dee-25caa5cb1c7b service nova] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Received unexpected event network-vif-plugged-ea92909f-40d7-48a8-be09-50439674945c for instance with vm_state active and task_state None.
Aug 09 18:36:25 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-276b4208-20a0-4a0a-807f-5906e27f5403 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Acquiring lock "4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:36:25 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-276b4208-20a0-4a0a-807f-5906e27f5403 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:36:25 user nova-compute[72418]: INFO nova.compute.manager [None req-276b4208-20a0-4a0a-807f-5906e27f5403 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Detaching volume 7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6
Aug 09 18:36:25 user nova-compute[72418]: INFO nova.virt.block_device [None req-276b4208-20a0-4a0a-807f-5906e27f5403 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Attempting to driver detach volume 7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6 from mountpoint /dev/vdb
Aug 09 18:36:25 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-9cac0da7-2f25-4c57-ab10-9dde95bbae40 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Acquiring lock "4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:36:25 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-276b4208-20a0-4a0a-807f-5906e27f5403 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Attempting to detach device vdb from instance 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64 from the persistent domain config. {{(pid=72418) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 18:36:25 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-276b4208-20a0-4a0a-807f-5906e27f5403 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 18:36:25 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:36:25 user nova-compute[72418]:   <source dev="/dev/sdf"/>
Aug 09 18:36:25 user nova-compute[72418]:   <target dev="vdb" bus="virtio"/>
Aug 09 18:36:25 user nova-compute[72418]:   <serial>7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6</serial>
Aug 09 18:36:25 user nova-compute[72418]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 18:36:25 user nova-compute[72418]: </disk>
Aug 09 18:36:25 user nova-compute[72418]:  {{(pid=72418) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 18:36:25 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-276b4208-20a0-4a0a-807f-5906e27f5403 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Successfully detached device vdb from instance 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64 from the persistent domain config.
Aug 09 18:36:25 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-276b4208-20a0-4a0a-807f-5906e27f5403 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64 from the live domain config. {{(pid=72418) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 18:36:25 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-276b4208-20a0-4a0a-807f-5906e27f5403 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 18:36:25 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:36:25 user nova-compute[72418]:   <source dev="/dev/sdf"/>
Aug 09 18:36:25 user nova-compute[72418]:   <target dev="vdb" bus="virtio"/>
Aug 09 18:36:25 user nova-compute[72418]:   <serial>7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6</serial>
Aug 09 18:36:25 user nova-compute[72418]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 18:36:25 user nova-compute[72418]: </disk>
Aug 09 18:36:25 user nova-compute[72418]:  {{(pid=72418) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 18:36:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:36:26 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Received event <DeviceRemovedEvent: 1691606186.094415, 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72418) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 18:36:26 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-276b4208-20a0-4a0a-807f-5906e27f5403 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64 {{(pid=72418) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 18:36:26 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-276b4208-20a0-4a0a-807f-5906e27f5403 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Successfully detached device vdb from instance 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64 from the live domain config.
Aug 09 18:36:26 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-276b4208-20a0-4a0a-807f-5906e27f5403 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] calling os-brick to detach iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 18:36:26 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-276b4208-20a0-4a0a-807f-5906e27f5403 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, {'target_iqns': ['iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ACpuUXzW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:36:26 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-276b4208-20a0-4a0a-807f-5906e27f5403 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:36:26 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-276b4208-20a0-4a0a-807f-5906e27f5403 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:36:26 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-276b4208-20a0-4a0a-807f-5906e27f5403 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:36:26 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-276b4208-20a0-4a0a-807f-5906e27f5403 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6', 0)] {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 18:36:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:26 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd4eea9-f64e-4e99-aadd-124f32f4d435]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:36:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:26 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb813a08-81f0-49f3-8199-cb10db3fe35c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:36:26 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-276b4208-20a0-4a0a-807f-5906e27f5403 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:36:26 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:36:26 user nova-compute[72418]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)
Aug 09 18:36:26 user nova-compute[72418]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6 (non-flash)
Aug 09 18:36:26 user nova-compute[72418]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:36:26 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:36:26 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-276b4208-20a0-4a0a-807f-5906e27f5403 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:36:26 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:36:26 user nova-compute[72418]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)
Aug 09 18:36:26 user nova-compute[72418]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6 (non-flash)
Aug 09 18:36:26 user nova-compute[72418]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:36:26 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:36:26 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-276b4208-20a0-4a0a-807f-5906e27f5403 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f42f8119cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6'): ({'sdf'}, set())}) {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 18:36:26 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-276b4208-20a0-4a0a-807f-5906e27f5403 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Removing single pathed devices sdf {{(pid=72418) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 18:36:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.068s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:26 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[9387e38e-a28a-46e4-a458-d2255ecb0af0]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:36:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.026s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:26 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa06a83-b7ca-4130-888e-8f6df0b34c70]: (4, ('ok\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:36:26 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-276b4208-20a0-4a0a-807f-5906e27f5403 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Flushing IO for device /dev/sdf {{(pid=72418) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 18:36:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:26 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d8c551-304e-418e-960c-3b782ccd35c6]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:36:26 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-276b4208-20a0-4a0a-807f-5906e27f5403 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72418) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 18:36:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.076s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:26 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[92638e40-d005-4acf-b1b2-902841e4c30a]: (4, ('1', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:36:26 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-276b4208-20a0-4a0a-807f-5906e27f5403 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 18:36:26 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-276b4208-20a0-4a0a-807f-5906e27f5403 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] SCSI volumes sdf have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 18:36:26 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-276b4208-20a0-4a0a-807f-5906e27f5403 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6')] {{(pid=72418) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 18:36:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.042s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:26 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f5894a-9eb0-48a4-a158-cbdbd766fa15]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:36:26 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-276b4208-20a0-4a0a-807f-5906e27f5403 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:36:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6 -p 172.16.0.220:3260 --logout {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:26 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82361aa-884c-4f0e-b4d1-77521c7fffdf]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:36:26 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-276b4208-20a0-4a0a-807f-5906e27f5403 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6, portal: 172.16.0.220,3260]
Aug 09 18:36:26 user nova-compute[72418]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6, portal: 172.16.0.220,3260] successful.
Aug 09 18:36:26 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:36:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6 -p 172.16.0.220:3260 --op delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:26 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:26 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe1859c-a209-42a2-af87-188287877898]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:36:26 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-276b4208-20a0-4a0a-807f-5906e27f5403 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:36:26 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-276b4208-20a0-4a0a-807f-5906e27f5403 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:36:26 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-276b4208-20a0-4a0a-807f-5906e27f5403 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] <== disconnect_volume: return (393ms) None {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:36:26 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-276b4208-20a0-4a0a-807f-5906e27f5403 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Disconnected iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 18:36:27 user nova-compute[72418]: DEBUG nova.objects.instance [None req-276b4208-20a0-4a0a-807f-5906e27f5403 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lazy-loading 'flavor' on Instance uuid 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:36:27 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-276b4208-20a0-4a0a-807f-5906e27f5403 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.739s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:36:27 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-9cac0da7-2f25-4c57-ab10-9dde95bbae40 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.626s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:36:27 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-9cac0da7-2f25-4c57-ab10-9dde95bbae40 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Acquiring lock "4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:36:27 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-9cac0da7-2f25-4c57-ab10-9dde95bbae40 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:36:27 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-9cac0da7-2f25-4c57-ab10-9dde95bbae40 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:36:27 user nova-compute[72418]: INFO nova.compute.manager [None req-9cac0da7-2f25-4c57-ab10-9dde95bbae40 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Terminating instance
Aug 09 18:36:27 user nova-compute[72418]: DEBUG nova.compute.manager [None req-9cac0da7-2f25-4c57-ab10-9dde95bbae40 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Start destroying the instance on the hypervisor. {{(pid=72418) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 18:36:27 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:36:27 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:36:27 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:36:27 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:36:27 user nova-compute[72418]: DEBUG nova.compute.manager [req-fdeac6f6-4712-41b1-a3d6-cd5c801f4d5c req-6133552e-d39c-4d30-9213-c5868187c982 service nova] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Received event network-vif-unplugged-6a5e7c25-876c-403d-b3d3-9859c970030d {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:36:27 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-fdeac6f6-4712-41b1-a3d6-cd5c801f4d5c req-6133552e-d39c-4d30-9213-c5868187c982 service nova] Acquiring lock "4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:36:27 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-fdeac6f6-4712-41b1-a3d6-cd5c801f4d5c req-6133552e-d39c-4d30-9213-c5868187c982 service nova] Lock "4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:36:27 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-fdeac6f6-4712-41b1-a3d6-cd5c801f4d5c req-6133552e-d39c-4d30-9213-c5868187c982 service nova] Lock "4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:36:27 user nova-compute[72418]: DEBUG nova.compute.manager [req-fdeac6f6-4712-41b1-a3d6-cd5c801f4d5c req-6133552e-d39c-4d30-9213-c5868187c982 service nova] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] No waiting events found dispatching network-vif-unplugged-6a5e7c25-876c-403d-b3d3-9859c970030d {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:36:27 user nova-compute[72418]: DEBUG nova.compute.manager [req-fdeac6f6-4712-41b1-a3d6-cd5c801f4d5c req-6133552e-d39c-4d30-9213-c5868187c982 service nova] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Received event network-vif-unplugged-6a5e7c25-876c-403d-b3d3-9859c970030d for instance with task_state deleting. {{(pid=72418) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 18:36:28 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Instance destroyed successfully.
Aug 09 18:36:28 user nova-compute[72418]: DEBUG nova.objects.instance [None req-9cac0da7-2f25-4c57-ab10-9dde95bbae40 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lazy-loading 'resources' on Instance uuid 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:36:28 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-9cac0da7-2f25-4c57-ab10-9dde95bbae40 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:33:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-499264021',display_name='tempest-VolumesSnapshotTestJSON-instance-499264021',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-499264021',id=28,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNMWVy03XjriP/TJ7/YEscxmJD9kU13yulTLI3siuykjYEfDwTYfKiCessjhJ4B5Q2b3TQ1sqoAJLRd60hoFGEJmIMx4tpodH8Km6SS2dZUxh9D5AtPVawIq2XsIlaZX0Q==',key_name='tempest-keypair-37443166',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:33:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eee663228cbc483896e4fd409c4aa135',ramdisk_id='',reservation_id='r-3hzc6uq3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1926046841',owner_user_name='tempest-VolumesSnapshotTestJSON-1926046841-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:33:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93e127bc79ec49fa813408f36b639504',uuid=4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a5e7c25-876c-403d-b3d3-9859c970030d", "address": "fa:16:3e:b0:f3:60", "network": {"id": "34f771ea-9846-4f27-94a0-c00494d053ab", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-973491744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eee663228cbc483896e4fd409c4aa135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a5e7c25-87", "ovs_interfaceid": "6a5e7c25-876c-403d-b3d3-9859c970030d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 18:36:28 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-9cac0da7-2f25-4c57-ab10-9dde95bbae40 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Converting VIF {"id": "6a5e7c25-876c-403d-b3d3-9859c970030d", "address": "fa:16:3e:b0:f3:60", "network": {"id": "34f771ea-9846-4f27-94a0-c00494d053ab", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-973491744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eee663228cbc483896e4fd409c4aa135", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a5e7c25-87", "ovs_interfaceid": "6a5e7c25-876c-403d-b3d3-9859c970030d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:36:28 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-9cac0da7-2f25-4c57-ab10-9dde95bbae40 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:f3:60,bridge_name='br-int',has_traffic_filtering=True,id=6a5e7c25-876c-403d-b3d3-9859c970030d,network=Network(34f771ea-9846-4f27-94a0-c00494d053ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a5e7c25-87') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:36:28 user nova-compute[72418]: DEBUG os_vif [None req-9cac0da7-2f25-4c57-ab10-9dde95bbae40 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:f3:60,bridge_name='br-int',has_traffic_filtering=True,id=6a5e7c25-876c-403d-b3d3-9859c970030d,network=Network(34f771ea-9846-4f27-94a0-c00494d053ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a5e7c25-87') {{(pid=72418) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 18:36:28 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:36:28 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a5e7c25-87, bridge=br-int, if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:36:28 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:36:28 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:36:28 user nova-compute[72418]: INFO os_vif [None req-9cac0da7-2f25-4c57-ab10-9dde95bbae40 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:f3:60,bridge_name='br-int',has_traffic_filtering=True,id=6a5e7c25-876c-403d-b3d3-9859c970030d,network=Network(34f771ea-9846-4f27-94a0-c00494d053ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a5e7c25-87')
Aug 09 18:36:28 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cac0da7-2f25-4c57-ab10-9dde95bbae40 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] calling os-brick to detach iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 18:36:28 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cac0da7-2f25-4c57-ab10-9dde95bbae40 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, {'target_iqns': ['iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ACpuUXzW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:36:28 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-9cac0da7-2f25-4c57-ab10-9dde95bbae40 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:36:28 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-9cac0da7-2f25-4c57-ab10-9dde95bbae40 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:36:28 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-9cac0da7-2f25-4c57-ab10-9dde95bbae40 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:36:28 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cac0da7-2f25-4c57-ab10-9dde95bbae40 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c0e0ed6-2506-4dd0-9c7b-524b7c7289d6', 0)] {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 18:36:28 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:28 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:28 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18387df-e612-4b96-b27f-e0e5ca638047]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:36:28 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:36:28 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:36:28 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54b7059-24b1-4049-810c-7a417038c9aa]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:36:28 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cac0da7-2f25-4c57-ab10-9dde95bbae40 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:36:28 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:36:28 user nova-compute[72418]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)
Aug 09 18:36:28 user nova-compute[72418]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:36:28 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:36:28 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cac0da7-2f25-4c57-ab10-9dde95bbae40 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:36:28 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:36:28 user nova-compute[72418]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)
Aug 09 18:36:28 user nova-compute[72418]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:36:28 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:36:28 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cac0da7-2f25-4c57-ab10-9dde95bbae40 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f42d46393f0>, {}) {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 18:36:28 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cac0da7-2f25-4c57-ab10-9dde95bbae40 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Disconnecting from: [] {{(pid=72418) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 18:36:28 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-9cac0da7-2f25-4c57-ab10-9dde95bbae40 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.052s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:36:28 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cac0da7-2f25-4c57-ab10-9dde95bbae40 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] <== disconnect_volume: return (53ms) None {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:36:28 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cac0da7-2f25-4c57-ab10-9dde95bbae40 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Disconnected iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 18:36:28 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-9cac0da7-2f25-4c57-ab10-9dde95bbae40 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Deleting instance files /opt/stack/data/nova/instances/4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64_del
Aug 09 18:36:28 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-9cac0da7-2f25-4c57-ab10-9dde95bbae40 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Deletion of /opt/stack/data/nova/instances/4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64_del complete
Aug 09 18:36:28 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:36:28 user nova-compute[72418]: INFO nova.compute.manager [None req-9cac0da7-2f25-4c57-ab10-9dde95bbae40 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 09 18:36:28 user nova-compute[72418]: DEBUG oslo.service.loopingcall [None req-9cac0da7-2f25-4c57-ab10-9dde95bbae40 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72418) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 18:36:28 user nova-compute[72418]: DEBUG nova.compute.manager [-] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Deallocating network for instance {{(pid=72418) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 18:36:28 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] deallocate_for_instance() {{(pid=72418) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 18:36:29 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:36:29 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Took 1.33 seconds to deallocate network for instance.
Aug 09 18:36:29 user nova-compute[72418]: DEBUG nova.compute.manager [req-9bdbaa06-cbb5-428b-8a17-3ce3f50573ca req-358463a4-ee12-4754-bd33-2b9c980c6bea service nova] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Received event network-vif-deleted-6a5e7c25-876c-403d-b3d3-9859c970030d {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:36:29 user nova-compute[72418]: INFO nova.compute.manager [req-9bdbaa06-cbb5-428b-8a17-3ce3f50573ca req-358463a4-ee12-4754-bd33-2b9c980c6bea service nova] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Neutron deleted interface 6a5e7c25-876c-403d-b3d3-9859c970030d; detaching it from the instance and deleting it from the info cache
Aug 09 18:36:29 user nova-compute[72418]: DEBUG nova.network.neutron [req-9bdbaa06-cbb5-428b-8a17-3ce3f50573ca req-358463a4-ee12-4754-bd33-2b9c980c6bea service nova] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:36:29 user nova-compute[72418]: WARNING nova.volume.cinder [None req-9cac0da7-2f25-4c57-ab10-9dde95bbae40 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Attachment 0a426aa9-6a57-47bd-a2e5-902d86fc13cb does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 0a426aa9-6a57-47bd-a2e5-902d86fc13cb. (HTTP 404) (Request-ID: req-c5d32dde-4adc-446e-8542-248174cc3d48)
Aug 09 18:36:29 user nova-compute[72418]: INFO nova.compute.manager [None req-9cac0da7-2f25-4c57-ab10-9dde95bbae40 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Took 0.03 seconds to detach 1 volumes for instance.
Aug 09 18:36:29 user nova-compute[72418]: DEBUG nova.compute.manager [req-9bdbaa06-cbb5-428b-8a17-3ce3f50573ca req-358463a4-ee12-4754-bd33-2b9c980c6bea service nova] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Detach interface failed, port_id=6a5e7c25-876c-403d-b3d3-9859c970030d, reason: Instance 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64 could not be found. {{(pid=72418) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 18:36:29 user nova-compute[72418]: DEBUG nova.compute.manager [req-6f2245f9-a376-473b-b9ab-78b3e7f3a676 req-e1e23a96-c46f-4774-8716-4b0ad180f0f0 service nova] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Received event network-vif-plugged-6a5e7c25-876c-403d-b3d3-9859c970030d {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:36:29 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-6f2245f9-a376-473b-b9ab-78b3e7f3a676 req-e1e23a96-c46f-4774-8716-4b0ad180f0f0 service nova] Acquiring lock "4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:36:29 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-6f2245f9-a376-473b-b9ab-78b3e7f3a676 req-e1e23a96-c46f-4774-8716-4b0ad180f0f0 service nova] Lock "4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:36:29 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-6f2245f9-a376-473b-b9ab-78b3e7f3a676 req-e1e23a96-c46f-4774-8716-4b0ad180f0f0 service nova] Lock "4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:36:29 user nova-compute[72418]: DEBUG nova.compute.manager [req-6f2245f9-a376-473b-b9ab-78b3e7f3a676 req-e1e23a96-c46f-4774-8716-4b0ad180f0f0 service nova] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] No waiting events found dispatching network-vif-plugged-6a5e7c25-876c-403d-b3d3-9859c970030d {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:36:29 user nova-compute[72418]: WARNING nova.compute.manager [req-6f2245f9-a376-473b-b9ab-78b3e7f3a676 req-e1e23a96-c46f-4774-8716-4b0ad180f0f0 service nova] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Received unexpected event network-vif-plugged-6a5e7c25-876c-403d-b3d3-9859c970030d for instance with vm_state active and task_state deleting.
Aug 09 18:36:29 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-9cac0da7-2f25-4c57-ab10-9dde95bbae40 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:36:29 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-9cac0da7-2f25-4c57-ab10-9dde95bbae40 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:36:30 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-9cac0da7-2f25-4c57-ab10-9dde95bbae40 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:36:30 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-9cac0da7-2f25-4c57-ab10-9dde95bbae40 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:36:30 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-9cac0da7-2f25-4c57-ab10-9dde95bbae40 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.429s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:36:30 user nova-compute[72418]: INFO nova.scheduler.client.report [None req-9cac0da7-2f25-4c57-ab10-9dde95bbae40 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Deleted allocations for instance 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64
Aug 09 18:36:30 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-9cac0da7-2f25-4c57-ab10-9dde95bbae40 tempest-VolumesSnapshotTestJSON-1926046841 tempest-VolumesSnapshotTestJSON-1926046841-project-member] Lock "4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.920s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:36:33 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:36:33 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:36:38 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:36:38 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:36:43 user nova-compute[72418]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691606188.1041791, 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64 => Stopped> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:36:43 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] VM Stopped (Lifecycle Event)
Aug 09 18:36:43 user nova-compute[72418]: DEBUG nova.compute.manager [None req-aaf4807c-baa9-4987-82be-415b8e0b87fa None None] [instance: 4b4b1bf8-3f49-4e37-8f28-0ed0ba2cab64] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:36:43 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:36:43 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:36:48 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:36:48 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:36:53 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:36:53 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:36:58 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:37:00 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:37:00 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:37:00 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Starting heal instance info cache {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 18:37:00 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "refresh_cache-8fe41968-a219-4a5a-afdb-32eb2082bb40" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:37:00 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquired lock "refresh_cache-8fe41968-a219-4a5a-afdb-32eb2082bb40" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:37:00 user nova-compute[72418]: DEBUG nova.network.neutron [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Forcefully refreshing network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 18:37:01 user nova-compute[72418]: DEBUG nova.network.neutron [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Updating instance_info_cache with network_info: [{"id": "2e2b5832-b357-4012-8bfc-d26009aa91f8", "address": "fa:16:3e:ee:f9:5d", "network": {"id": "beaefb5c-f5e4-47e7-ab68-60131f532ade", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e5863cda54487682a4edcc24202c91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2b5832-b3", "ovs_interfaceid": "2e2b5832-b357-4012-8bfc-d26009aa91f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:37:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Releasing lock "refresh_cache-8fe41968-a219-4a5a-afdb-32eb2082bb40" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:37:01 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Updated the network info_cache for instance {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 18:37:01 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:37:01 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:37:01 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:37:01 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:37:01 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:37:01 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:37:01 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72418) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 18:37:01 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:37:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:37:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:37:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:37:01 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Auditing locally available compute resources for user (node: user) {{(pid=72418) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 18:37:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c53f871-2be9-4119-b5c0-d5081e2f4388/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c53f871-2be9-4119-b5c0-d5081e2f4388/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c53f871-2be9-4119-b5c0-d5081e2f4388/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c53f871-2be9-4119-b5c0-d5081e2f4388/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:03 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:37:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/873654d4-9cf2-4dde-859c-ad26d05d6e0a/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:37:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/873654d4-9cf2-4dde-859c-ad26d05d6e0a/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/873654d4-9cf2-4dde-859c-ad26d05d6e0a/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/873654d4-9cf2-4dde-859c-ad26d05d6e0a/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9e974b-b993-4f4e-9446-14941c39f109/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9e974b-b993-4f4e-9446-14941c39f109/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9e974b-b993-4f4e-9446-14941c39f109/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9e974b-b993-4f4e-9446-14941c39f109/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f49889-df0b-48c1-97ce-5c331b6a65ce/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f49889-df0b-48c1-97ce-5c331b6a65ce/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f49889-df0b-48c1-97ce-5c331b6a65ce/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f49889-df0b-48c1-97ce-5c331b6a65ce/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:05 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:37:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e24ebafb-73cb-42ea-a0b6-2263badd573f/disk.rescue --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e24ebafb-73cb-42ea-a0b6-2263badd573f/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e24ebafb-73cb-42ea-a0b6-2263badd573f/disk.rescue --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e24ebafb-73cb-42ea-a0b6-2263badd573f/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e582b61c-d998-4a3f-8392-a7f0e94a4dec/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e582b61c-d998-4a3f-8392-a7f0e94a4dec/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e582b61c-d998-4a3f-8392-a7f0e94a4dec/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e582b61c-d998-4a3f-8392-a7f0e94a4dec/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:05 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:37:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:06 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:37:06 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:37:06 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:37:06 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Hypervisor/Node resource view: name=user free_ram=6915MB free_disk=25.189693450927734GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72418) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 18:37:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:37:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:37:06 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 6af7918a-ce90-45ab-93d8-684e1489e891 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:37:06 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 8fe41968-a219-4a5a-afdb-32eb2082bb40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:37:06 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 01c46b33-6788-44a5-a43c-88ee4acc4d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:37:06 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance e019064c-955e-4f80-9b00-6b32b3835d58 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:37:06 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance c46f2599-93f8-412e-9918-7ace8a9f19dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:37:06 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 1c53f871-2be9-4119-b5c0-d5081e2f4388 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:37:06 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance e582b61c-d998-4a3f-8392-a7f0e94a4dec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:37:06 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 2c9e974b-b993-4f4e-9446-14941c39f109 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:37:06 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance e24ebafb-73cb-42ea-a0b6-2263badd573f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:37:06 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 03ad5bab-ab32-47fc-b7e8-b32282b9c20d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:37:06 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 0659fd5c-cb05-441e-94b6-9d05f7135893 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:37:06 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 97f49889-df0b-48c1-97ce-5c331b6a65ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:37:06 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 873654d4-9cf2-4dde-859c-ad26d05d6e0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:37:06 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 4e1a095f-a2e7-4ab6-bb7e-38cda890d567 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:37:06 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 18:37:06 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 18:37:07 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:37:07 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:37:07 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Compute_service record updated for user:user {{(pid=72418) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 18:37:07 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.586s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:37:08 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:37:08 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-8f807ffc-4a8c-4ca9-8f9a-c1599dffa683 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Acquiring lock "1c53f871-2be9-4119-b5c0-d5081e2f4388" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:37:08 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-8f807ffc-4a8c-4ca9-8f9a-c1599dffa683 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "1c53f871-2be9-4119-b5c0-d5081e2f4388" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:37:08 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-8f807ffc-4a8c-4ca9-8f9a-c1599dffa683 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Acquiring lock "1c53f871-2be9-4119-b5c0-d5081e2f4388-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:37:08 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-8f807ffc-4a8c-4ca9-8f9a-c1599dffa683 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "1c53f871-2be9-4119-b5c0-d5081e2f4388-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:37:08 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-8f807ffc-4a8c-4ca9-8f9a-c1599dffa683 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "1c53f871-2be9-4119-b5c0-d5081e2f4388-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:37:08 user nova-compute[72418]: INFO nova.compute.manager [None req-8f807ffc-4a8c-4ca9-8f9a-c1599dffa683 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Terminating instance
Aug 09 18:37:08 user nova-compute[72418]: DEBUG nova.compute.manager [None req-8f807ffc-4a8c-4ca9-8f9a-c1599dffa683 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Start destroying the instance on the hypervisor. {{(pid=72418) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 18:37:09 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:37:09 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:37:09 user nova-compute[72418]: DEBUG nova.compute.manager [req-ee9e26d3-a312-41ba-9c9f-b3c08a1ca4a0 req-7e28ad2b-7ca5-45f3-8eb3-7689a98a9022 service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Received event network-vif-unplugged-84eb2df4-6995-47c5-bf0f-387932ece66d {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:37:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-ee9e26d3-a312-41ba-9c9f-b3c08a1ca4a0 req-7e28ad2b-7ca5-45f3-8eb3-7689a98a9022 service nova] Acquiring lock "1c53f871-2be9-4119-b5c0-d5081e2f4388-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:37:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-ee9e26d3-a312-41ba-9c9f-b3c08a1ca4a0 req-7e28ad2b-7ca5-45f3-8eb3-7689a98a9022 service nova] Lock "1c53f871-2be9-4119-b5c0-d5081e2f4388-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:37:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-ee9e26d3-a312-41ba-9c9f-b3c08a1ca4a0 req-7e28ad2b-7ca5-45f3-8eb3-7689a98a9022 service nova] Lock "1c53f871-2be9-4119-b5c0-d5081e2f4388-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:37:09 user nova-compute[72418]: DEBUG nova.compute.manager [req-ee9e26d3-a312-41ba-9c9f-b3c08a1ca4a0 req-7e28ad2b-7ca5-45f3-8eb3-7689a98a9022 service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] No waiting events found dispatching network-vif-unplugged-84eb2df4-6995-47c5-bf0f-387932ece66d {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:37:09 user nova-compute[72418]: DEBUG nova.compute.manager [req-ee9e26d3-a312-41ba-9c9f-b3c08a1ca4a0 req-7e28ad2b-7ca5-45f3-8eb3-7689a98a9022 service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Received event network-vif-unplugged-84eb2df4-6995-47c5-bf0f-387932ece66d for instance with task_state deleting. {{(pid=72418) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 18:37:09 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:37:09 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:37:09 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:37:09 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Instance destroyed successfully.
Aug 09 18:37:09 user nova-compute[72418]: DEBUG nova.objects.instance [None req-8f807ffc-4a8c-4ca9-8f9a-c1599dffa683 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lazy-loading 'resources' on Instance uuid 1c53f871-2be9-4119-b5c0-d5081e2f4388 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:37:09 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-8f807ffc-4a8c-4ca9-8f9a-c1599dffa683 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:30:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-726518213',display_name='tempest-ServerRescueNegativeTestJSON-server-726518213',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-726518213',id=23,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYgqOVWyn0dFX4Ed9YyvsFFE+jrecgTvMY887w9viUNHXtdgFMObE/m2tkO2gGT++FsK404JHMmKjOtdQQqB+ock45M5UHDZsc/R8Qw31XfQ2breULNzs/hrNYbxNLAYg==',key_name='tempest-keypair-462614825',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:32:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5c68622cd79472ba6ad14a6876aeaea',ramdisk_id='',reservation_id='r-pyrt30fh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-326572915',owner_user_name='tempest-ServerRescueNegativeTestJSON-326572915-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:34:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3c4feb0a14841eeb757a79b6a05d1fa',uuid=1c53f871-2be9-4119-b5c0-d5081e2f4388,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84eb2df4-6995-47c5-bf0f-387932ece66d", "address": "fa:16:3e:d2:b0:b4", "network": {"id": "15a49d9b-3c0d-449b-9473-29f219960e2c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c68622cd79472ba6ad14a6876aeaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84eb2df4-69", "ovs_interfaceid": "84eb2df4-6995-47c5-bf0f-387932ece66d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 18:37:09 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-8f807ffc-4a8c-4ca9-8f9a-c1599dffa683 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Converting VIF {"id": "84eb2df4-6995-47c5-bf0f-387932ece66d", "address": "fa:16:3e:d2:b0:b4", "network": {"id": "15a49d9b-3c0d-449b-9473-29f219960e2c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c68622cd79472ba6ad14a6876aeaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84eb2df4-69", "ovs_interfaceid": "84eb2df4-6995-47c5-bf0f-387932ece66d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:37:09 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-8f807ffc-4a8c-4ca9-8f9a-c1599dffa683 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:b0:b4,bridge_name='br-int',has_traffic_filtering=True,id=84eb2df4-6995-47c5-bf0f-387932ece66d,network=Network(15a49d9b-3c0d-449b-9473-29f219960e2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84eb2df4-69') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:37:09 user nova-compute[72418]: DEBUG os_vif [None req-8f807ffc-4a8c-4ca9-8f9a-c1599dffa683 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:b0:b4,bridge_name='br-int',has_traffic_filtering=True,id=84eb2df4-6995-47c5-bf0f-387932ece66d,network=Network(15a49d9b-3c0d-449b-9473-29f219960e2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84eb2df4-69') {{(pid=72418) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 18:37:09 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:37:09 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84eb2df4-69, bridge=br-int, if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:37:09 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:37:09 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:37:09 user nova-compute[72418]: INFO os_vif [None req-8f807ffc-4a8c-4ca9-8f9a-c1599dffa683 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:b0:b4,bridge_name='br-int',has_traffic_filtering=True,id=84eb2df4-6995-47c5-bf0f-387932ece66d,network=Network(15a49d9b-3c0d-449b-9473-29f219960e2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84eb2df4-69')
Aug 09 18:37:09 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-8f807ffc-4a8c-4ca9-8f9a-c1599dffa683 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Deleting instance files /opt/stack/data/nova/instances/1c53f871-2be9-4119-b5c0-d5081e2f4388_del
Aug 09 18:37:09 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-8f807ffc-4a8c-4ca9-8f9a-c1599dffa683 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Deletion of /opt/stack/data/nova/instances/1c53f871-2be9-4119-b5c0-d5081e2f4388_del complete
Aug 09 18:37:09 user nova-compute[72418]: INFO nova.compute.manager [None req-8f807ffc-4a8c-4ca9-8f9a-c1599dffa683 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 09 18:37:09 user nova-compute[72418]: DEBUG oslo.service.loopingcall [None req-8f807ffc-4a8c-4ca9-8f9a-c1599dffa683 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72418) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 18:37:09 user nova-compute[72418]: DEBUG nova.compute.manager [-] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Deallocating network for instance {{(pid=72418) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 18:37:09 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] deallocate_for_instance() {{(pid=72418) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 18:37:10 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:37:10 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Took 1.02 seconds to deallocate network for instance.
Aug 09 18:37:10 user nova-compute[72418]: DEBUG nova.compute.manager [req-ed7e01b3-f043-48d0-9789-2e6512b40687 req-143421ad-818a-471e-97a6-7ae7125ce7d9 service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Received event network-vif-deleted-84eb2df4-6995-47c5-bf0f-387932ece66d {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:37:10 user nova-compute[72418]: INFO nova.compute.manager [req-ed7e01b3-f043-48d0-9789-2e6512b40687 req-143421ad-818a-471e-97a6-7ae7125ce7d9 service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Neutron deleted interface 84eb2df4-6995-47c5-bf0f-387932ece66d; detaching it from the instance and deleting it from the info cache
Aug 09 18:37:10 user nova-compute[72418]: DEBUG nova.network.neutron [req-ed7e01b3-f043-48d0-9789-2e6512b40687 req-143421ad-818a-471e-97a6-7ae7125ce7d9 service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:37:10 user nova-compute[72418]: DEBUG nova.compute.manager [req-ed7e01b3-f043-48d0-9789-2e6512b40687 req-143421ad-818a-471e-97a6-7ae7125ce7d9 service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Detach interface failed, port_id=84eb2df4-6995-47c5-bf0f-387932ece66d, reason: Instance 1c53f871-2be9-4119-b5c0-d5081e2f4388 could not be found. {{(pid=72418) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 18:37:10 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-8f807ffc-4a8c-4ca9-8f9a-c1599dffa683 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:37:10 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-8f807ffc-4a8c-4ca9-8f9a-c1599dffa683 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:37:11 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-8f807ffc-4a8c-4ca9-8f9a-c1599dffa683 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:37:11 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-8f807ffc-4a8c-4ca9-8f9a-c1599dffa683 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:37:11 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-8f807ffc-4a8c-4ca9-8f9a-c1599dffa683 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.388s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:37:11 user nova-compute[72418]: INFO nova.scheduler.client.report [None req-8f807ffc-4a8c-4ca9-8f9a-c1599dffa683 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Deleted allocations for instance 1c53f871-2be9-4119-b5c0-d5081e2f4388
Aug 09 18:37:11 user nova-compute[72418]: DEBUG nova.compute.manager [req-51ede361-28c1-4148-8cbf-bdeaced777b0 req-43964abc-754e-4401-8ed2-a631de1ce4fc service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Received event network-vif-plugged-84eb2df4-6995-47c5-bf0f-387932ece66d {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:37:11 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-51ede361-28c1-4148-8cbf-bdeaced777b0 req-43964abc-754e-4401-8ed2-a631de1ce4fc service nova] Acquiring lock "1c53f871-2be9-4119-b5c0-d5081e2f4388-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:37:11 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-51ede361-28c1-4148-8cbf-bdeaced777b0 req-43964abc-754e-4401-8ed2-a631de1ce4fc service nova] Lock "1c53f871-2be9-4119-b5c0-d5081e2f4388-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:37:11 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-51ede361-28c1-4148-8cbf-bdeaced777b0 req-43964abc-754e-4401-8ed2-a631de1ce4fc service nova] Lock "1c53f871-2be9-4119-b5c0-d5081e2f4388-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:37:11 user nova-compute[72418]: DEBUG nova.compute.manager [req-51ede361-28c1-4148-8cbf-bdeaced777b0 req-43964abc-754e-4401-8ed2-a631de1ce4fc service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] No waiting events found dispatching network-vif-plugged-84eb2df4-6995-47c5-bf0f-387932ece66d {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:37:11 user nova-compute[72418]: WARNING nova.compute.manager [req-51ede361-28c1-4148-8cbf-bdeaced777b0 req-43964abc-754e-4401-8ed2-a631de1ce4fc service nova] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Received unexpected event network-vif-plugged-84eb2df4-6995-47c5-bf0f-387932ece66d for instance with vm_state deleted and task_state None.
Aug 09 18:37:11 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-8f807ffc-4a8c-4ca9-8f9a-c1599dffa683 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "1c53f871-2be9-4119-b5c0-d5081e2f4388" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.479s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:37:12 user nova-compute[72418]: INFO nova.compute.manager [None req-2e69b0c3-dbdb-4077-83be-06077bda65e9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Unrescuing
Aug 09 18:37:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-2e69b0c3-dbdb-4077-83be-06077bda65e9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquiring lock "refresh_cache-e24ebafb-73cb-42ea-a0b6-2263badd573f" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:37:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-2e69b0c3-dbdb-4077-83be-06077bda65e9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquired lock "refresh_cache-e24ebafb-73cb-42ea-a0b6-2263badd573f" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:37:12 user nova-compute[72418]: DEBUG nova.network.neutron [None req-2e69b0c3-dbdb-4077-83be-06077bda65e9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:37:13 user nova-compute[72418]: DEBUG nova.network.neutron [None req-2e69b0c3-dbdb-4077-83be-06077bda65e9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Updating instance_info_cache with network_info: [{"id": "af96e29f-e6ad-495f-9703-9597a81cb2ef", "address": "fa:16:3e:4f:13:a9", "network": {"id": "beaefb5c-f5e4-47e7-ab68-60131f532ade", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e5863cda54487682a4edcc24202c91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf96e29f-e6", "ovs_interfaceid": "af96e29f-e6ad-495f-9703-9597a81cb2ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:37:13 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-2e69b0c3-dbdb-4077-83be-06077bda65e9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Releasing lock "refresh_cache-e24ebafb-73cb-42ea-a0b6-2263badd573f" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:37:13 user nova-compute[72418]: DEBUG nova.objects.instance [None req-2e69b0c3-dbdb-4077-83be-06077bda65e9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lazy-loading 'flavor' on Instance uuid e24ebafb-73cb-42ea-a0b6-2263badd573f {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:37:13 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:37:13 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:37:13 user nova-compute[72418]: DEBUG nova.compute.manager [req-a8d09ed2-ec9b-48a7-90e0-13145d54230f req-7d4fefa8-c428-46c6-a1d3-ea9dfeb86f35 service nova] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Received event network-vif-unplugged-af96e29f-e6ad-495f-9703-9597a81cb2ef {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:37:13 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a8d09ed2-ec9b-48a7-90e0-13145d54230f req-7d4fefa8-c428-46c6-a1d3-ea9dfeb86f35 service nova] Acquiring lock "e24ebafb-73cb-42ea-a0b6-2263badd573f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:37:13 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a8d09ed2-ec9b-48a7-90e0-13145d54230f req-7d4fefa8-c428-46c6-a1d3-ea9dfeb86f35 service nova] Lock "e24ebafb-73cb-42ea-a0b6-2263badd573f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:37:13 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a8d09ed2-ec9b-48a7-90e0-13145d54230f req-7d4fefa8-c428-46c6-a1d3-ea9dfeb86f35 service nova] Lock "e24ebafb-73cb-42ea-a0b6-2263badd573f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:37:13 user nova-compute[72418]: DEBUG nova.compute.manager [req-a8d09ed2-ec9b-48a7-90e0-13145d54230f req-7d4fefa8-c428-46c6-a1d3-ea9dfeb86f35 service nova] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] No waiting events found dispatching network-vif-unplugged-af96e29f-e6ad-495f-9703-9597a81cb2ef {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:37:13 user nova-compute[72418]: WARNING nova.compute.manager [req-a8d09ed2-ec9b-48a7-90e0-13145d54230f req-7d4fefa8-c428-46c6-a1d3-ea9dfeb86f35 service nova] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Received unexpected event network-vif-unplugged-af96e29f-e6ad-495f-9703-9597a81cb2ef for instance with vm_state rescued and task_state unrescuing.
Aug 09 18:37:13 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:37:13 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:37:14 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Instance destroyed successfully.
Aug 09 18:37:14 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:37:15 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:37:15 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:37:15 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:37:15 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:37:15 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:37:15 user nova-compute[72418]: DEBUG nova.compute.manager [req-5419e593-49d8-4284-8355-3a5b257a4479 req-60ad93a5-3df9-473d-834f-e13196c696e3 service nova] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Received event network-vif-plugged-af96e29f-e6ad-495f-9703-9597a81cb2ef {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:37:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-5419e593-49d8-4284-8355-3a5b257a4479 req-60ad93a5-3df9-473d-834f-e13196c696e3 service nova] Acquiring lock "e24ebafb-73cb-42ea-a0b6-2263badd573f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:37:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-5419e593-49d8-4284-8355-3a5b257a4479 req-60ad93a5-3df9-473d-834f-e13196c696e3 service nova] Lock "e24ebafb-73cb-42ea-a0b6-2263badd573f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:37:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-5419e593-49d8-4284-8355-3a5b257a4479 req-60ad93a5-3df9-473d-834f-e13196c696e3 service nova] Lock "e24ebafb-73cb-42ea-a0b6-2263badd573f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:37:15 user nova-compute[72418]: DEBUG nova.compute.manager [req-5419e593-49d8-4284-8355-3a5b257a4479 req-60ad93a5-3df9-473d-834f-e13196c696e3 service nova] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] No waiting events found dispatching network-vif-plugged-af96e29f-e6ad-495f-9703-9597a81cb2ef {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:37:15 user nova-compute[72418]: WARNING nova.compute.manager [req-5419e593-49d8-4284-8355-3a5b257a4479 req-60ad93a5-3df9-473d-834f-e13196c696e3 service nova] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Received unexpected event network-vif-plugged-af96e29f-e6ad-495f-9703-9597a81cb2ef for instance with vm_state rescued and task_state unrescuing.
Aug 09 18:37:15 user nova-compute[72418]: DEBUG nova.compute.manager [req-5419e593-49d8-4284-8355-3a5b257a4479 req-60ad93a5-3df9-473d-834f-e13196c696e3 service nova] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Received event network-vif-plugged-af96e29f-e6ad-495f-9703-9597a81cb2ef {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:37:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-5419e593-49d8-4284-8355-3a5b257a4479 req-60ad93a5-3df9-473d-834f-e13196c696e3 service nova] Acquiring lock "e24ebafb-73cb-42ea-a0b6-2263badd573f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:37:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-5419e593-49d8-4284-8355-3a5b257a4479 req-60ad93a5-3df9-473d-834f-e13196c696e3 service nova] Lock "e24ebafb-73cb-42ea-a0b6-2263badd573f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:37:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-5419e593-49d8-4284-8355-3a5b257a4479 req-60ad93a5-3df9-473d-834f-e13196c696e3 service nova] Lock "e24ebafb-73cb-42ea-a0b6-2263badd573f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:37:15 user nova-compute[72418]: DEBUG nova.compute.manager [req-5419e593-49d8-4284-8355-3a5b257a4479 req-60ad93a5-3df9-473d-834f-e13196c696e3 service nova] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] No waiting events found dispatching network-vif-plugged-af96e29f-e6ad-495f-9703-9597a81cb2ef {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:37:15 user nova-compute[72418]: WARNING nova.compute.manager [req-5419e593-49d8-4284-8355-3a5b257a4479 req-60ad93a5-3df9-473d-834f-e13196c696e3 service nova] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Received unexpected event network-vif-plugged-af96e29f-e6ad-495f-9703-9597a81cb2ef for instance with vm_state rescued and task_state unrescuing.
Aug 09 18:37:15 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:37:15 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:37:17 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Removed pending event for e24ebafb-73cb-42ea-a0b6-2263badd573f due to event {{(pid=72418) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 18:37:17 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691606237.4277194, e24ebafb-73cb-42ea-a0b6-2263badd573f => Resumed> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:37:17 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] VM Resumed (Lifecycle Event)
Aug 09 18:37:17 user nova-compute[72418]: DEBUG nova.compute.manager [None req-2e69b0c3-dbdb-4077-83be-06077bda65e9 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:37:17 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:37:17 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:37:17 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 09 18:37:17 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691606237.4289584, e24ebafb-73cb-42ea-a0b6-2263badd573f => Started> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:37:17 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] VM Started (Lifecycle Event)
Aug 09 18:37:17 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:37:17 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:37:17 user nova-compute[72418]: DEBUG nova.compute.manager [req-fcf05c82-2738-43c0-9f31-19683d648126 req-449dc7eb-6546-408b-bfdb-c856f0f4509c service nova] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Received event network-vif-plugged-af96e29f-e6ad-495f-9703-9597a81cb2ef {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:37:17 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-fcf05c82-2738-43c0-9f31-19683d648126 req-449dc7eb-6546-408b-bfdb-c856f0f4509c service nova] Acquiring lock "e24ebafb-73cb-42ea-a0b6-2263badd573f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:37:17 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-fcf05c82-2738-43c0-9f31-19683d648126 req-449dc7eb-6546-408b-bfdb-c856f0f4509c service nova] Lock "e24ebafb-73cb-42ea-a0b6-2263badd573f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:37:17 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-fcf05c82-2738-43c0-9f31-19683d648126 req-449dc7eb-6546-408b-bfdb-c856f0f4509c service nova] Lock "e24ebafb-73cb-42ea-a0b6-2263badd573f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:37:17 user nova-compute[72418]: DEBUG nova.compute.manager [req-fcf05c82-2738-43c0-9f31-19683d648126 req-449dc7eb-6546-408b-bfdb-c856f0f4509c service nova] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] No waiting events found dispatching network-vif-plugged-af96e29f-e6ad-495f-9703-9597a81cb2ef {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:37:17 user nova-compute[72418]: WARNING nova.compute.manager [req-fcf05c82-2738-43c0-9f31-19683d648126 req-449dc7eb-6546-408b-bfdb-c856f0f4509c service nova] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Received unexpected event network-vif-plugged-af96e29f-e6ad-495f-9703-9597a81cb2ef for instance with vm_state active and task_state None.
Aug 09 18:37:18 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:37:19 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:37:20 user nova-compute[72418]: DEBUG nova.compute.manager [req-8f4c367a-5578-4a0c-88bc-14f3943ef877 req-5739551e-3cfa-49e4-8019-74814f38c222 service nova] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Received event network-changed-6c9676d3-6e5d-4a95-a24f-0df4a15e993d {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:37:20 user nova-compute[72418]: DEBUG nova.compute.manager [req-8f4c367a-5578-4a0c-88bc-14f3943ef877 req-5739551e-3cfa-49e4-8019-74814f38c222 service nova] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Refreshing instance network info cache due to event network-changed-6c9676d3-6e5d-4a95-a24f-0df4a15e993d. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:37:20 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-8f4c367a-5578-4a0c-88bc-14f3943ef877 req-5739551e-3cfa-49e4-8019-74814f38c222 service nova] Acquiring lock "refresh_cache-c46f2599-93f8-412e-9918-7ace8a9f19dd" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:37:20 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-8f4c367a-5578-4a0c-88bc-14f3943ef877 req-5739551e-3cfa-49e4-8019-74814f38c222 service nova] Acquired lock "refresh_cache-c46f2599-93f8-412e-9918-7ace8a9f19dd" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:37:20 user nova-compute[72418]: DEBUG nova.network.neutron [req-8f4c367a-5578-4a0c-88bc-14f3943ef877 req-5739551e-3cfa-49e4-8019-74814f38c222 service nova] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Refreshing network info cache for port 6c9676d3-6e5d-4a95-a24f-0df4a15e993d {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:37:21 user nova-compute[72418]: DEBUG nova.network.neutron [req-8f4c367a-5578-4a0c-88bc-14f3943ef877 req-5739551e-3cfa-49e4-8019-74814f38c222 service nova] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Updated VIF entry in instance network info cache for port 6c9676d3-6e5d-4a95-a24f-0df4a15e993d. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:37:21 user nova-compute[72418]: DEBUG nova.network.neutron [req-8f4c367a-5578-4a0c-88bc-14f3943ef877 req-5739551e-3cfa-49e4-8019-74814f38c222 service nova] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Updating instance_info_cache with network_info: [{"id": "6c9676d3-6e5d-4a95-a24f-0df4a15e993d", "address": "fa:16:3e:80:17:d9", "network": {"id": "bd36ef30-e57d-473f-97bc-c51b5db08aa7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-425133239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78b6e36a5b61456092ce7de9212c3c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9676d3-6e", "ovs_interfaceid": "6c9676d3-6e5d-4a95-a24f-0df4a15e993d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:37:21 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-8f4c367a-5578-4a0c-88bc-14f3943ef877 req-5739551e-3cfa-49e4-8019-74814f38c222 service nova] Releasing lock "refresh_cache-c46f2599-93f8-412e-9918-7ace8a9f19dd" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:37:22 user nova-compute[72418]: DEBUG nova.compute.manager [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Stashing vm_state: active {{(pid=72418) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 09 18:37:22 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:37:22 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:37:22 user nova-compute[72418]: DEBUG nova.objects.instance [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lazy-loading 'pci_requests' on Instance uuid 0659fd5c-cb05-441e-94b6-9d05f7135893 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:37:22 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72418) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 18:37:22 user nova-compute[72418]: INFO nova.compute.claims [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Claim successful on node user
Aug 09 18:37:22 user nova-compute[72418]: DEBUG nova.objects.instance [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lazy-loading 'resources' on Instance uuid 0659fd5c-cb05-441e-94b6-9d05f7135893 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:37:22 user nova-compute[72418]: DEBUG nova.objects.instance [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lazy-loading 'pci_devices' on Instance uuid 0659fd5c-cb05-441e-94b6-9d05f7135893 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:37:22 user nova-compute[72418]: INFO nova.compute.resource_tracker [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Updating resource usage from migration f736d05d-3ba5-4d57-8e9c-332bae8c553f
Aug 09 18:37:22 user nova-compute[72418]: DEBUG nova.compute.manager [req-d2b13899-c852-4d0a-a458-1790214c67f6 req-b79b0e16-f45a-4337-8431-4db66b586570 service nova] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Received event network-changed-0cd6232b-ea64-4978-bc0e-0e84995fd9a4 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:37:22 user nova-compute[72418]: DEBUG nova.compute.manager [req-d2b13899-c852-4d0a-a458-1790214c67f6 req-b79b0e16-f45a-4337-8431-4db66b586570 service nova] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Refreshing instance network info cache due to event network-changed-0cd6232b-ea64-4978-bc0e-0e84995fd9a4. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:37:22 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-d2b13899-c852-4d0a-a458-1790214c67f6 req-b79b0e16-f45a-4337-8431-4db66b586570 service nova] Acquiring lock "refresh_cache-0659fd5c-cb05-441e-94b6-9d05f7135893" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:37:22 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-d2b13899-c852-4d0a-a458-1790214c67f6 req-b79b0e16-f45a-4337-8431-4db66b586570 service nova] Acquired lock "refresh_cache-0659fd5c-cb05-441e-94b6-9d05f7135893" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:37:22 user nova-compute[72418]: DEBUG nova.network.neutron [req-d2b13899-c852-4d0a-a458-1790214c67f6 req-b79b0e16-f45a-4337-8431-4db66b586570 service nova] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Refreshing network info cache for port 0cd6232b-ea64-4978-bc0e-0e84995fd9a4 {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:37:22 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:37:22 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:37:22 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.587s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:37:22 user nova-compute[72418]: INFO nova.compute.manager [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Migrating
Aug 09 18:37:22 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Acquiring lock "refresh_cache-0659fd5c-cb05-441e-94b6-9d05f7135893" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:37:23 user nova-compute[72418]: DEBUG nova.network.neutron [req-d2b13899-c852-4d0a-a458-1790214c67f6 req-b79b0e16-f45a-4337-8431-4db66b586570 service nova] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Updated VIF entry in instance network info cache for port 0cd6232b-ea64-4978-bc0e-0e84995fd9a4. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:37:23 user nova-compute[72418]: DEBUG nova.network.neutron [req-d2b13899-c852-4d0a-a458-1790214c67f6 req-b79b0e16-f45a-4337-8431-4db66b586570 service nova] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Updating instance_info_cache with network_info: [{"id": "0cd6232b-ea64-4978-bc0e-0e84995fd9a4", "address": "fa:16:3e:65:a1:d2", "network": {"id": "bd36ef30-e57d-473f-97bc-c51b5db08aa7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-425133239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78b6e36a5b61456092ce7de9212c3c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd6232b-ea", "ovs_interfaceid": "0cd6232b-ea64-4978-bc0e-0e84995fd9a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:37:23 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-d2b13899-c852-4d0a-a458-1790214c67f6 req-b79b0e16-f45a-4337-8431-4db66b586570 service nova] Releasing lock "refresh_cache-0659fd5c-cb05-441e-94b6-9d05f7135893" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:37:23 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Acquired lock "refresh_cache-0659fd5c-cb05-441e-94b6-9d05f7135893" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:37:23 user nova-compute[72418]: DEBUG nova.network.neutron [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:37:23 user nova-compute[72418]: DEBUG nova.network.neutron [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Updating instance_info_cache with network_info: [{"id": "0cd6232b-ea64-4978-bc0e-0e84995fd9a4", "address": "fa:16:3e:65:a1:d2", "network": {"id": "bd36ef30-e57d-473f-97bc-c51b5db08aa7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-425133239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78b6e36a5b61456092ce7de9212c3c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd6232b-ea", "ovs_interfaceid": "0cd6232b-ea64-4978-bc0e-0e84995fd9a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:37:23 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Releasing lock "refresh_cache-0659fd5c-cb05-441e-94b6-9d05f7135893" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:37:23 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Starting migrate_disk_and_power_off {{(pid=72418) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 09 18:37:23 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:37:23 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG nova.compute.manager [req-e505d5a8-0783-4c00-9103-6fc4af022113 req-37fed2ff-b18a-433a-bb82-25e9e82ab5f5 service nova] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Received event network-vif-unplugged-0cd6232b-ea64-4978-bc0e-0e84995fd9a4 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-e505d5a8-0783-4c00-9103-6fc4af022113 req-37fed2ff-b18a-433a-bb82-25e9e82ab5f5 service nova] Acquiring lock "0659fd5c-cb05-441e-94b6-9d05f7135893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-e505d5a8-0783-4c00-9103-6fc4af022113 req-37fed2ff-b18a-433a-bb82-25e9e82ab5f5 service nova] Lock "0659fd5c-cb05-441e-94b6-9d05f7135893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-e505d5a8-0783-4c00-9103-6fc4af022113 req-37fed2ff-b18a-433a-bb82-25e9e82ab5f5 service nova] Lock "0659fd5c-cb05-441e-94b6-9d05f7135893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG nova.compute.manager [req-e505d5a8-0783-4c00-9103-6fc4af022113 req-37fed2ff-b18a-433a-bb82-25e9e82ab5f5 service nova] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] No waiting events found dispatching network-vif-unplugged-0cd6232b-ea64-4978-bc0e-0e84995fd9a4 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:37:24 user nova-compute[72418]: WARNING nova.compute.manager [req-e505d5a8-0783-4c00-9103-6fc4af022113 req-37fed2ff-b18a-433a-bb82-25e9e82ab5f5 service nova] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Received unexpected event network-vif-unplugged-0cd6232b-ea64-4978-bc0e-0e84995fd9a4 for instance with vm_state active and task_state resize_migrating.
Aug 09 18:37:24 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691606229.6040797, 1c53f871-2be9-4119-b5c0-d5081e2f4388 => Stopped> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:37:24 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] VM Stopped (Lifecycle Event)
Aug 09 18:37:24 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:37:24 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Instance destroyed successfully.
Aug 09 18:37:24 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:35:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-935482357',display_name='tempest-ServerActionsTestOtherA-server-935482357',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-935482357',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZ8H8MvJhas/vPLXexc9KvUsV16Uhsl6uYTaDGrZC9aE3rBb3x7zoV+NqPR5zKzOIkCqtgn8ZVvU3tdtAtEAYrB/yDbEIXvY0hEVuVM8ww17BzMc60Vtn0IN61LmfWZ8Q==',key_name='tempest-keypair-882054128',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:35:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='78b6e36a5b61456092ce7de9212c3c82',ramdisk_id='',reservation_id='r-kxlskkmt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1039384122',owner_user_name='tempest-ServerActionsTestOtherA-1039384122-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:37:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='edc9ed6980274b978caf0666a9b31379',uuid=0659fd5c-cb05-441e-94b6-9d05f7135893,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0cd6232b-ea64-4978-bc0e-0e84995fd9a4", "address": "fa:16:3e:65:a1:d2", "network": {"id": "bd36ef30-e57d-473f-97bc-c51b5db08aa7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-425133239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-425133239-network", "vif_mac": "fa:16:3e:65:a1:d2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78b6e36a5b61456092ce7de9212c3c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd6232b-ea", "ovs_interfaceid": "0cd6232b-ea64-4978-bc0e-0e84995fd9a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Converting VIF {"id": "0cd6232b-ea64-4978-bc0e-0e84995fd9a4", "address": "fa:16:3e:65:a1:d2", "network": {"id": "bd36ef30-e57d-473f-97bc-c51b5db08aa7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-425133239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-425133239-network", "vif_mac": "fa:16:3e:65:a1:d2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78b6e36a5b61456092ce7de9212c3c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd6232b-ea", "ovs_interfaceid": "0cd6232b-ea64-4978-bc0e-0e84995fd9a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:a1:d2,bridge_name='br-int',has_traffic_filtering=True,id=0cd6232b-ea64-4978-bc0e-0e84995fd9a4,network=Network(bd36ef30-e57d-473f-97bc-c51b5db08aa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cd6232b-ea') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG os_vif [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:a1:d2,bridge_name='br-int',has_traffic_filtering=True,id=0cd6232b-ea64-4978-bc0e-0e84995fd9a4,network=Network(bd36ef30-e57d-473f-97bc-c51b5db08aa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cd6232b-ea') {{(pid=72418) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG nova.compute.manager [None req-6b910ff9-f22c-46df-8159-5aa01bfc4132 None None] [instance: 1c53f871-2be9-4119-b5c0-d5081e2f4388] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0cd6232b-ea, bridge=br-int, if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:37:24 user nova-compute[72418]: INFO os_vif [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:a1:d2,bridge_name='br-int',has_traffic_filtering=True,id=0cd6232b-ea64-4978-bc0e-0e84995fd9a4,network=Network(bd36ef30-e57d-473f-97bc-c51b5db08aa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cd6232b-ea')
Aug 09 18:37:24 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] calling os-brick to detach iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, {'target_iqns': ['iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jgrEVDUS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:37:24 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:37:24 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b', 0)] {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[457d19ae-6224-400a-8cab-930212919998]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[6abbe153-9c08-4428-be57-fc23ccb92c9b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:37:24 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:37:24 user nova-compute[72418]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)
Aug 09 18:37:24 user nova-compute[72418]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:37:24 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:37:24 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:37:24 user nova-compute[72418]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)
Aug 09 18:37:24 user nova-compute[72418]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:37:24 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f42f859d120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b'): ({'sde'}, set())}) {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Removing single pathed devices sde {{(pid=72418) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c72c27-91ec-4130-b3e6-02ffb5f78342]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[27988d7f-bf53-43db-85b4-139461de9f85]: (4, ('ok\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Flushing IO for device /dev/sde {{(pid=72418) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2e0735-68a8-4ecc-929c-e9a1ecad5a10]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72418) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b3ad05-426d-491b-bacc-83d057b47acc]: (4, ('1', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] SCSI volumes sde have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b')] {{(pid=72418) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[999e4fcb-5cf6-4181-99ef-98bf17b167d2]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b -p 172.16.0.220:3260 --logout {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[50efd33c-20d4-4d04-862c-f7a3ab13ddbb]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b, portal: 172.16.0.220,3260]
Aug 09 18:37:24 user nova-compute[72418]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b, portal: 172.16.0.220,3260] successful.
Aug 09 18:37:24 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b -p 172.16.0.220:3260 --op delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:24 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd80228-8486-4145-a219-a338eb0dbd39]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:37:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:37:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:37:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] <== disconnect_volume: return (331ms) None {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:37:25 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Disconnected iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 18:37:25 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] skipping disk /dev/sde (vda) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:37:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:37:25 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:37:26 user nova-compute[72418]: DEBUG nova.network.neutron [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Port 0cd6232b-ea64-4978-bc0e-0e84995fd9a4 binding to destination host user is already ACTIVE {{(pid=72418) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 09 18:37:26 user nova-compute[72418]: DEBUG nova.compute.manager [req-211d2468-57c6-44b1-958a-88dc0639101f req-984c483c-2c35-46d6-870f-cbf1e3399455 service nova] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Received event network-vif-plugged-0cd6232b-ea64-4978-bc0e-0e84995fd9a4 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:37:26 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-211d2468-57c6-44b1-958a-88dc0639101f req-984c483c-2c35-46d6-870f-cbf1e3399455 service nova] Acquiring lock "0659fd5c-cb05-441e-94b6-9d05f7135893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:37:26 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-211d2468-57c6-44b1-958a-88dc0639101f req-984c483c-2c35-46d6-870f-cbf1e3399455 service nova] Lock "0659fd5c-cb05-441e-94b6-9d05f7135893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:37:26 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-211d2468-57c6-44b1-958a-88dc0639101f req-984c483c-2c35-46d6-870f-cbf1e3399455 service nova] Lock "0659fd5c-cb05-441e-94b6-9d05f7135893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:37:26 user nova-compute[72418]: DEBUG nova.compute.manager [req-211d2468-57c6-44b1-958a-88dc0639101f req-984c483c-2c35-46d6-870f-cbf1e3399455 service nova] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] No waiting events found dispatching network-vif-plugged-0cd6232b-ea64-4978-bc0e-0e84995fd9a4 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:37:26 user nova-compute[72418]: WARNING nova.compute.manager [req-211d2468-57c6-44b1-958a-88dc0639101f req-984c483c-2c35-46d6-870f-cbf1e3399455 service nova] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Received unexpected event network-vif-plugged-0cd6232b-ea64-4978-bc0e-0e84995fd9a4 for instance with vm_state active and task_state resize_migrating.
Aug 09 18:37:26 user nova-compute[72418]: DEBUG nova.compute.manager [req-211d2468-57c6-44b1-958a-88dc0639101f req-984c483c-2c35-46d6-870f-cbf1e3399455 service nova] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Received event network-vif-plugged-0cd6232b-ea64-4978-bc0e-0e84995fd9a4 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:37:26 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-211d2468-57c6-44b1-958a-88dc0639101f req-984c483c-2c35-46d6-870f-cbf1e3399455 service nova] Acquiring lock "0659fd5c-cb05-441e-94b6-9d05f7135893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:37:26 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-211d2468-57c6-44b1-958a-88dc0639101f req-984c483c-2c35-46d6-870f-cbf1e3399455 service nova] Lock "0659fd5c-cb05-441e-94b6-9d05f7135893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:37:26 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-211d2468-57c6-44b1-958a-88dc0639101f req-984c483c-2c35-46d6-870f-cbf1e3399455 service nova] Lock "0659fd5c-cb05-441e-94b6-9d05f7135893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:37:26 user nova-compute[72418]: DEBUG nova.compute.manager [req-211d2468-57c6-44b1-958a-88dc0639101f req-984c483c-2c35-46d6-870f-cbf1e3399455 service nova] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] No waiting events found dispatching network-vif-plugged-0cd6232b-ea64-4978-bc0e-0e84995fd9a4 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:37:26 user nova-compute[72418]: WARNING nova.compute.manager [req-211d2468-57c6-44b1-958a-88dc0639101f req-984c483c-2c35-46d6-870f-cbf1e3399455 service nova] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Received unexpected event network-vif-plugged-0cd6232b-ea64-4978-bc0e-0e84995fd9a4 for instance with vm_state active and task_state resize_migrating.
Aug 09 18:37:26 user nova-compute[72418]: DEBUG nova.compute.manager [req-211d2468-57c6-44b1-958a-88dc0639101f req-984c483c-2c35-46d6-870f-cbf1e3399455 service nova] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Received event network-vif-plugged-0cd6232b-ea64-4978-bc0e-0e84995fd9a4 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:37:26 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-211d2468-57c6-44b1-958a-88dc0639101f req-984c483c-2c35-46d6-870f-cbf1e3399455 service nova] Acquiring lock "0659fd5c-cb05-441e-94b6-9d05f7135893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:37:26 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-211d2468-57c6-44b1-958a-88dc0639101f req-984c483c-2c35-46d6-870f-cbf1e3399455 service nova] Lock "0659fd5c-cb05-441e-94b6-9d05f7135893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:37:26 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-211d2468-57c6-44b1-958a-88dc0639101f req-984c483c-2c35-46d6-870f-cbf1e3399455 service nova] Lock "0659fd5c-cb05-441e-94b6-9d05f7135893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:37:26 user nova-compute[72418]: DEBUG nova.compute.manager [req-211d2468-57c6-44b1-958a-88dc0639101f req-984c483c-2c35-46d6-870f-cbf1e3399455 service nova] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] No waiting events found dispatching network-vif-plugged-0cd6232b-ea64-4978-bc0e-0e84995fd9a4 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:37:26 user nova-compute[72418]: WARNING nova.compute.manager [req-211d2468-57c6-44b1-958a-88dc0639101f req-984c483c-2c35-46d6-870f-cbf1e3399455 service nova] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Received unexpected event network-vif-plugged-0cd6232b-ea64-4978-bc0e-0e84995fd9a4 for instance with vm_state active and task_state resize_migrating.
Aug 09 18:37:26 user nova-compute[72418]: DEBUG nova.compute.manager [req-211d2468-57c6-44b1-958a-88dc0639101f req-984c483c-2c35-46d6-870f-cbf1e3399455 service nova] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Received event network-vif-unplugged-0cd6232b-ea64-4978-bc0e-0e84995fd9a4 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:37:26 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-211d2468-57c6-44b1-958a-88dc0639101f req-984c483c-2c35-46d6-870f-cbf1e3399455 service nova] Acquiring lock "0659fd5c-cb05-441e-94b6-9d05f7135893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:37:26 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-211d2468-57c6-44b1-958a-88dc0639101f req-984c483c-2c35-46d6-870f-cbf1e3399455 service nova] Lock "0659fd5c-cb05-441e-94b6-9d05f7135893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:37:26 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-211d2468-57c6-44b1-958a-88dc0639101f req-984c483c-2c35-46d6-870f-cbf1e3399455 service nova] Lock "0659fd5c-cb05-441e-94b6-9d05f7135893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:37:26 user nova-compute[72418]: DEBUG nova.compute.manager [req-211d2468-57c6-44b1-958a-88dc0639101f req-984c483c-2c35-46d6-870f-cbf1e3399455 service nova] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] No waiting events found dispatching network-vif-unplugged-0cd6232b-ea64-4978-bc0e-0e84995fd9a4 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:37:26 user nova-compute[72418]: WARNING nova.compute.manager [req-211d2468-57c6-44b1-958a-88dc0639101f req-984c483c-2c35-46d6-870f-cbf1e3399455 service nova] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Received unexpected event network-vif-unplugged-0cd6232b-ea64-4978-bc0e-0e84995fd9a4 for instance with vm_state active and task_state resize_migrating.
Aug 09 18:37:26 user nova-compute[72418]: DEBUG nova.compute.manager [req-211d2468-57c6-44b1-958a-88dc0639101f req-984c483c-2c35-46d6-870f-cbf1e3399455 service nova] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Received event network-vif-plugged-0cd6232b-ea64-4978-bc0e-0e84995fd9a4 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:37:26 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-211d2468-57c6-44b1-958a-88dc0639101f req-984c483c-2c35-46d6-870f-cbf1e3399455 service nova] Acquiring lock "0659fd5c-cb05-441e-94b6-9d05f7135893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:37:26 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-211d2468-57c6-44b1-958a-88dc0639101f req-984c483c-2c35-46d6-870f-cbf1e3399455 service nova] Lock "0659fd5c-cb05-441e-94b6-9d05f7135893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:37:26 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-211d2468-57c6-44b1-958a-88dc0639101f req-984c483c-2c35-46d6-870f-cbf1e3399455 service nova] Lock "0659fd5c-cb05-441e-94b6-9d05f7135893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:37:26 user nova-compute[72418]: DEBUG nova.compute.manager [req-211d2468-57c6-44b1-958a-88dc0639101f req-984c483c-2c35-46d6-870f-cbf1e3399455 service nova] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] No waiting events found dispatching network-vif-plugged-0cd6232b-ea64-4978-bc0e-0e84995fd9a4 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:37:26 user nova-compute[72418]: WARNING nova.compute.manager [req-211d2468-57c6-44b1-958a-88dc0639101f req-984c483c-2c35-46d6-870f-cbf1e3399455 service nova] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Received unexpected event network-vif-plugged-0cd6232b-ea64-4978-bc0e-0e84995fd9a4 for instance with vm_state active and task_state resize_migrating.
Aug 09 18:37:26 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Acquiring lock "0659fd5c-cb05-441e-94b6-9d05f7135893-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:37:26 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "0659fd5c-cb05-441e-94b6-9d05f7135893-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:37:26 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "0659fd5c-cb05-441e-94b6-9d05f7135893-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:37:26 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Acquiring lock "refresh_cache-0659fd5c-cb05-441e-94b6-9d05f7135893" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:37:26 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Acquired lock "refresh_cache-0659fd5c-cb05-441e-94b6-9d05f7135893" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:37:26 user nova-compute[72418]: DEBUG nova.network.neutron [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:37:27 user nova-compute[72418]: DEBUG nova.network.neutron [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Updating instance_info_cache with network_info: [{"id": "0cd6232b-ea64-4978-bc0e-0e84995fd9a4", "address": "fa:16:3e:65:a1:d2", "network": {"id": "bd36ef30-e57d-473f-97bc-c51b5db08aa7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-425133239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78b6e36a5b61456092ce7de9212c3c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd6232b-ea", "ovs_interfaceid": "0cd6232b-ea64-4978-bc0e-0e84995fd9a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:37:27 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Releasing lock "refresh_cache-0659fd5c-cb05-441e-94b6-9d05f7135893" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:37:27 user nova-compute[72418]: DEBUG os_brick.utils [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:37:27 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:27 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:27 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36c3277-1ca6-4ad5-a398-fae008f67641]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ad56b243ad71\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:37:27 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:27 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:27 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a3efa6-361e-4342-9f90-17c18635c4d2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:37:27 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:27 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:27 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef7e790-1d45-452d-8d96-a728ed200a9c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:37:27 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd5f395-85c0-4900-8175-ffd73599b4c3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:37:27 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Running cmd (subprocess): nvme version {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:27 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] 'nvme version' failed. Not Retrying. {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:37:27 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] nvme not present on system {{(pid=72418) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 18:37:27 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:27 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:37:27 user nova-compute[72418]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 18:37:27 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5374b1-d0fb-487f-ad64-e0ec36e18cd2]: (4, '') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:37:27 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72418) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 18:37:27 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 18:37:27 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] LIGHTOS: no hostnqn found. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 18:37:27 user nova-compute[72418]: DEBUG os_brick.utils [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ad56b243ad71', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:37:29 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:37:33 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:37:34 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:37:38 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:37:39 user nova-compute[72418]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691606244.595311, 0659fd5c-cb05-441e-94b6-9d05f7135893 => Stopped> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:37:39 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] VM Stopped (Lifecycle Event)
Aug 09 18:37:39 user nova-compute[72418]: DEBUG nova.compute.manager [None req-110aac88-c9bf-4dee-a8a5-d3e4e798a972 None None] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:37:39 user nova-compute[72418]: DEBUG nova.compute.manager [None req-110aac88-c9bf-4dee-a8a5-d3e4e798a972 None None] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:37:39 user nova-compute[72418]: INFO nova.compute.manager [None req-110aac88-c9bf-4dee-a8a5-d3e4e798a972 None None] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 09 18:37:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Starting finish_migration {{(pid=72418) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Instance directory exists: not creating {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 18:37:42 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Creating image(s)
Aug 09 18:37:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Did not create local disks {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Ensure instance console log exists: /opt/stack/data/nova/instances/0659fd5c-cb05-441e-94b6-9d05f7135893/console.log {{(pid=72418) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Start _get_guest_xml network_info=[{"id": "0cd6232b-ea64-4978-bc0e-0e84995fd9a4", "address": "fa:16:3e:65:a1:d2", "network": {"id": "bd36ef30-e57d-473f-97bc-c51b5db08aa7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-425133239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-425133239-network", "vif_mac": "fa:16:3e:65:a1:d2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78b6e36a5b61456092ce7de9212c3c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd6232b-ea", "ovs_interfaceid": "0cd6232b-ea64-4978-bc0e-0e84995fd9a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '85b45b52-d49e-406e-b774-7d4cee123102', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jgrEVDUS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '0659fd5c-cb05-441e-94b6-9d05f7135893', 'attached_at': '2023-08-09T18:37:42.000000', 'detached_at': '', 'volume_id': 'e52e5369-5c8f-4793-a8fc-9df310f4572b', 'serial': 'e52e5369-5c8f-4793-a8fc-9df310f4572b'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 18:37:42 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:37:42 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:37:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] CPU controller missing on host. {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] CPU controller found on host. {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72418) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T18:18:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Flavor limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Image limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Flavor pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Image pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Got 1 possible topologies {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG nova.objects.instance [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0659fd5c-cb05-441e-94b6-9d05f7135893 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Calling os-brick to attach iSCSI Volume {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jgrEVDUS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:37:42 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:37:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:37:42 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:37:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:37:42 user nova-compute[72418]: INFO os_brick.initiator.connectors.iscsi [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 18:37:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b -p 172.16.0.220:3260 {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4baa356-2911-4a2f-b360-571215148a3b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 18:37:42 user nova-compute[72418]:  {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b -p 172.16.0.220:3260 --interface default --op new {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77102cc-a599-431c-b1c2-9e68ecba7524]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b] added\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b] added
Aug 09 18:37:42 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d27ae8-6c6e-49b6-b2f6-068478043200]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec53f252-4df0-4931-9821-a014651d89aa]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jgrEVDUS {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jgrEVDUS" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ed5c16-522a-40de-a591-27ce7e0ab109]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jgrEVDUS'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[6247c061-2652-4820-b199-ca1f328318ed]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[410fe55c-5fa6-4e0a-9959-d74e55928271]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:37:42 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:37:42 user nova-compute[72418]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:37:42 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:37:42 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:37:42 user nova-compute[72418]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:37:42 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b -p 172.16.0.220:3260 --login {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[0815524f-9673-433c-9e93-1e766cf0c9c3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b, portal: 172.16.0.220,3260]
Aug 09 18:37:42 user nova-compute[72418]: Login to [iface: default, target: iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b, portal: 172.16.0.220,3260] successful.
Aug 09 18:37:42 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85c594a-c3cf-4365-af0e-fc1b91a092b0]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[354843f2-77ac-461e-ae86-138723e79535]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:37:42 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:37:42 user nova-compute[72418]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:37:42 user nova-compute[72418]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)
Aug 09 18:37:42 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:37:42 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:37:42 user nova-compute[72418]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:37:42 user nova-compute[72418]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)
Aug 09 18:37:42 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Connected to 172.16.0.220:3260 {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] HCTL ('34', '-', '-', 0) found on session 35 with lun 0 {{(pid=72418) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72418) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ef682b-c942-4f10-bb63-a579d1d0e6bd]: (4, ('- - 0', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72418) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 18:37:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jgrEVDUS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 18:37:43 user nova-compute[72418]: DEBUG nova.compute.manager [req-b295a873-d89e-4abc-8271-bc5d2a62157f req-3fefd2e7-2ae3-4ca1-99b8-671ec7749e23 service nova] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Received event network-changed-07c05457-6d05-4961-9642-02b3db4901c4 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:37:43 user nova-compute[72418]: DEBUG nova.compute.manager [req-b295a873-d89e-4abc-8271-bc5d2a62157f req-3fefd2e7-2ae3-4ca1-99b8-671ec7749e23 service nova] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Refreshing instance network info cache due to event network-changed-07c05457-6d05-4961-9642-02b3db4901c4. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:37:43 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-b295a873-d89e-4abc-8271-bc5d2a62157f req-3fefd2e7-2ae3-4ca1-99b8-671ec7749e23 service nova] Acquiring lock "refresh_cache-97f49889-df0b-48c1-97ce-5c331b6a65ce" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:37:43 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-b295a873-d89e-4abc-8271-bc5d2a62157f req-3fefd2e7-2ae3-4ca1-99b8-671ec7749e23 service nova] Acquired lock "refresh_cache-97f49889-df0b-48c1-97ce-5c331b6a65ce" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:37:43 user nova-compute[72418]: DEBUG nova.network.neutron [req-b295a873-d89e-4abc-8271-bc5d2a62157f req-3fefd2e7-2ae3-4ca1-99b8-671ec7749e23 service nova] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Refreshing network info cache for port 07c05457-6d05-4961-9642-02b3db4901c4 {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:37:43 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:37:43 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:37:43 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '26164306633663066', 'path': '/dev/sdc'} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:37:43 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164306633663066', 'path': '/dev/sdc'} {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 18:37:43 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:35:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-935482357',display_name='tempest-ServerActionsTestOtherA-server-935482357',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-935482357',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZ8H8MvJhas/vPLXexc9KvUsV16Uhsl6uYTaDGrZC9aE3rBb3x7zoV+NqPR5zKzOIkCqtgn8ZVvU3tdtAtEAYrB/yDbEIXvY0hEVuVM8ww17BzMc60Vtn0IN61LmfWZ8Q==',key_name='tempest-keypair-882054128',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:35:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='78b6e36a5b61456092ce7de9212c3c82',ramdisk_id='',reservation_id='r-kxlskkmt',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1039384122',owner_user_name='tempest-ServerActionsTestOtherA-1039384122-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:37:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='edc9ed6980274b978caf0666a9b31379',uuid=0659fd5c-cb05-441e-94b6-9d05f7135893,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0cd6232b-ea64-4978-bc0e-0e84995fd9a4", "address": "fa:16:3e:65:a1:d2", "network": {"id": "bd36ef30-e57d-473f-97bc-c51b5db08aa7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-425133239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-425133239-network", "vif_mac": "fa:16:3e:65:a1:d2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78b6e36a5b61456092ce7de9212c3c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd6232b-ea", "ovs_interfaceid": "0cd6232b-ea64-4978-bc0e-0e84995fd9a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:37:43 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Converting VIF {"id": "0cd6232b-ea64-4978-bc0e-0e84995fd9a4", "address": "fa:16:3e:65:a1:d2", "network": {"id": "bd36ef30-e57d-473f-97bc-c51b5db08aa7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-425133239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-425133239-network", "vif_mac": "fa:16:3e:65:a1:d2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78b6e36a5b61456092ce7de9212c3c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd6232b-ea", "ovs_interfaceid": "0cd6232b-ea64-4978-bc0e-0e84995fd9a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:37:43 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:a1:d2,bridge_name='br-int',has_traffic_filtering=True,id=0cd6232b-ea64-4978-bc0e-0e84995fd9a4,network=Network(bd36ef30-e57d-473f-97bc-c51b5db08aa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cd6232b-ea') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:37:43 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] End _get_guest_xml xml=<domain type="kvm">
Aug 09 18:37:43 user nova-compute[72418]:   <uuid>0659fd5c-cb05-441e-94b6-9d05f7135893</uuid>
Aug 09 18:37:43 user nova-compute[72418]:   <name>instance-0000001d</name>
Aug 09 18:37:43 user nova-compute[72418]:   <memory>2097152</memory>
Aug 09 18:37:43 user nova-compute[72418]:   <vcpu>1</vcpu>
Aug 09 18:37:43 user nova-compute[72418]:   <metadata>
Aug 09 18:37:43 user nova-compute[72418]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:37:43 user nova-compute[72418]:       <nova:package version="0.0.0"/>
Aug 09 18:37:43 user nova-compute[72418]:       <nova:name>tempest-ServerActionsTestOtherA-server-935482357</nova:name>
Aug 09 18:37:43 user nova-compute[72418]:       <nova:creationTime>2023-08-09 18:37:42</nova:creationTime>
Aug 09 18:37:43 user nova-compute[72418]:       <nova:flavor name="m1.small">
Aug 09 18:37:43 user nova-compute[72418]:         <nova:memory>2048</nova:memory>
Aug 09 18:37:43 user nova-compute[72418]:         <nova:disk>20</nova:disk>
Aug 09 18:37:43 user nova-compute[72418]:         <nova:swap>0</nova:swap>
Aug 09 18:37:43 user nova-compute[72418]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:37:43 user nova-compute[72418]:         <nova:vcpus>1</nova:vcpus>
Aug 09 18:37:43 user nova-compute[72418]:       </nova:flavor>
Aug 09 18:37:43 user nova-compute[72418]:       <nova:owner>
Aug 09 18:37:43 user nova-compute[72418]:         <nova:user uuid="edc9ed6980274b978caf0666a9b31379">tempest-ServerActionsTestOtherA-1039384122-project-member</nova:user>
Aug 09 18:37:43 user nova-compute[72418]:         <nova:project uuid="78b6e36a5b61456092ce7de9212c3c82">tempest-ServerActionsTestOtherA-1039384122</nova:project>
Aug 09 18:37:43 user nova-compute[72418]:       </nova:owner>
Aug 09 18:37:43 user nova-compute[72418]:       <nova:ports>
Aug 09 18:37:43 user nova-compute[72418]:         <nova:port uuid="0cd6232b-ea64-4978-bc0e-0e84995fd9a4">
Aug 09 18:37:43 user nova-compute[72418]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 09 18:37:43 user nova-compute[72418]:         </nova:port>
Aug 09 18:37:43 user nova-compute[72418]:       </nova:ports>
Aug 09 18:37:43 user nova-compute[72418]:     </nova:instance>
Aug 09 18:37:43 user nova-compute[72418]:   </metadata>
Aug 09 18:37:43 user nova-compute[72418]:   <sysinfo type="smbios">
Aug 09 18:37:43 user nova-compute[72418]:     <system>
Aug 09 18:37:43 user nova-compute[72418]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 18:37:43 user nova-compute[72418]:       <entry name="product">OpenStack Nova</entry>
Aug 09 18:37:43 user nova-compute[72418]:       <entry name="version">0.0.0</entry>
Aug 09 18:37:43 user nova-compute[72418]:       <entry name="serial">0659fd5c-cb05-441e-94b6-9d05f7135893</entry>
Aug 09 18:37:43 user nova-compute[72418]:       <entry name="uuid">0659fd5c-cb05-441e-94b6-9d05f7135893</entry>
Aug 09 18:37:43 user nova-compute[72418]:       <entry name="family">Virtual Machine</entry>
Aug 09 18:37:43 user nova-compute[72418]:     </system>
Aug 09 18:37:43 user nova-compute[72418]:   </sysinfo>
Aug 09 18:37:43 user nova-compute[72418]:   <os>
Aug 09 18:37:43 user nova-compute[72418]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 18:37:43 user nova-compute[72418]:     <boot dev="hd"/>
Aug 09 18:37:43 user nova-compute[72418]:     <smbios mode="sysinfo"/>
Aug 09 18:37:43 user nova-compute[72418]:   </os>
Aug 09 18:37:43 user nova-compute[72418]:   <features>
Aug 09 18:37:43 user nova-compute[72418]:     <acpi/>
Aug 09 18:37:43 user nova-compute[72418]:     <apic/>
Aug 09 18:37:43 user nova-compute[72418]:     <vmcoreinfo/>
Aug 09 18:37:43 user nova-compute[72418]:   </features>
Aug 09 18:37:43 user nova-compute[72418]:   <clock offset="utc">
Aug 09 18:37:43 user nova-compute[72418]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 18:37:43 user nova-compute[72418]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 18:37:43 user nova-compute[72418]:     <timer name="hpet" present="no"/>
Aug 09 18:37:43 user nova-compute[72418]:   </clock>
Aug 09 18:37:43 user nova-compute[72418]:   <cpu mode="custom" match="exact">
Aug 09 18:37:43 user nova-compute[72418]:     <model>Nehalem</model>
Aug 09 18:37:43 user nova-compute[72418]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 18:37:43 user nova-compute[72418]:   </cpu>
Aug 09 18:37:43 user nova-compute[72418]:   <devices>
Aug 09 18:37:43 user nova-compute[72418]:     <disk type="block" device="disk">
Aug 09 18:37:43 user nova-compute[72418]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:37:43 user nova-compute[72418]:       <source dev="/dev/sdc"/>
Aug 09 18:37:43 user nova-compute[72418]:       <target dev="vda" bus="virtio"/>
Aug 09 18:37:43 user nova-compute[72418]:       <serial>e52e5369-5c8f-4793-a8fc-9df310f4572b</serial>
Aug 09 18:37:43 user nova-compute[72418]:     </disk>
Aug 09 18:37:43 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:37:43 user nova-compute[72418]:       <mac address="fa:16:3e:65:a1:d2"/>
Aug 09 18:37:43 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:37:43 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:37:43 user nova-compute[72418]:       <target dev="tap0cd6232b-ea"/>
Aug 09 18:37:43 user nova-compute[72418]:     </interface>
Aug 09 18:37:43 user nova-compute[72418]:     <serial type="pty">
Aug 09 18:37:43 user nova-compute[72418]:       <log file="/opt/stack/data/nova/instances/0659fd5c-cb05-441e-94b6-9d05f7135893/console.log" append="off"/>
Aug 09 18:37:43 user nova-compute[72418]:     </serial>
Aug 09 18:37:43 user nova-compute[72418]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 18:37:43 user nova-compute[72418]:     <video>
Aug 09 18:37:43 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:37:43 user nova-compute[72418]:     </video>
Aug 09 18:37:43 user nova-compute[72418]:     <rng model="virtio">
Aug 09 18:37:43 user nova-compute[72418]:       <backend model="random">/dev/urandom</backend>
Aug 09 18:37:43 user nova-compute[72418]:     </rng>
Aug 09 18:37:43 user nova-compute[72418]:     <controller type="usb" index="0" model="none"/>
Aug 09 18:37:43 user nova-compute[72418]:     <memballoon model="virtio">
Aug 09 18:37:43 user nova-compute[72418]:       <stats period="10"/>
Aug 09 18:37:43 user nova-compute[72418]:     </memballoon>
Aug 09 18:37:43 user nova-compute[72418]:   </devices>
Aug 09 18:37:43 user nova-compute[72418]: </domain>
Aug 09 18:37:43 user nova-compute[72418]:  {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 18:37:43 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:35:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-935482357',display_name='tempest-ServerActionsTestOtherA-server-935482357',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-935482357',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZ8H8MvJhas/vPLXexc9KvUsV16Uhsl6uYTaDGrZC9aE3rBb3x7zoV+NqPR5zKzOIkCqtgn8ZVvU3tdtAtEAYrB/yDbEIXvY0hEVuVM8ww17BzMc60Vtn0IN61LmfWZ8Q==',key_name='tempest-keypair-882054128',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:35:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='78b6e36a5b61456092ce7de9212c3c82',ramdisk_id='',reservation_id='r-kxlskkmt',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1039384122',owner_user_name='tempest-ServerActionsTestOtherA-1039384122-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:37:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='edc9ed6980274b978caf0666a9b31379',uuid=0659fd5c-cb05-441e-94b6-9d05f7135893,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0cd6232b-ea64-4978-bc0e-0e84995fd9a4", "address": "fa:16:3e:65:a1:d2", "network": {"id": "bd36ef30-e57d-473f-97bc-c51b5db08aa7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-425133239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-425133239-network", "vif_mac": "fa:16:3e:65:a1:d2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78b6e36a5b61456092ce7de9212c3c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd6232b-ea", "ovs_interfaceid": "0cd6232b-ea64-4978-bc0e-0e84995fd9a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:37:43 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Converting VIF {"id": "0cd6232b-ea64-4978-bc0e-0e84995fd9a4", "address": "fa:16:3e:65:a1:d2", "network": {"id": "bd36ef30-e57d-473f-97bc-c51b5db08aa7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-425133239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-425133239-network", "vif_mac": "fa:16:3e:65:a1:d2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78b6e36a5b61456092ce7de9212c3c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd6232b-ea", "ovs_interfaceid": "0cd6232b-ea64-4978-bc0e-0e84995fd9a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:37:43 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:a1:d2,bridge_name='br-int',has_traffic_filtering=True,id=0cd6232b-ea64-4978-bc0e-0e84995fd9a4,network=Network(bd36ef30-e57d-473f-97bc-c51b5db08aa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cd6232b-ea') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:37:43 user nova-compute[72418]: DEBUG os_vif [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:a1:d2,bridge_name='br-int',has_traffic_filtering=True,id=0cd6232b-ea64-4978-bc0e-0e84995fd9a4,network=Network(bd36ef30-e57d-473f-97bc-c51b5db08aa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cd6232b-ea') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:37:43 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:37:43 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:37:43 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:37:43 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:37:43 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0cd6232b-ea, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:37:43 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0cd6232b-ea, col_values=(('external_ids', {'iface-id': '0cd6232b-ea64-4978-bc0e-0e84995fd9a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:a1:d2', 'vm-uuid': '0659fd5c-cb05-441e-94b6-9d05f7135893'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:37:43 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:37:43 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:37:43 user nova-compute[72418]: INFO os_vif [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:a1:d2,bridge_name='br-int',has_traffic_filtering=True,id=0cd6232b-ea64-4978-bc0e-0e84995fd9a4,network=Network(bd36ef30-e57d-473f-97bc-c51b5db08aa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cd6232b-ea')
Aug 09 18:37:43 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:37:43 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] No VIF found with MAC fa:16:3e:65:a1:d2, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:37:43 user nova-compute[72418]: DEBUG nova.network.neutron [req-b295a873-d89e-4abc-8271-bc5d2a62157f req-3fefd2e7-2ae3-4ca1-99b8-671ec7749e23 service nova] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Updated VIF entry in instance network info cache for port 07c05457-6d05-4961-9642-02b3db4901c4. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:37:43 user nova-compute[72418]: DEBUG nova.network.neutron [req-b295a873-d89e-4abc-8271-bc5d2a62157f req-3fefd2e7-2ae3-4ca1-99b8-671ec7749e23 service nova] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Updating instance_info_cache with network_info: [{"id": "07c05457-6d05-4961-9642-02b3db4901c4", "address": "fa:16:3e:4c:1c:62", "network": {"id": "7621f03d-76ac-49da-89a8-0753bb11e329", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596253708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5242fb37f9664dbf9a8b50449f8dd129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07c05457-6d", "ovs_interfaceid": "07c05457-6d05-4961-9642-02b3db4901c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:37:43 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-b295a873-d89e-4abc-8271-bc5d2a62157f req-3fefd2e7-2ae3-4ca1-99b8-671ec7749e23 service nova] Releasing lock "refresh_cache-97f49889-df0b-48c1-97ce-5c331b6a65ce" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:37:45 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:37:45 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:37:45 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:37:45 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:37:45 user nova-compute[72418]: DEBUG nova.compute.manager [req-2cb38c90-a798-4af8-9e28-9e2e404c3785 req-4c5cb67c-5fe1-4746-b86c-aa8ea12cd5b1 service nova] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Received event network-vif-plugged-0cd6232b-ea64-4978-bc0e-0e84995fd9a4 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:37:45 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-2cb38c90-a798-4af8-9e28-9e2e404c3785 req-4c5cb67c-5fe1-4746-b86c-aa8ea12cd5b1 service nova] Acquiring lock "0659fd5c-cb05-441e-94b6-9d05f7135893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:37:45 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-2cb38c90-a798-4af8-9e28-9e2e404c3785 req-4c5cb67c-5fe1-4746-b86c-aa8ea12cd5b1 service nova] Lock "0659fd5c-cb05-441e-94b6-9d05f7135893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:37:45 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-2cb38c90-a798-4af8-9e28-9e2e404c3785 req-4c5cb67c-5fe1-4746-b86c-aa8ea12cd5b1 service nova] Lock "0659fd5c-cb05-441e-94b6-9d05f7135893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:37:45 user nova-compute[72418]: DEBUG nova.compute.manager [req-2cb38c90-a798-4af8-9e28-9e2e404c3785 req-4c5cb67c-5fe1-4746-b86c-aa8ea12cd5b1 service nova] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] No waiting events found dispatching network-vif-plugged-0cd6232b-ea64-4978-bc0e-0e84995fd9a4 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:37:45 user nova-compute[72418]: WARNING nova.compute.manager [req-2cb38c90-a798-4af8-9e28-9e2e404c3785 req-4c5cb67c-5fe1-4746-b86c-aa8ea12cd5b1 service nova] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Received unexpected event network-vif-plugged-0cd6232b-ea64-4978-bc0e-0e84995fd9a4 for instance with vm_state active and task_state resize_finish.
Aug 09 18:37:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ffbdd011-a2c2-4997-96a5-b2684deebe3d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Acquiring lock "97f49889-df0b-48c1-97ce-5c331b6a65ce" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:37:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ffbdd011-a2c2-4997-96a5-b2684deebe3d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "97f49889-df0b-48c1-97ce-5c331b6a65ce" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:37:47 user nova-compute[72418]: DEBUG nova.objects.instance [None req-ffbdd011-a2c2-4997-96a5-b2684deebe3d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lazy-loading 'flavor' on Instance uuid 97f49889-df0b-48c1-97ce-5c331b6a65ce {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:37:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ffbdd011-a2c2-4997-96a5-b2684deebe3d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "97f49889-df0b-48c1-97ce-5c331b6a65ce" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:37:47 user nova-compute[72418]: DEBUG nova.compute.manager [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Instance event wait completed in 0 seconds for  {{(pid=72418) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 18:37:47 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691606267.2733252, 0659fd5c-cb05-441e-94b6-9d05f7135893 => Resumed> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:37:47 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] VM Resumed (Lifecycle Event)
Aug 09 18:37:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ffbdd011-a2c2-4997-96a5-b2684deebe3d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Acquiring lock "97f49889-df0b-48c1-97ce-5c331b6a65ce" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:37:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ffbdd011-a2c2-4997-96a5-b2684deebe3d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "97f49889-df0b-48c1-97ce-5c331b6a65ce" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:37:47 user nova-compute[72418]: INFO nova.compute.manager [None req-ffbdd011-a2c2-4997-96a5-b2684deebe3d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Attaching volume cceb9c76-2bd3-461d-ac8b-41b4350b9fa7 to /dev/vdb
Aug 09 18:37:47 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Instance running successfully.
Aug 09 18:37:47 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Failed to set time: agent not configured {{(pid=72418) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 09 18:37:47 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-1d2401c1-7737-4232-9695-2e074efbee3f tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] finish_migration finished successfully. {{(pid=72418) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 09 18:37:47 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:37:47 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:37:47 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 09 18:37:47 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691606267.2766075, 0659fd5c-cb05-441e-94b6-9d05f7135893 => Started> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:37:47 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] VM Started (Lifecycle Event)
Aug 09 18:37:47 user nova-compute[72418]: DEBUG os_brick.utils [None req-ffbdd011-a2c2-4997-96a5-b2684deebe3d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:37:47 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:47 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:37:47 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:37:47 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:47 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4846f3-eff0-4726-b859-86c230936cf2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ad56b243ad71\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:37:47 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:47 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:47 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[e472cc7a-25fe-4c38-ad6c-894cf5bb7f16]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:37:47 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 09 18:37:47 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:47 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:47 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[5225978d-55a9-477d-8b32-de9e5792906d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:37:47 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8358b90-ddbd-45e2-935a-bdbb2f09f008]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:37:47 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-ffbdd011-a2c2-4997-96a5-b2684deebe3d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Running cmd (subprocess): nvme version {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:47 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-ffbdd011-a2c2-4997-96a5-b2684deebe3d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] 'nvme version' failed. Not Retrying. {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:37:47 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ffbdd011-a2c2-4997-96a5-b2684deebe3d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] nvme not present on system {{(pid=72418) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 18:37:47 user nova-compute[72418]: DEBUG nova.compute.manager [req-13b161b5-ae0d-4af1-b661-fd4b0773c240 req-0ff6a41d-9553-40cb-8157-36438cdb5879 service nova] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Received event network-vif-plugged-0cd6232b-ea64-4978-bc0e-0e84995fd9a4 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:37:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-13b161b5-ae0d-4af1-b661-fd4b0773c240 req-0ff6a41d-9553-40cb-8157-36438cdb5879 service nova] Acquiring lock "0659fd5c-cb05-441e-94b6-9d05f7135893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:37:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-13b161b5-ae0d-4af1-b661-fd4b0773c240 req-0ff6a41d-9553-40cb-8157-36438cdb5879 service nova] Lock "0659fd5c-cb05-441e-94b6-9d05f7135893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:37:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-13b161b5-ae0d-4af1-b661-fd4b0773c240 req-0ff6a41d-9553-40cb-8157-36438cdb5879 service nova] Lock "0659fd5c-cb05-441e-94b6-9d05f7135893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:37:47 user nova-compute[72418]: DEBUG nova.compute.manager [req-13b161b5-ae0d-4af1-b661-fd4b0773c240 req-0ff6a41d-9553-40cb-8157-36438cdb5879 service nova] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] No waiting events found dispatching network-vif-plugged-0cd6232b-ea64-4978-bc0e-0e84995fd9a4 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:37:47 user nova-compute[72418]: WARNING nova.compute.manager [req-13b161b5-ae0d-4af1-b661-fd4b0773c240 req-0ff6a41d-9553-40cb-8157-36438cdb5879 service nova] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Received unexpected event network-vif-plugged-0cd6232b-ea64-4978-bc0e-0e84995fd9a4 for instance with vm_state active and task_state resize_finish.
Aug 09 18:37:47 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:47 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:37:47 user nova-compute[72418]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 18:37:47 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[167e3c78-d523-41bc-8ef3-dd5cb6f03628]: (4, '') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:37:47 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-ffbdd011-a2c2-4997-96a5-b2684deebe3d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72418) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 18:37:47 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-ffbdd011-a2c2-4997-96a5-b2684deebe3d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 18:37:47 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-ffbdd011-a2c2-4997-96a5-b2684deebe3d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] LIGHTOS: no hostnqn found. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 18:37:47 user nova-compute[72418]: DEBUG os_brick.utils [None req-ffbdd011-a2c2-4997-96a5-b2684deebe3d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ad56b243ad71', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:37:47 user nova-compute[72418]: DEBUG nova.virt.block_device [None req-ffbdd011-a2c2-4997-96a5-b2684deebe3d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Updating existing volume attachment record: e31177ab-2e17-4e00-be8d-0fa43b92807c {{(pid=72418) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 18:37:48 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:37:48 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-80a2f4ba-fe41-45bc-a4fa-eb6e02130770 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Acquiring lock "873654d4-9cf2-4dde-859c-ad26d05d6e0a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:37:48 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-80a2f4ba-fe41-45bc-a4fa-eb6e02130770 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "873654d4-9cf2-4dde-859c-ad26d05d6e0a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:37:48 user nova-compute[72418]: DEBUG nova.objects.instance [None req-80a2f4ba-fe41-45bc-a4fa-eb6e02130770 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lazy-loading 'flavor' on Instance uuid 873654d4-9cf2-4dde-859c-ad26d05d6e0a {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:37:48 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:37:48 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-80a2f4ba-fe41-45bc-a4fa-eb6e02130770 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "873654d4-9cf2-4dde-859c-ad26d05d6e0a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:37:48 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-80a2f4ba-fe41-45bc-a4fa-eb6e02130770 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Acquiring lock "873654d4-9cf2-4dde-859c-ad26d05d6e0a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:37:48 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-80a2f4ba-fe41-45bc-a4fa-eb6e02130770 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "873654d4-9cf2-4dde-859c-ad26d05d6e0a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:37:48 user nova-compute[72418]: INFO nova.compute.manager [None req-80a2f4ba-fe41-45bc-a4fa-eb6e02130770 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Attaching volume 802e8a18-bf68-47e6-b074-48e3ff2298df to /dev/vdb
Aug 09 18:37:48 user nova-compute[72418]: DEBUG os_brick.utils [None req-80a2f4ba-fe41-45bc-a4fa-eb6e02130770 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:37:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:48 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf84970a-70a4-43ac-843c-808635d41d38]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ad56b243ad71\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:37:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:48 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c526e7e-3f0a-4203-a261-b181625fb399]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:37:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:48 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed425da-a5ca-4b3d-ab76-09de3f1badd1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:37:48 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1665086-20ef-44f3-843a-e02854f8b1e5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:37:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-80a2f4ba-fe41-45bc-a4fa-eb6e02130770 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Running cmd (subprocess): nvme version {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-80a2f4ba-fe41-45bc-a4fa-eb6e02130770 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] 'nvme version' failed. Not Retrying. {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:37:48 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.nvmeof [None req-80a2f4ba-fe41-45bc-a4fa-eb6e02130770 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] nvme not present on system {{(pid=72418) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 18:37:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:49 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:37:49 user nova-compute[72418]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 18:37:49 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[563972d6-c6be-48e3-a4a2-5638343242f7]: (4, '') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:37:49 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-80a2f4ba-fe41-45bc-a4fa-eb6e02130770 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72418) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 18:37:49 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-80a2f4ba-fe41-45bc-a4fa-eb6e02130770 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 18:37:49 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-80a2f4ba-fe41-45bc-a4fa-eb6e02130770 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] LIGHTOS: no hostnqn found. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 18:37:49 user nova-compute[72418]: DEBUG os_brick.utils [None req-80a2f4ba-fe41-45bc-a4fa-eb6e02130770 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ad56b243ad71', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:37:49 user nova-compute[72418]: DEBUG nova.virt.block_device [None req-80a2f4ba-fe41-45bc-a4fa-eb6e02130770 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Updating existing volume attachment record: 8e94ea73-7e61-4af0-9b1c-7a4926fa4591 {{(pid=72418) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 18:37:49 user nova-compute[72418]: DEBUG nova.compute.manager [req-a41484d3-6de1-41e6-9558-6ae2d01da407 req-84a70831-fc6e-4a5f-8f3d-208a30d85115 service nova] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Received event network-changed-396cd02b-9a02-4b77-b06b-6253ca90f538 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:37:49 user nova-compute[72418]: DEBUG nova.compute.manager [req-a41484d3-6de1-41e6-9558-6ae2d01da407 req-84a70831-fc6e-4a5f-8f3d-208a30d85115 service nova] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Refreshing instance network info cache due to event network-changed-396cd02b-9a02-4b77-b06b-6253ca90f538. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:37:49 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a41484d3-6de1-41e6-9558-6ae2d01da407 req-84a70831-fc6e-4a5f-8f3d-208a30d85115 service nova] Acquiring lock "refresh_cache-873654d4-9cf2-4dde-859c-ad26d05d6e0a" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:37:49 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a41484d3-6de1-41e6-9558-6ae2d01da407 req-84a70831-fc6e-4a5f-8f3d-208a30d85115 service nova] Acquired lock "refresh_cache-873654d4-9cf2-4dde-859c-ad26d05d6e0a" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:37:49 user nova-compute[72418]: DEBUG nova.network.neutron [req-a41484d3-6de1-41e6-9558-6ae2d01da407 req-84a70831-fc6e-4a5f-8f3d-208a30d85115 service nova] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Refreshing network info cache for port 396cd02b-9a02-4b77-b06b-6253ca90f538 {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:37:50 user nova-compute[72418]: DEBUG nova.network.neutron [req-a41484d3-6de1-41e6-9558-6ae2d01da407 req-84a70831-fc6e-4a5f-8f3d-208a30d85115 service nova] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Updated VIF entry in instance network info cache for port 396cd02b-9a02-4b77-b06b-6253ca90f538. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:37:50 user nova-compute[72418]: DEBUG nova.network.neutron [req-a41484d3-6de1-41e6-9558-6ae2d01da407 req-84a70831-fc6e-4a5f-8f3d-208a30d85115 service nova] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Updating instance_info_cache with network_info: [{"id": "396cd02b-9a02-4b77-b06b-6253ca90f538", "address": "fa:16:3e:47:8e:5a", "network": {"id": "0fbd02ef-7c74-46c2-a09c-3b69be222ffa", "bridge": "br-int", "label": "tempest-TestStampPattern-85008345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce18df915bca48109597ad4aa8f1d116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap396cd02b-9a", "ovs_interfaceid": "396cd02b-9a02-4b77-b06b-6253ca90f538", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:37:50 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a41484d3-6de1-41e6-9558-6ae2d01da407 req-84a70831-fc6e-4a5f-8f3d-208a30d85115 service nova] Releasing lock "refresh_cache-873654d4-9cf2-4dde-859c-ad26d05d6e0a" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:37:51 user nova-compute[72418]: DEBUG nova.compute.manager [None req-03b001e6-83ee-4253-9a73-f31457914506 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:37:51 user nova-compute[72418]: INFO nova.compute.manager [None req-03b001e6-83ee-4253-9a73-f31457914506 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] instance snapshotting
Aug 09 18:37:51 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-03b001e6-83ee-4253-9a73-f31457914506 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Beginning live snapshot process
Aug 09 18:37:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-03b001e6-83ee-4253-9a73-f31457914506 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/disk --force-share --output=json -f qcow2 {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-03b001e6-83ee-4253-9a73-f31457914506 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/disk --force-share --output=json -f qcow2" returned: 0 in 0.146s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-03b001e6-83ee-4253-9a73-f31457914506 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/disk --force-share --output=json -f qcow2 {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:51 user nova-compute[72418]: DEBUG nova.compute.manager [req-b71afc22-437a-4305-9497-ccb3f7c53210 req-5956665c-1575-4a52-97fd-ba9eec281f15 service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Received event network-changed-e6df16f7-7151-450f-bbf8-dc3be066011e {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:37:51 user nova-compute[72418]: DEBUG nova.compute.manager [req-b71afc22-437a-4305-9497-ccb3f7c53210 req-5956665c-1575-4a52-97fd-ba9eec281f15 service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Refreshing instance network info cache due to event network-changed-e6df16f7-7151-450f-bbf8-dc3be066011e. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:37:51 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-b71afc22-437a-4305-9497-ccb3f7c53210 req-5956665c-1575-4a52-97fd-ba9eec281f15 service nova] Acquiring lock "refresh_cache-4e1a095f-a2e7-4ab6-bb7e-38cda890d567" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:37:51 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-b71afc22-437a-4305-9497-ccb3f7c53210 req-5956665c-1575-4a52-97fd-ba9eec281f15 service nova] Acquired lock "refresh_cache-4e1a095f-a2e7-4ab6-bb7e-38cda890d567" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:37:51 user nova-compute[72418]: DEBUG nova.network.neutron [req-b71afc22-437a-4305-9497-ccb3f7c53210 req-5956665c-1575-4a52-97fd-ba9eec281f15 service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Refreshing network info cache for port e6df16f7-7151-450f-bbf8-dc3be066011e {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:37:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-03b001e6-83ee-4253-9a73-f31457914506 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/disk --force-share --output=json -f qcow2" returned: 0 in 0.151s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-03b001e6-83ee-4253-9a73-f31457914506 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-03b001e6-83ee-4253-9a73-f31457914506 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.243s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-03b001e6-83ee-4253-9a73-f31457914506 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpmqaymysw/cd2071e448cc425fb0f774c72c2bd24f.delta 1073741824 {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-03b001e6-83ee-4253-9a73-f31457914506 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpmqaymysw/cd2071e448cc425fb0f774c72c2bd24f.delta 1073741824" returned: 0 in 0.073s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:52 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-03b001e6-83ee-4253-9a73-f31457914506 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 09 18:37:52 user nova-compute[72418]: DEBUG nova.network.neutron [req-b71afc22-437a-4305-9497-ccb3f7c53210 req-5956665c-1575-4a52-97fd-ba9eec281f15 service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Updated VIF entry in instance network info cache for port e6df16f7-7151-450f-bbf8-dc3be066011e. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:37:52 user nova-compute[72418]: DEBUG nova.network.neutron [req-b71afc22-437a-4305-9497-ccb3f7c53210 req-5956665c-1575-4a52-97fd-ba9eec281f15 service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Updating instance_info_cache with network_info: [{"id": "e6df16f7-7151-450f-bbf8-dc3be066011e", "address": "fa:16:3e:42:1f:2f", "network": {"id": "aa563713-99b7-4830-bbc5-5390076a264d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1029161501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99d09208fba747f29a90f95c5bb5ee4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6df16f7-71", "ovs_interfaceid": "e6df16f7-7151-450f-bbf8-dc3be066011e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:37:52 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-b71afc22-437a-4305-9497-ccb3f7c53210 req-5956665c-1575-4a52-97fd-ba9eec281f15 service nova] Releasing lock "refresh_cache-4e1a095f-a2e7-4ab6-bb7e-38cda890d567" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:37:53 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-03b001e6-83ee-4253-9a73-f31457914506 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72418) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 18:37:53 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:37:53 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:37:53 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-03b001e6-83ee-4253-9a73-f31457914506 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72418) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 18:37:53 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-03b001e6-83ee-4253-9a73-f31457914506 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 09 18:37:53 user nova-compute[72418]: DEBUG nova.privsep.utils [None req-03b001e6-83ee-4253-9a73-f31457914506 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72418) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 18:37:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-03b001e6-83ee-4253-9a73-f31457914506 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpmqaymysw/cd2071e448cc425fb0f774c72c2bd24f.delta /opt/stack/data/nova/instances/snapshots/tmpmqaymysw/cd2071e448cc425fb0f774c72c2bd24f {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-03b001e6-83ee-4253-9a73-f31457914506 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpmqaymysw/cd2071e448cc425fb0f774c72c2bd24f.delta /opt/stack/data/nova/instances/snapshots/tmpmqaymysw/cd2071e448cc425fb0f774c72c2bd24f" returned: 0 in 0.639s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:54 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-03b001e6-83ee-4253-9a73-f31457914506 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Snapshot extracted, beginning image upload
Aug 09 18:37:55 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:37:55 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:37:55 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:37:55 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72418) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 18:37:56 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:37:57 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffbdd011-a2c2-4997-96a5-b2684deebe3d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Calling os-brick to attach iSCSI Volume {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 18:37:57 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffbdd011-a2c2-4997-96a5-b2684deebe3d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dpYONgIP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:37:57 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-ffbdd011-a2c2-4997-96a5-b2684deebe3d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:37:57 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-ffbdd011-a2c2-4997-96a5-b2684deebe3d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:37:57 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-ffbdd011-a2c2-4997-96a5-b2684deebe3d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:37:57 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-ffbdd011-a2c2-4997-96a5-b2684deebe3d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:37:57 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-ffbdd011-a2c2-4997-96a5-b2684deebe3d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:37:57 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-ffbdd011-a2c2-4997-96a5-b2684deebe3d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:37:57 user nova-compute[72418]: INFO os_brick.initiator.connectors.iscsi [None req-ffbdd011-a2c2-4997-96a5-b2684deebe3d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 18:37:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7 -p 172.16.0.220:3260 {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:57 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[d831aff7-b18e-4ff7-ac2a-16ef62e9e72d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:37:57 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffbdd011-a2c2-4997-96a5-b2684deebe3d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 18:37:57 user nova-compute[72418]:  {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:37:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7 -p 172.16.0.220:3260 --interface default --op new {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:57 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[57359fdd-fe5e-4591-9072-c1defd3c39eb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7] added\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:37:57 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffbdd011-a2c2-4997-96a5-b2684deebe3d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7] added
Aug 09 18:37:57 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:37:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:57 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d5ebb4-6f07-4f65-9c0e-e56fa212e2de]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:37:57 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffbdd011-a2c2-4997-96a5-b2684deebe3d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:37:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:57 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c337f20-aab2-434b-93da-3c3bf6fadbea]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:37:57 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffbdd011-a2c2-4997-96a5-b2684deebe3d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:37:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dpYONgIP {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dpYONgIP" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:57 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[2178ed03-3909-406c-b6dc-ac1d5cdd984a]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:37:57 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffbdd011-a2c2-4997-96a5-b2684deebe3d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dpYONgIP'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:37:57 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-03b001e6-83ee-4253-9a73-f31457914506 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Snapshot image upload complete
Aug 09 18:37:57 user nova-compute[72418]: INFO nova.compute.manager [None req-03b001e6-83ee-4253-9a73-f31457914506 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Took 5.86 seconds to snapshot the instance on the hypervisor.
Aug 09 18:37:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:57 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74495f1-8fef-4378-86b1-cee73a9e5c5a]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:37:57 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffbdd011-a2c2-4997-96a5-b2684deebe3d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:37:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:57 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab253ed-65c2-4cb4-95f2-ff3ba3281e19]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:37:57 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffbdd011-a2c2-4997-96a5-b2684deebe3d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:37:57 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:37:57 user nova-compute[72418]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:37:57 user nova-compute[72418]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)
Aug 09 18:37:57 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:37:57 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffbdd011-a2c2-4997-96a5-b2684deebe3d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:37:57 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:37:57 user nova-compute[72418]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:37:57 user nova-compute[72418]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)
Aug 09 18:37:57 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:37:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7 -p 172.16.0.220:3260 --login {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:57 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8df4167-4b75-445b-a4a0-444300361d95]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:37:57 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffbdd011-a2c2-4997-96a5-b2684deebe3d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7, portal: 172.16.0.220,3260]
Aug 09 18:37:57 user nova-compute[72418]: Login to [iface: default, target: iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7, portal: 172.16.0.220,3260] successful.
Aug 09 18:37:57 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:37:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:57 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f451169-0467-4fca-bf3a-1c0e4202c40e]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:37:57 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffbdd011-a2c2-4997-96a5-b2684deebe3d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:37:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:57 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53e6cc5-3f32-4666-9d86-4f61b1409c47]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:37:57 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffbdd011-a2c2-4997-96a5-b2684deebe3d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:37:57 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:37:57 user nova-compute[72418]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:37:57 user nova-compute[72418]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)
Aug 09 18:37:57 user nova-compute[72418]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7 (non-flash)
Aug 09 18:37:57 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:37:57 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffbdd011-a2c2-4997-96a5-b2684deebe3d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:37:57 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:37:57 user nova-compute[72418]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:37:57 user nova-compute[72418]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)
Aug 09 18:37:57 user nova-compute[72418]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7 (non-flash)
Aug 09 18:37:57 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:37:57 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-ffbdd011-a2c2-4997-96a5-b2684deebe3d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:37:57 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffbdd011-a2c2-4997-96a5-b2684deebe3d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Connected to 172.16.0.220:3260 {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 18:37:57 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-ffbdd011-a2c2-4997-96a5-b2684deebe3d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] HCTL ('36', '-', '-', 0) found on session 36 with lun 0 {{(pid=72418) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 18:37:57 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-ffbdd011-a2c2-4997-96a5-b2684deebe3d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72418) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 18:37:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:57 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[52496bee-a8ca-4dfd-9c52-40d30d31a577]: (4, ('- - 0', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:37:57 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-ffbdd011-a2c2-4997-96a5-b2684deebe3d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72418) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 18:37:57 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffbdd011-a2c2-4997-96a5-b2684deebe3d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dpYONgIP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 18:37:57 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:37:58 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:37:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-ffbdd011-a2c2-4997-96a5-b2684deebe3d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:37:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffbdd011-a2c2-4997-96a5-b2684deebe3d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '23639633263353265', 'path': '/dev/sde'} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:37:58 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffbdd011-a2c2-4997-96a5-b2684deebe3d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639633263353265', 'path': '/dev/sde'} {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 18:37:58 user nova-compute[72418]: DEBUG nova.objects.instance [None req-ffbdd011-a2c2-4997-96a5-b2684deebe3d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lazy-loading 'flavor' on Instance uuid 97f49889-df0b-48c1-97ce-5c331b6a65ce {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:37:58 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-ffbdd011-a2c2-4997-96a5-b2684deebe3d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 18:37:58 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:37:58 user nova-compute[72418]:   <source dev="/dev/sde"/>
Aug 09 18:37:58 user nova-compute[72418]:   <target dev="vdb" bus="virtio"/>
Aug 09 18:37:58 user nova-compute[72418]:   <serial>cceb9c76-2bd3-461d-ac8b-41b4350b9fa7</serial>
Aug 09 18:37:58 user nova-compute[72418]: </disk>
Aug 09 18:37:58 user nova-compute[72418]:  {{(pid=72418) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 18:37:58 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:37:58 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80a2f4ba-fe41-45bc-a4fa-eb6e02130770 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Calling os-brick to attach iSCSI Volume {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 18:37:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-80a2f4ba-fe41-45bc-a4fa-eb6e02130770 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:802e8a18-bf68-47e6-b074-48e3ff2298df'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fNEorhMg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:37:58 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-80a2f4ba-fe41-45bc-a4fa-eb6e02130770 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:37:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-80a2f4ba-fe41-45bc-a4fa-eb6e02130770 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:37:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-80a2f4ba-fe41-45bc-a4fa-eb6e02130770 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:37:58 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-80a2f4ba-fe41-45bc-a4fa-eb6e02130770 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:37:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-80a2f4ba-fe41-45bc-a4fa-eb6e02130770 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:802e8a18-bf68-47e6-b074-48e3ff2298df" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:37:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-80a2f4ba-fe41-45bc-a4fa-eb6e02130770 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:802e8a18-bf68-47e6-b074-48e3ff2298df" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:37:58 user nova-compute[72418]: INFO os_brick.initiator.connectors.iscsi [None req-80a2f4ba-fe41-45bc-a4fa-eb6e02130770 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 18:37:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:802e8a18-bf68-47e6-b074-48e3ff2298df -p 172.16.0.220:3260 {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:802e8a18-bf68-47e6-b074-48e3ff2298df -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:58 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb8465d-09b5-4f35-bafe-eb1d145435ff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:37:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-80a2f4ba-fe41-45bc-a4fa-eb6e02130770 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 18:37:58 user nova-compute[72418]:  {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:37:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:802e8a18-bf68-47e6-b074-48e3ff2298df -p 172.16.0.220:3260 --interface default --op new {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:802e8a18-bf68-47e6-b074-48e3ff2298df -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:58 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5ac3ea-6d66-4af9-a389-82beb2513b24]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:802e8a18-bf68-47e6-b074-48e3ff2298df] added\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:37:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-80a2f4ba-fe41-45bc-a4fa-eb6e02130770 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:802e8a18-bf68-47e6-b074-48e3ff2298df] added
Aug 09 18:37:58 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:37:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:802e8a18-bf68-47e6-b074-48e3ff2298df -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:802e8a18-bf68-47e6-b074-48e3ff2298df -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:58 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc22143-d7e2-4149-875e-15f2ff1ab035]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:37:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-80a2f4ba-fe41-45bc-a4fa-eb6e02130770 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:37:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:802e8a18-bf68-47e6-b074-48e3ff2298df -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:802e8a18-bf68-47e6-b074-48e3ff2298df -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:58 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[40059c85-4b80-465f-bb4a-cd35a1d55d10]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:37:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-80a2f4ba-fe41-45bc-a4fa-eb6e02130770 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:37:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:802e8a18-bf68-47e6-b074-48e3ff2298df -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fNEorhMg {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:802e8a18-bf68-47e6-b074-48e3ff2298df -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fNEorhMg" returned: 0 in 0.023s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:58 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5c1835-f20d-4c93-a63e-c4f718ab2f25]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:37:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-80a2f4ba-fe41-45bc-a4fa-eb6e02130770 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fNEorhMg'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:37:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:802e8a18-bf68-47e6-b074-48e3ff2298df -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:802e8a18-bf68-47e6-b074-48e3ff2298df -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:58 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d599d9-719f-4331-b4fe-b9f97980d226]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:37:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-80a2f4ba-fe41-45bc-a4fa-eb6e02130770 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:37:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:58 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[21fcec25-3e51-4f2a-be17-ddddd7c5fa10]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:37:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-80a2f4ba-fe41-45bc-a4fa-eb6e02130770 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:37:58 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:37:58 user nova-compute[72418]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:37:58 user nova-compute[72418]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)
Aug 09 18:37:58 user nova-compute[72418]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7 (non-flash)
Aug 09 18:37:58 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:37:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-80a2f4ba-fe41-45bc-a4fa-eb6e02130770 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:37:58 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:37:58 user nova-compute[72418]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:37:58 user nova-compute[72418]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)
Aug 09 18:37:58 user nova-compute[72418]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7 (non-flash)
Aug 09 18:37:58 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:37:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:802e8a18-bf68-47e6-b074-48e3ff2298df -p 172.16.0.220:3260 --login {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:58 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:37:58 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:37:58 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72418) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 18:37:58 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-ffbdd011-a2c2-4997-96a5-b2684deebe3d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:37:58 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-ffbdd011-a2c2-4997-96a5-b2684deebe3d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:37:58 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-ffbdd011-a2c2-4997-96a5-b2684deebe3d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] No VIF found with MAC fa:16:3e:4c:1c:62, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:37:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:802e8a18-bf68-47e6-b074-48e3ff2298df -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:58 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25d43fa-79e3-4d0e-b255-873fd665423f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:802e8a18-bf68-47e6-b074-48e3ff2298df, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:802e8a18-bf68-47e6-b074-48e3ff2298df, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:37:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-80a2f4ba-fe41-45bc-a4fa-eb6e02130770 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:802e8a18-bf68-47e6-b074-48e3ff2298df, portal: 172.16.0.220,3260]
Aug 09 18:37:58 user nova-compute[72418]: Login to [iface: default, target: iqn.2010-10.org.openstack:802e8a18-bf68-47e6-b074-48e3ff2298df, portal: 172.16.0.220,3260] successful.
Aug 09 18:37:58 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:37:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:802e8a18-bf68-47e6-b074-48e3ff2298df -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:802e8a18-bf68-47e6-b074-48e3ff2298df -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:59 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[b287bdb3-7001-4e95-b169-bb0601dda8fa]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:37:59 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-80a2f4ba-fe41-45bc-a4fa-eb6e02130770 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:37:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:59 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[440d492f-d869-4321-90e9-c8f04ea19d45]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:802e8a18-bf68-47e6-b074-48e3ff2298df (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:37:59 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-80a2f4ba-fe41-45bc-a4fa-eb6e02130770 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:37:59 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:37:59 user nova-compute[72418]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:37:59 user nova-compute[72418]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)
Aug 09 18:37:59 user nova-compute[72418]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7 (non-flash)
Aug 09 18:37:59 user nova-compute[72418]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:802e8a18-bf68-47e6-b074-48e3ff2298df (non-flash)
Aug 09 18:37:59 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:37:59 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-80a2f4ba-fe41-45bc-a4fa-eb6e02130770 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:37:59 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:37:59 user nova-compute[72418]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:37:59 user nova-compute[72418]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)
Aug 09 18:37:59 user nova-compute[72418]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7 (non-flash)
Aug 09 18:37:59 user nova-compute[72418]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:802e8a18-bf68-47e6-b074-48e3ff2298df (non-flash)
Aug 09 18:37:59 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:37:59 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-80a2f4ba-fe41-45bc-a4fa-eb6e02130770 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:802e8a18-bf68-47e6-b074-48e3ff2298df" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.357s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:37:59 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-80a2f4ba-fe41-45bc-a4fa-eb6e02130770 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Connected to 172.16.0.220:3260 {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 18:37:59 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-80a2f4ba-fe41-45bc-a4fa-eb6e02130770 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] HCTL ('37', '-', '-', 0) found on session 37 with lun 0 {{(pid=72418) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 18:37:59 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-80a2f4ba-fe41-45bc-a4fa-eb6e02130770 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72418) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 18:37:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:37:59 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-ffbdd011-a2c2-4997-96a5-b2684deebe3d tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "97f49889-df0b-48c1-97ce-5c331b6a65ce" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.790s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:37:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.036s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:37:59 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84feef7-0527-47a8-839c-7edec5958c39]: (4, ('- - 0', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:37:59 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-80a2f4ba-fe41-45bc-a4fa-eb6e02130770 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Searching for a device in session 37 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72418) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 18:37:59 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-80a2f4ba-fe41-45bc-a4fa-eb6e02130770 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fNEorhMg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 18:37:59 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:37:59 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:37:59 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:38:00 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-80a2f4ba-fe41-45bc-a4fa-eb6e02130770 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.416s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:38:00 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-80a2f4ba-fe41-45bc-a4fa-eb6e02130770 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] <== connect_volume: return (1417ms) {'type': 'block', 'scsi_wwn': '26335353535643738', 'path': '/dev/sdf'} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:38:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80a2f4ba-fe41-45bc-a4fa-eb6e02130770 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335353535643738', 'path': '/dev/sdf'} {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 18:38:00 user nova-compute[72418]: DEBUG nova.objects.instance [None req-80a2f4ba-fe41-45bc-a4fa-eb6e02130770 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lazy-loading 'flavor' on Instance uuid 873654d4-9cf2-4dde-859c-ad26d05d6e0a {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:38:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-80a2f4ba-fe41-45bc-a4fa-eb6e02130770 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 18:38:00 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:38:00 user nova-compute[72418]:   <source dev="/dev/sdf"/>
Aug 09 18:38:00 user nova-compute[72418]:   <target dev="vdb" bus="virtio"/>
Aug 09 18:38:00 user nova-compute[72418]:   <serial>802e8a18-bf68-47e6-b074-48e3ff2298df</serial>
Aug 09 18:38:00 user nova-compute[72418]: </disk>
Aug 09 18:38:00 user nova-compute[72418]:  {{(pid=72418) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 18:38:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-80a2f4ba-fe41-45bc-a4fa-eb6e02130770 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:38:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-80a2f4ba-fe41-45bc-a4fa-eb6e02130770 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:38:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-80a2f4ba-fe41-45bc-a4fa-eb6e02130770 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] No VIF found with MAC fa:16:3e:47:8e:5a, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:38:00 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-80a2f4ba-fe41-45bc-a4fa-eb6e02130770 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "873654d4-9cf2-4dde-859c-ad26d05d6e0a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.958s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:38:00 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:38:00 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Starting heal instance info cache {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 18:38:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "refresh_cache-01c46b33-6788-44a5-a43c-88ee4acc4d39" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:38:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquired lock "refresh_cache-01c46b33-6788-44a5-a43c-88ee4acc4d39" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:38:01 user nova-compute[72418]: DEBUG nova.network.neutron [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Forcefully refreshing network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 18:38:01 user nova-compute[72418]: DEBUG nova.network.neutron [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Updating instance_info_cache with network_info: [{"id": "1487cbc0-54ec-4134-9e08-88f02ff870f5", "address": "fa:16:3e:b3:6b:21", "network": {"id": "15a49d9b-3c0d-449b-9473-29f219960e2c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c68622cd79472ba6ad14a6876aeaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1487cbc0-54", "ovs_interfaceid": "1487cbc0-54ec-4134-9e08-88f02ff870f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:38:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Releasing lock "refresh_cache-01c46b33-6788-44a5-a43c-88ee4acc4d39" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:38:01 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Updated the network info_cache for instance {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-4d481680-4e48-4ad6-938c-cb03db2d4e75 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Acquiring lock "97f49889-df0b-48c1-97ce-5c331b6a65ce" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-4d481680-4e48-4ad6-938c-cb03db2d4e75 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "97f49889-df0b-48c1-97ce-5c331b6a65ce" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG nova.objects.instance [None req-4d481680-4e48-4ad6-938c-cb03db2d4e75 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lazy-loading 'flavor' on Instance uuid 97f49889-df0b-48c1-97ce-5c331b6a65ce {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-4d481680-4e48-4ad6-938c-cb03db2d4e75 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "97f49889-df0b-48c1-97ce-5c331b6a65ce" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-f013a1d4-645c-4e27-b04a-f2aa0950b061 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Acquiring lock "873654d4-9cf2-4dde-859c-ad26d05d6e0a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-f013a1d4-645c-4e27-b04a-f2aa0950b061 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "873654d4-9cf2-4dde-859c-ad26d05d6e0a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:38:03 user nova-compute[72418]: INFO nova.compute.manager [None req-f013a1d4-645c-4e27-b04a-f2aa0950b061 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Detaching volume 802e8a18-bf68-47e6-b074-48e3ff2298df
Aug 09 18:38:03 user nova-compute[72418]: INFO nova.virt.block_device [None req-f013a1d4-645c-4e27-b04a-f2aa0950b061 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Attempting to driver detach volume 802e8a18-bf68-47e6-b074-48e3ff2298df from mountpoint /dev/vdb
Aug 09 18:38:03 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-f013a1d4-645c-4e27-b04a-f2aa0950b061 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Attempting to detach device vdb from instance 873654d4-9cf2-4dde-859c-ad26d05d6e0a from the persistent domain config. {{(pid=72418) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-f013a1d4-645c-4e27-b04a-f2aa0950b061 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 18:38:03 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:38:03 user nova-compute[72418]:   <source dev="/dev/sdf"/>
Aug 09 18:38:03 user nova-compute[72418]:   <target dev="vdb" bus="virtio"/>
Aug 09 18:38:03 user nova-compute[72418]:   <serial>802e8a18-bf68-47e6-b074-48e3ff2298df</serial>
Aug 09 18:38:03 user nova-compute[72418]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 18:38:03 user nova-compute[72418]: </disk>
Aug 09 18:38:03 user nova-compute[72418]:  {{(pid=72418) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 18:38:03 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-f013a1d4-645c-4e27-b04a-f2aa0950b061 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Successfully detached device vdb from instance 873654d4-9cf2-4dde-859c-ad26d05d6e0a from the persistent domain config.
Aug 09 18:38:03 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-f013a1d4-645c-4e27-b04a-f2aa0950b061 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 873654d4-9cf2-4dde-859c-ad26d05d6e0a from the live domain config. {{(pid=72418) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-f013a1d4-645c-4e27-b04a-f2aa0950b061 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 18:38:03 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:38:03 user nova-compute[72418]:   <source dev="/dev/sdf"/>
Aug 09 18:38:03 user nova-compute[72418]:   <target dev="vdb" bus="virtio"/>
Aug 09 18:38:03 user nova-compute[72418]:   <serial>802e8a18-bf68-47e6-b074-48e3ff2298df</serial>
Aug 09 18:38:03 user nova-compute[72418]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 18:38:03 user nova-compute[72418]: </disk>
Aug 09 18:38:03 user nova-compute[72418]:  {{(pid=72418) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-4d481680-4e48-4ad6-938c-cb03db2d4e75 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Acquiring lock "97f49889-df0b-48c1-97ce-5c331b6a65ce" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-4d481680-4e48-4ad6-938c-cb03db2d4e75 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "97f49889-df0b-48c1-97ce-5c331b6a65ce" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:38:03 user nova-compute[72418]: INFO nova.compute.manager [None req-4d481680-4e48-4ad6-938c-cb03db2d4e75 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Attaching volume 311e1210-fd22-4cc0-bd88-c1d19fc0d8c3 to /dev/vdc
Aug 09 18:38:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG os_brick.utils [None req-4d481680-4e48-4ad6-938c-cb03db2d4e75 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebe6421-02be-4a1c-a77c-d09835f24c35]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ad56b243ad71\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[960c6ffc-60b3-4cc9-b334-72956958bd4e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a3cee2-a8d7-4a33-bc25-2e741416210a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4d1a4b-5cc5-468f-a685-7f2b928c6487]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-4d481680-4e48-4ad6-938c-cb03db2d4e75 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Running cmd (subprocess): nvme version {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-4d481680-4e48-4ad6-938c-cb03db2d4e75 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] 'nvme version' failed. Not Retrying. {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4d481680-4e48-4ad6-938c-cb03db2d4e75 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] nvme not present on system {{(pid=72418) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:38:03 user nova-compute[72418]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 18:38:03 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec16c357-25dc-41e5-8879-c399451061ea]: (4, '') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-4d481680-4e48-4ad6-938c-cb03db2d4e75 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72418) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-4d481680-4e48-4ad6-938c-cb03db2d4e75 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-4d481680-4e48-4ad6-938c-cb03db2d4e75 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] LIGHTOS: no hostnqn found. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG os_brick.utils [None req-4d481680-4e48-4ad6-938c-cb03db2d4e75 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ad56b243ad71', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG nova.virt.block_device [None req-4d481680-4e48-4ad6-938c-cb03db2d4e75 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Updating existing volume attachment record: e573033c-ab27-4b4c-b5d3-4a821e2029bf {{(pid=72418) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Received event <DeviceRemovedEvent: 1691606283.6480575, 873654d4-9cf2-4dde-859c-ad26d05d6e0a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72418) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-f013a1d4-645c-4e27-b04a-f2aa0950b061 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 873654d4-9cf2-4dde-859c-ad26d05d6e0a {{(pid=72418) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 18:38:03 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-f013a1d4-645c-4e27-b04a-f2aa0950b061 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Successfully detached device vdb from instance 873654d4-9cf2-4dde-859c-ad26d05d6e0a from the live domain config.
Aug 09 18:38:03 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f013a1d4-645c-4e27-b04a-f2aa0950b061 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] calling os-brick to detach iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f013a1d4-645c-4e27-b04a-f2aa0950b061 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, {'target_iqns': ['iqn.2010-10.org.openstack:802e8a18-bf68-47e6-b074-48e3ff2298df'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fNEorhMg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:38:03 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-f013a1d4-645c-4e27-b04a-f2aa0950b061 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:38:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-f013a1d4-645c-4e27-b04a-f2aa0950b061 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-f013a1d4-645c-4e27-b04a-f2aa0950b061 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f013a1d4-645c-4e27-b04a-f2aa0950b061 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:802e8a18-bf68-47e6-b074-48e3ff2298df', 0)] {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c989f7-76dd-4a88-ae1c-bdebf6dc535b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:802e8a18-bf68-47e6-b074-48e3ff2298df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63c0f0c-6f69-42d3-b3c1-a67d10494dc6]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:802e8a18-bf68-47e6-b074-48e3ff2298df (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f013a1d4-645c-4e27-b04a-f2aa0950b061 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:38:03 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:38:03 user nova-compute[72418]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:38:03 user nova-compute[72418]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)
Aug 09 18:38:03 user nova-compute[72418]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7 (non-flash)
Aug 09 18:38:03 user nova-compute[72418]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:802e8a18-bf68-47e6-b074-48e3ff2298df (non-flash)
Aug 09 18:38:03 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f013a1d4-645c-4e27-b04a-f2aa0950b061 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:38:03 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:38:03 user nova-compute[72418]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:38:03 user nova-compute[72418]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)
Aug 09 18:38:03 user nova-compute[72418]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7 (non-flash)
Aug 09 18:38:03 user nova-compute[72418]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:802e8a18-bf68-47e6-b074-48e3ff2298df (non-flash)
Aug 09 18:38:03 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f013a1d4-645c-4e27-b04a-f2aa0950b061 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f42f874dcf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:802e8a18-bf68-47e6-b074-48e3ff2298df'): ({'sdf'}, set())}) {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-f013a1d4-645c-4e27-b04a-f2aa0950b061 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Removing single pathed devices sdf {{(pid=72418) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0041549-ae5c-40ec-9576-dc88173d70e5]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac4c70c-0ee4-4257-81b2-72e1fde22a4e]: (4, ('ok\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-f013a1d4-645c-4e27-b04a-f2aa0950b061 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Flushing IO for device /dev/sdf {{(pid=72418) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d4ca47-0d90-4c86-ab67-67c981208854]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-f013a1d4-645c-4e27-b04a-f2aa0950b061 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72418) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.036s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[36dd293e-dc2a-4a5c-bad8-3a6c15e81f9b]: (4, ('1', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-f013a1d4-645c-4e27-b04a-f2aa0950b061 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-f013a1d4-645c-4e27-b04a-f2aa0950b061 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] SCSI volumes sdf have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f013a1d4-645c-4e27-b04a-f2aa0950b061 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:802e8a18-bf68-47e6-b074-48e3ff2298df')] {{(pid=72418) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:802e8a18-bf68-47e6-b074-48e3ff2298df -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:802e8a18-bf68-47e6-b074-48e3ff2298df -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e0ed7e-4a46-4155-b2cd-93a054e6df95]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f013a1d4-645c-4e27-b04a-f2aa0950b061 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:802e8a18-bf68-47e6-b074-48e3ff2298df -p 172.16.0.220:3260 --logout {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:802e8a18-bf68-47e6-b074-48e3ff2298df -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[73293e10-bf87-4cc2-880a-fb4eb4b53ee1]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:802e8a18-bf68-47e6-b074-48e3ff2298df, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:802e8a18-bf68-47e6-b074-48e3ff2298df, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f013a1d4-645c-4e27-b04a-f2aa0950b061 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:802e8a18-bf68-47e6-b074-48e3ff2298df, portal: 172.16.0.220,3260]
Aug 09 18:38:03 user nova-compute[72418]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:802e8a18-bf68-47e6-b074-48e3ff2298df, portal: 172.16.0.220,3260] successful.
Aug 09 18:38:03 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:802e8a18-bf68-47e6-b074-48e3ff2298df -p 172.16.0.220:3260 --op delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Auditing locally available compute resources for user (node: user) {{(pid=72418) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:802e8a18-bf68-47e6-b074-48e3ff2298df -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb1f777-2264-4c96-9225-ca4c073d0973]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f013a1d4-645c-4e27-b04a-f2aa0950b061 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-f013a1d4-645c-4e27-b04a-f2aa0950b061 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-f013a1d4-645c-4e27-b04a-f2aa0950b061 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] <== disconnect_volume: return (313ms) None {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:38:03 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f013a1d4-645c-4e27-b04a-f2aa0950b061 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Disconnected iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 18:38:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:04 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:38:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/873654d4-9cf2-4dde-859c-ad26d05d6e0a/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:04 user nova-compute[72418]: DEBUG nova.objects.instance [None req-f013a1d4-645c-4e27-b04a-f2aa0950b061 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lazy-loading 'flavor' on Instance uuid 873654d4-9cf2-4dde-859c-ad26d05d6e0a {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:38:04 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-f013a1d4-645c-4e27-b04a-f2aa0950b061 tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "873654d4-9cf2-4dde-859c-ad26d05d6e0a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.821s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:38:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/873654d4-9cf2-4dde-859c-ad26d05d6e0a/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/873654d4-9cf2-4dde-859c-ad26d05d6e0a/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/873654d4-9cf2-4dde-859c-ad26d05d6e0a/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9e974b-b993-4f4e-9446-14941c39f109/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9e974b-b993-4f4e-9446-14941c39f109/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9e974b-b993-4f4e-9446-14941c39f109/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9e974b-b993-4f4e-9446-14941c39f109/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json" returned: 0 in 0.150s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f49889-df0b-48c1-97ce-5c331b6a65ce/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f49889-df0b-48c1-97ce-5c331b6a65ce/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f49889-df0b-48c1-97ce-5c331b6a65ce/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f49889-df0b-48c1-97ce-5c331b6a65ce/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:06 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:38:06 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:38:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e582b61c-d998-4a3f-8392-a7f0e94a4dec/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e582b61c-d998-4a3f-8392-a7f0e94a4dec/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e582b61c-d998-4a3f-8392-a7f0e94a4dec/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e582b61c-d998-4a3f-8392-a7f0e94a4dec/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:07 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:38:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:07 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:38:08 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:38:08 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:38:08 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Hypervisor/Node resource view: name=user free_ram=7062MB free_disk=25.157581329345703GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72418) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 18:38:08 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:38:08 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:38:08 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Applying migration context for instance 0659fd5c-cb05-441e-94b6-9d05f7135893 as it has an incoming, in-progress migration f736d05d-3ba5-4d57-8e9c-332bae8c553f. Migration status is finished {{(pid=72418) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 09 18:38:08 user nova-compute[72418]: INFO nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Updating resource usage from migration f736d05d-3ba5-4d57-8e9c-332bae8c553f
Aug 09 18:38:08 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:38:08 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 6af7918a-ce90-45ab-93d8-684e1489e891 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:38:08 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 8fe41968-a219-4a5a-afdb-32eb2082bb40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:38:08 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 01c46b33-6788-44a5-a43c-88ee4acc4d39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:38:08 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance e019064c-955e-4f80-9b00-6b32b3835d58 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:38:08 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance c46f2599-93f8-412e-9918-7ace8a9f19dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:38:08 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance e582b61c-d998-4a3f-8392-a7f0e94a4dec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:38:08 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 2c9e974b-b993-4f4e-9446-14941c39f109 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:38:08 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance e24ebafb-73cb-42ea-a0b6-2263badd573f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:38:08 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 03ad5bab-ab32-47fc-b7e8-b32282b9c20d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:38:08 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 97f49889-df0b-48c1-97ce-5c331b6a65ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:38:08 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 873654d4-9cf2-4dde-859c-ad26d05d6e0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:38:08 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 4e1a095f-a2e7-4ab6-bb7e-38cda890d567 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:38:08 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Migration f736d05d-3ba5-4d57-8e9c-332bae8c553f is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 09 18:38:08 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 0659fd5c-cb05-441e-94b6-9d05f7135893 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:38:08 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 18:38:08 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 18:38:08 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Refreshing inventories for resource provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 18:38:08 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Updating ProviderTree inventory for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 18:38:08 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Updating inventory in ProviderTree for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 18:38:08 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Refreshing aggregate associations for resource provider 50628e48-0a01-4c3f-9ff5-2a66453cd194, aggregates: None {{(pid=72418) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 18:38:08 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Refreshing trait associations for resource provider 50628e48-0a01-4c3f-9ff5-2a66453cd194, traits: HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=72418) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 18:38:08 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:38:08 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:38:08 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:38:09 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Compute_service record updated for user:user {{(pid=72418) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 18:38:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.912s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:38:12 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:38:12 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Cleaning up deleted instances {{(pid=72418) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 18:38:12 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] There are 0 instances to clean {{(pid=72418) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 18:38:13 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:38:13 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:38:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-6f2db57d-975c-4fbf-a1f5-e7fe46e2e903 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Acquiring lock "01c46b33-6788-44a5-a43c-88ee4acc4d39" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:38:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-6f2db57d-975c-4fbf-a1f5-e7fe46e2e903 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "01c46b33-6788-44a5-a43c-88ee4acc4d39" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:38:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-6f2db57d-975c-4fbf-a1f5-e7fe46e2e903 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Acquiring lock "01c46b33-6788-44a5-a43c-88ee4acc4d39-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:38:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-6f2db57d-975c-4fbf-a1f5-e7fe46e2e903 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "01c46b33-6788-44a5-a43c-88ee4acc4d39-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:38:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-6f2db57d-975c-4fbf-a1f5-e7fe46e2e903 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "01c46b33-6788-44a5-a43c-88ee4acc4d39-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:38:15 user nova-compute[72418]: INFO nova.compute.manager [None req-6f2db57d-975c-4fbf-a1f5-e7fe46e2e903 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Terminating instance
Aug 09 18:38:15 user nova-compute[72418]: DEBUG nova.compute.manager [None req-6f2db57d-975c-4fbf-a1f5-e7fe46e2e903 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Start destroying the instance on the hypervisor. {{(pid=72418) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 18:38:15 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:38:15 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:38:15 user nova-compute[72418]: DEBUG nova.compute.manager [req-1905a303-3bcf-47dc-a1de-51998f14656e req-50757822-1187-4e51-97c9-3fa994db4f35 service nova] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Received event network-vif-unplugged-1487cbc0-54ec-4134-9e08-88f02ff870f5 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:38:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-1905a303-3bcf-47dc-a1de-51998f14656e req-50757822-1187-4e51-97c9-3fa994db4f35 service nova] Acquiring lock "01c46b33-6788-44a5-a43c-88ee4acc4d39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:38:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-1905a303-3bcf-47dc-a1de-51998f14656e req-50757822-1187-4e51-97c9-3fa994db4f35 service nova] Lock "01c46b33-6788-44a5-a43c-88ee4acc4d39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:38:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-1905a303-3bcf-47dc-a1de-51998f14656e req-50757822-1187-4e51-97c9-3fa994db4f35 service nova] Lock "01c46b33-6788-44a5-a43c-88ee4acc4d39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:38:15 user nova-compute[72418]: DEBUG nova.compute.manager [req-1905a303-3bcf-47dc-a1de-51998f14656e req-50757822-1187-4e51-97c9-3fa994db4f35 service nova] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] No waiting events found dispatching network-vif-unplugged-1487cbc0-54ec-4134-9e08-88f02ff870f5 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:38:15 user nova-compute[72418]: DEBUG nova.compute.manager [req-1905a303-3bcf-47dc-a1de-51998f14656e req-50757822-1187-4e51-97c9-3fa994db4f35 service nova] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Received event network-vif-unplugged-1487cbc0-54ec-4134-9e08-88f02ff870f5 for instance with task_state deleting. {{(pid=72418) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 18:38:15 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:38:15 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:38:16 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:38:16 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Instance destroyed successfully.
Aug 09 18:38:16 user nova-compute[72418]: DEBUG nova.objects.instance [None req-6f2db57d-975c-4fbf-a1f5-e7fe46e2e903 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lazy-loading 'resources' on Instance uuid 01c46b33-6788-44a5-a43c-88ee4acc4d39 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:38:16 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-6f2db57d-975c-4fbf-a1f5-e7fe46e2e903 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:21:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1456004149',display_name='tempest-ServerRescueNegativeTestJSON-server-1456004149',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1456004149',id=4,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:23:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5c68622cd79472ba6ad14a6876aeaea',ramdisk_id='',reservation_id='r-jh195jvw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-326572915',owner_user_name='tempest-ServerRescueNegativeTestJSON-326572915-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:23:52Z,user_data=None,user_id='b3c4feb0a14841eeb757a79b6a05d1fa',uuid=01c46b33-6788-44a5-a43c-88ee4acc4d39,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "1487cbc0-54ec-4134-9e08-88f02ff870f5", "address": "fa:16:3e:b3:6b:21", "network": {"id": "15a49d9b-3c0d-449b-9473-29f219960e2c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c68622cd79472ba6ad14a6876aeaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1487cbc0-54", "ovs_interfaceid": "1487cbc0-54ec-4134-9e08-88f02ff870f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 18:38:16 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-6f2db57d-975c-4fbf-a1f5-e7fe46e2e903 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Converting VIF {"id": "1487cbc0-54ec-4134-9e08-88f02ff870f5", "address": "fa:16:3e:b3:6b:21", "network": {"id": "15a49d9b-3c0d-449b-9473-29f219960e2c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c68622cd79472ba6ad14a6876aeaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1487cbc0-54", "ovs_interfaceid": "1487cbc0-54ec-4134-9e08-88f02ff870f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:38:16 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-6f2db57d-975c-4fbf-a1f5-e7fe46e2e903 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:6b:21,bridge_name='br-int',has_traffic_filtering=True,id=1487cbc0-54ec-4134-9e08-88f02ff870f5,network=Network(15a49d9b-3c0d-449b-9473-29f219960e2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1487cbc0-54') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:38:16 user nova-compute[72418]: DEBUG os_vif [None req-6f2db57d-975c-4fbf-a1f5-e7fe46e2e903 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:6b:21,bridge_name='br-int',has_traffic_filtering=True,id=1487cbc0-54ec-4134-9e08-88f02ff870f5,network=Network(15a49d9b-3c0d-449b-9473-29f219960e2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1487cbc0-54') {{(pid=72418) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 18:38:16 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:38:16 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1487cbc0-54, bridge=br-int, if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:38:16 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:38:16 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:38:16 user nova-compute[72418]: INFO os_vif [None req-6f2db57d-975c-4fbf-a1f5-e7fe46e2e903 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:6b:21,bridge_name='br-int',has_traffic_filtering=True,id=1487cbc0-54ec-4134-9e08-88f02ff870f5,network=Network(15a49d9b-3c0d-449b-9473-29f219960e2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1487cbc0-54')
Aug 09 18:38:16 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-6f2db57d-975c-4fbf-a1f5-e7fe46e2e903 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Deleting instance files /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39_del
Aug 09 18:38:16 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-6f2db57d-975c-4fbf-a1f5-e7fe46e2e903 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Deletion of /opt/stack/data/nova/instances/01c46b33-6788-44a5-a43c-88ee4acc4d39_del complete
Aug 09 18:38:16 user nova-compute[72418]: INFO nova.compute.manager [None req-6f2db57d-975c-4fbf-a1f5-e7fe46e2e903 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 09 18:38:16 user nova-compute[72418]: DEBUG oslo.service.loopingcall [None req-6f2db57d-975c-4fbf-a1f5-e7fe46e2e903 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72418) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 18:38:16 user nova-compute[72418]: DEBUG nova.compute.manager [-] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Deallocating network for instance {{(pid=72418) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 18:38:16 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] deallocate_for_instance() {{(pid=72418) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 18:38:16 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:38:16 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Took 0.55 seconds to deallocate network for instance.
Aug 09 18:38:16 user nova-compute[72418]: DEBUG nova.compute.manager [req-e7a5651b-681b-475d-95cd-4458de39c6c2 req-65ce71db-da1a-482a-af5e-1eae288e8a8c service nova] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Received event network-vif-deleted-1487cbc0-54ec-4134-9e08-88f02ff870f5 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:38:17 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-6f2db57d-975c-4fbf-a1f5-e7fe46e2e903 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:38:17 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-6f2db57d-975c-4fbf-a1f5-e7fe46e2e903 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:38:17 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-6f2db57d-975c-4fbf-a1f5-e7fe46e2e903 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:38:17 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-6f2db57d-975c-4fbf-a1f5-e7fe46e2e903 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:38:17 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-6f2db57d-975c-4fbf-a1f5-e7fe46e2e903 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.456s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:38:17 user nova-compute[72418]: INFO nova.scheduler.client.report [None req-6f2db57d-975c-4fbf-a1f5-e7fe46e2e903 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Deleted allocations for instance 01c46b33-6788-44a5-a43c-88ee4acc4d39
Aug 09 18:38:17 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-6f2db57d-975c-4fbf-a1f5-e7fe46e2e903 tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "01c46b33-6788-44a5-a43c-88ee4acc4d39" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.113s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:38:17 user nova-compute[72418]: DEBUG nova.compute.manager [req-c95d0aff-93dc-4bfc-b4fc-9b7a413e0d32 req-4ec5930f-76f2-4fac-9454-7283e26d92b5 service nova] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Received event network-vif-plugged-1487cbc0-54ec-4134-9e08-88f02ff870f5 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:38:17 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-c95d0aff-93dc-4bfc-b4fc-9b7a413e0d32 req-4ec5930f-76f2-4fac-9454-7283e26d92b5 service nova] Acquiring lock "01c46b33-6788-44a5-a43c-88ee4acc4d39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:38:17 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-c95d0aff-93dc-4bfc-b4fc-9b7a413e0d32 req-4ec5930f-76f2-4fac-9454-7283e26d92b5 service nova] Lock "01c46b33-6788-44a5-a43c-88ee4acc4d39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:38:17 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-c95d0aff-93dc-4bfc-b4fc-9b7a413e0d32 req-4ec5930f-76f2-4fac-9454-7283e26d92b5 service nova] Lock "01c46b33-6788-44a5-a43c-88ee4acc4d39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:38:17 user nova-compute[72418]: DEBUG nova.compute.manager [req-c95d0aff-93dc-4bfc-b4fc-9b7a413e0d32 req-4ec5930f-76f2-4fac-9454-7283e26d92b5 service nova] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] No waiting events found dispatching network-vif-plugged-1487cbc0-54ec-4134-9e08-88f02ff870f5 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:38:17 user nova-compute[72418]: WARNING nova.compute.manager [req-c95d0aff-93dc-4bfc-b4fc-9b7a413e0d32 req-4ec5930f-76f2-4fac-9454-7283e26d92b5 service nova] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Received unexpected event network-vif-plugged-1487cbc0-54ec-4134-9e08-88f02ff870f5 for instance with vm_state deleted and task_state None.
Aug 09 18:38:18 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:38:20 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d481680-4e48-4ad6-938c-cb03db2d4e75 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Calling os-brick to attach iSCSI Volume {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 18:38:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d481680-4e48-4ad6-938c-cb03db2d4e75 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:311e1210-fd22-4cc0-bd88-c1d19fc0d8c3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EZBdavuA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:38:20 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-4d481680-4e48-4ad6-938c-cb03db2d4e75 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:38:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-4d481680-4e48-4ad6-938c-cb03db2d4e75 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:38:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-4d481680-4e48-4ad6-938c-cb03db2d4e75 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:38:20 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-4d481680-4e48-4ad6-938c-cb03db2d4e75 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:38:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-4d481680-4e48-4ad6-938c-cb03db2d4e75 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:311e1210-fd22-4cc0-bd88-c1d19fc0d8c3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:38:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-4d481680-4e48-4ad6-938c-cb03db2d4e75 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:311e1210-fd22-4cc0-bd88-c1d19fc0d8c3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:38:20 user nova-compute[72418]: INFO os_brick.initiator.connectors.iscsi [None req-4d481680-4e48-4ad6-938c-cb03db2d4e75 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 18:38:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:311e1210-fd22-4cc0-bd88-c1d19fc0d8c3 -p 172.16.0.220:3260 {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:311e1210-fd22-4cc0-bd88-c1d19fc0d8c3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:20 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbfde6ee-ac09-4d45-85e3-6815b0d3f2be]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:38:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d481680-4e48-4ad6-938c-cb03db2d4e75 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 18:38:20 user nova-compute[72418]:  {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:38:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:311e1210-fd22-4cc0-bd88-c1d19fc0d8c3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:311e1210-fd22-4cc0-bd88-c1d19fc0d8c3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:20 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[7529576e-c394-4fb9-a3d5-681f6932c79d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:311e1210-fd22-4cc0-bd88-c1d19fc0d8c3] added\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:38:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d481680-4e48-4ad6-938c-cb03db2d4e75 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:311e1210-fd22-4cc0-bd88-c1d19fc0d8c3] added
Aug 09 18:38:20 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:38:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:311e1210-fd22-4cc0-bd88-c1d19fc0d8c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:311e1210-fd22-4cc0-bd88-c1d19fc0d8c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:20 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c16398-7f03-43bb-af54-6805b44a6b4a]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:38:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d481680-4e48-4ad6-938c-cb03db2d4e75 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:38:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:311e1210-fd22-4cc0-bd88-c1d19fc0d8c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:311e1210-fd22-4cc0-bd88-c1d19fc0d8c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:20 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d43ec9-206b-4163-a570-857253d4f73c]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:38:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d481680-4e48-4ad6-938c-cb03db2d4e75 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:38:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:311e1210-fd22-4cc0-bd88-c1d19fc0d8c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EZBdavuA {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:311e1210-fd22-4cc0-bd88-c1d19fc0d8c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EZBdavuA" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:20 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[443f9968-48a8-4c0c-8ad3-69e2a7b5f61e]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:38:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d481680-4e48-4ad6-938c-cb03db2d4e75 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EZBdavuA'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:38:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:311e1210-fd22-4cc0-bd88-c1d19fc0d8c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:311e1210-fd22-4cc0-bd88-c1d19fc0d8c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:20 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e85993-ffef-4644-8f3e-0dd10371f139]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:38:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d481680-4e48-4ad6-938c-cb03db2d4e75 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:38:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:21 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:21 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e365050-082a-4fda-b018-f1e40f70ba3b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:38:21 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d481680-4e48-4ad6-938c-cb03db2d4e75 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:38:21 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:38:21 user nova-compute[72418]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:38:21 user nova-compute[72418]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)
Aug 09 18:38:21 user nova-compute[72418]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7 (non-flash)
Aug 09 18:38:21 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:38:21 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d481680-4e48-4ad6-938c-cb03db2d4e75 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:38:21 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:38:21 user nova-compute[72418]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:38:21 user nova-compute[72418]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)
Aug 09 18:38:21 user nova-compute[72418]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7 (non-flash)
Aug 09 18:38:21 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:38:21 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:311e1210-fd22-4cc0-bd88-c1d19fc0d8c3 -p 172.16.0.220:3260 --login {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:21 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:311e1210-fd22-4cc0-bd88-c1d19fc0d8c3 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:21 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[7527a0f2-3132-4af3-a86c-9833b77d8810]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:311e1210-fd22-4cc0-bd88-c1d19fc0d8c3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:311e1210-fd22-4cc0-bd88-c1d19fc0d8c3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:38:21 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d481680-4e48-4ad6-938c-cb03db2d4e75 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:311e1210-fd22-4cc0-bd88-c1d19fc0d8c3, portal: 172.16.0.220,3260]
Aug 09 18:38:21 user nova-compute[72418]: Login to [iface: default, target: iqn.2010-10.org.openstack:311e1210-fd22-4cc0-bd88-c1d19fc0d8c3, portal: 172.16.0.220,3260] successful.
Aug 09 18:38:21 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:38:21 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:311e1210-fd22-4cc0-bd88-c1d19fc0d8c3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:21 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:311e1210-fd22-4cc0-bd88-c1d19fc0d8c3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:21 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[053922d0-49f5-4bab-a546-1800a1c2caa7]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:38:21 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d481680-4e48-4ad6-938c-cb03db2d4e75 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:38:21 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:21 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:21 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fe564b-8f6a-4408-9a93-6796bab77428]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311e1210-fd22-4cc0-bd88-c1d19fc0d8c3 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:38:21 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d481680-4e48-4ad6-938c-cb03db2d4e75 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:38:21 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:38:21 user nova-compute[72418]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:38:21 user nova-compute[72418]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)
Aug 09 18:38:21 user nova-compute[72418]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7 (non-flash)
Aug 09 18:38:21 user nova-compute[72418]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311e1210-fd22-4cc0-bd88-c1d19fc0d8c3 (non-flash)
Aug 09 18:38:21 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:38:21 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d481680-4e48-4ad6-938c-cb03db2d4e75 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:38:21 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:38:21 user nova-compute[72418]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:38:21 user nova-compute[72418]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)
Aug 09 18:38:21 user nova-compute[72418]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7 (non-flash)
Aug 09 18:38:21 user nova-compute[72418]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311e1210-fd22-4cc0-bd88-c1d19fc0d8c3 (non-flash)
Aug 09 18:38:21 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:38:21 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-4d481680-4e48-4ad6-938c-cb03db2d4e75 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:311e1210-fd22-4cc0-bd88-c1d19fc0d8c3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:38:21 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d481680-4e48-4ad6-938c-cb03db2d4e75 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Connected to 172.16.0.220:3260 {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 18:38:21 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-4d481680-4e48-4ad6-938c-cb03db2d4e75 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] HCTL ('37', '-', '-', 0) found on session 38 with lun 0 {{(pid=72418) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 18:38:21 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-4d481680-4e48-4ad6-938c-cb03db2d4e75 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72418) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 18:38:21 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:21 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.033s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:21 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f8f389-a727-41e1-8832-de757f063733]: (4, ('- - 0', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:38:21 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-4d481680-4e48-4ad6-938c-cb03db2d4e75 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Searching for a device in session 38 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72418) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 18:38:21 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d481680-4e48-4ad6-938c-cb03db2d4e75 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EZBdavuA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 18:38:21 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:38:22 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-4d481680-4e48-4ad6-938c-cb03db2d4e75 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:38:22 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d481680-4e48-4ad6-938c-cb03db2d4e75 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23639386136376635', 'path': '/dev/sdf'} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:38:22 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d481680-4e48-4ad6-938c-cb03db2d4e75 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639386136376635', 'path': '/dev/sdf'} {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 18:38:22 user nova-compute[72418]: DEBUG nova.objects.instance [None req-4d481680-4e48-4ad6-938c-cb03db2d4e75 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lazy-loading 'flavor' on Instance uuid 97f49889-df0b-48c1-97ce-5c331b6a65ce {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:38:22 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-4d481680-4e48-4ad6-938c-cb03db2d4e75 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 18:38:22 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:38:22 user nova-compute[72418]:   <source dev="/dev/sdf"/>
Aug 09 18:38:22 user nova-compute[72418]:   <target dev="vdc" bus="virtio"/>
Aug 09 18:38:22 user nova-compute[72418]:   <serial>311e1210-fd22-4cc0-bd88-c1d19fc0d8c3</serial>
Aug 09 18:38:22 user nova-compute[72418]: </disk>
Aug 09 18:38:22 user nova-compute[72418]:  {{(pid=72418) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 18:38:22 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-4d481680-4e48-4ad6-938c-cb03db2d4e75 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:38:22 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-4d481680-4e48-4ad6-938c-cb03db2d4e75 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:38:22 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-4d481680-4e48-4ad6-938c-cb03db2d4e75 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:38:22 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-4d481680-4e48-4ad6-938c-cb03db2d4e75 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] No VIF found with MAC fa:16:3e:4c:1c:62, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:38:22 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-4d481680-4e48-4ad6-938c-cb03db2d4e75 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "97f49889-df0b-48c1-97ce-5c331b6a65ce" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.494s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:38:23 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:38:24 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-fe270c4b-329f-4bd3-8966-7aee1abc99bc tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Acquiring lock "97f49889-df0b-48c1-97ce-5c331b6a65ce" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:38:24 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-fe270c4b-329f-4bd3-8966-7aee1abc99bc tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "97f49889-df0b-48c1-97ce-5c331b6a65ce" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:38:24 user nova-compute[72418]: INFO nova.compute.manager [None req-fe270c4b-329f-4bd3-8966-7aee1abc99bc tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Detaching volume cceb9c76-2bd3-461d-ac8b-41b4350b9fa7
Aug 09 18:38:24 user nova-compute[72418]: INFO nova.virt.block_device [None req-fe270c4b-329f-4bd3-8966-7aee1abc99bc tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Attempting to driver detach volume cceb9c76-2bd3-461d-ac8b-41b4350b9fa7 from mountpoint /dev/vdb
Aug 09 18:38:24 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-fe270c4b-329f-4bd3-8966-7aee1abc99bc tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Attempting to detach device vdb from instance 97f49889-df0b-48c1-97ce-5c331b6a65ce from the persistent domain config. {{(pid=72418) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 18:38:24 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-fe270c4b-329f-4bd3-8966-7aee1abc99bc tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 18:38:24 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:38:24 user nova-compute[72418]:   <source dev="/dev/sde"/>
Aug 09 18:38:24 user nova-compute[72418]:   <target dev="vdb" bus="virtio"/>
Aug 09 18:38:24 user nova-compute[72418]:   <serial>cceb9c76-2bd3-461d-ac8b-41b4350b9fa7</serial>
Aug 09 18:38:24 user nova-compute[72418]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 18:38:24 user nova-compute[72418]: </disk>
Aug 09 18:38:24 user nova-compute[72418]:  {{(pid=72418) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 18:38:24 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-fe270c4b-329f-4bd3-8966-7aee1abc99bc tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Successfully detached device vdb from instance 97f49889-df0b-48c1-97ce-5c331b6a65ce from the persistent domain config.
Aug 09 18:38:24 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-fe270c4b-329f-4bd3-8966-7aee1abc99bc tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 97f49889-df0b-48c1-97ce-5c331b6a65ce from the live domain config. {{(pid=72418) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 18:38:24 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-fe270c4b-329f-4bd3-8966-7aee1abc99bc tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 18:38:24 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:38:24 user nova-compute[72418]:   <source dev="/dev/sde"/>
Aug 09 18:38:24 user nova-compute[72418]:   <target dev="vdb" bus="virtio"/>
Aug 09 18:38:24 user nova-compute[72418]:   <serial>cceb9c76-2bd3-461d-ac8b-41b4350b9fa7</serial>
Aug 09 18:38:24 user nova-compute[72418]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 18:38:24 user nova-compute[72418]: </disk>
Aug 09 18:38:24 user nova-compute[72418]:  {{(pid=72418) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 18:38:24 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Received event <DeviceRemovedEvent: 1691606304.7019577, 97f49889-df0b-48c1-97ce-5c331b6a65ce => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72418) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 18:38:24 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-fe270c4b-329f-4bd3-8966-7aee1abc99bc tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 97f49889-df0b-48c1-97ce-5c331b6a65ce {{(pid=72418) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 18:38:24 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-fe270c4b-329f-4bd3-8966-7aee1abc99bc tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Successfully detached device vdb from instance 97f49889-df0b-48c1-97ce-5c331b6a65ce from the live domain config.
Aug 09 18:38:24 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe270c4b-329f-4bd3-8966-7aee1abc99bc tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] calling os-brick to detach iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 18:38:24 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe270c4b-329f-4bd3-8966-7aee1abc99bc tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, {'target_iqns': ['iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dpYONgIP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:38:24 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-fe270c4b-329f-4bd3-8966-7aee1abc99bc tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:38:24 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-fe270c4b-329f-4bd3-8966-7aee1abc99bc tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:38:24 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-fe270c4b-329f-4bd3-8966-7aee1abc99bc tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:38:24 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe270c4b-329f-4bd3-8966-7aee1abc99bc tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7', 0)] {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 18:38:24 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:24 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:24 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a5eabc-c88d-462d-8bbb-6bdd18a79baf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:311e1210-fd22-4cc0-bd88-c1d19fc0d8c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:38:24 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:24 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:24 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a402883-9f19-4bbc-b5c8-0b03f8ba067c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311e1210-fd22-4cc0-bd88-c1d19fc0d8c3 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:38:24 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe270c4b-329f-4bd3-8966-7aee1abc99bc tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:38:24 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:38:24 user nova-compute[72418]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:38:24 user nova-compute[72418]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)
Aug 09 18:38:24 user nova-compute[72418]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7 (non-flash)
Aug 09 18:38:24 user nova-compute[72418]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311e1210-fd22-4cc0-bd88-c1d19fc0d8c3 (non-flash)
Aug 09 18:38:24 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:38:24 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe270c4b-329f-4bd3-8966-7aee1abc99bc tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:38:24 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:38:24 user nova-compute[72418]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:38:24 user nova-compute[72418]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)
Aug 09 18:38:24 user nova-compute[72418]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7 (non-flash)
Aug 09 18:38:24 user nova-compute[72418]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311e1210-fd22-4cc0-bd88-c1d19fc0d8c3 (non-flash)
Aug 09 18:38:24 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:38:24 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe270c4b-329f-4bd3-8966-7aee1abc99bc tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f42d4689630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7'): ({'sde'}, set())}) {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 18:38:24 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-fe270c4b-329f-4bd3-8966-7aee1abc99bc tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Removing single pathed devices sde {{(pid=72418) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 18:38:24 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:24 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:24 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d7a6d2-f559-4117-a22f-8fd63a1916d1]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:38:24 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:24 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:24 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[afdd1450-3f47-4456-93d4-5cbfee9e89c4]: (4, ('ok\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:38:24 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-fe270c4b-329f-4bd3-8966-7aee1abc99bc tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Flushing IO for device /dev/sde {{(pid=72418) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 18:38:24 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:24 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:24 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c0bb62-0aa3-4876-b3f3-6b579d60f43d]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:38:24 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-fe270c4b-329f-4bd3-8966-7aee1abc99bc tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72418) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 18:38:24 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:24 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:24 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe675d6-a3f3-491a-bad0-7dbbc5015a48]: (4, ('1', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:38:24 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-fe270c4b-329f-4bd3-8966-7aee1abc99bc tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 18:38:24 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-fe270c4b-329f-4bd3-8966-7aee1abc99bc tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] SCSI volumes sde have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 18:38:24 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe270c4b-329f-4bd3-8966-7aee1abc99bc tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7')] {{(pid=72418) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 18:38:24 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:24 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:24 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5025a7-7c9b-4374-8203-dd579585bf99]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:38:24 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe270c4b-329f-4bd3-8966-7aee1abc99bc tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:38:24 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7 -p 172.16.0.220:3260 --logout {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:24 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:24 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ba208a-4105-4cee-ab68-4ed69c727860]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:38:24 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe270c4b-329f-4bd3-8966-7aee1abc99bc tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7, portal: 172.16.0.220,3260]
Aug 09 18:38:24 user nova-compute[72418]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7, portal: 172.16.0.220,3260] successful.
Aug 09 18:38:24 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:38:24 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7 -p 172.16.0.220:3260 --op delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:25 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cceb9c76-2bd3-461d-ac8b-41b4350b9fa7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:25 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b7b75c-137e-485a-a19a-98d0fa2a5b3f]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:38:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe270c4b-329f-4bd3-8966-7aee1abc99bc tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:38:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-fe270c4b-329f-4bd3-8966-7aee1abc99bc tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:38:25 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe270c4b-329f-4bd3-8966-7aee1abc99bc tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] <== disconnect_volume: return (295ms) None {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:38:25 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe270c4b-329f-4bd3-8966-7aee1abc99bc tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Disconnected iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 18:38:25 user nova-compute[72418]: DEBUG nova.objects.instance [None req-fe270c4b-329f-4bd3-8966-7aee1abc99bc tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lazy-loading 'flavor' on Instance uuid 97f49889-df0b-48c1-97ce-5c331b6a65ce {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:38:25 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-fe270c4b-329f-4bd3-8966-7aee1abc99bc tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "97f49889-df0b-48c1-97ce-5c331b6a65ce" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.688s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:38:26 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:38:26 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d2173bb8-8239-490d-8b3f-c85d815a9883 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Acquiring lock "97f49889-df0b-48c1-97ce-5c331b6a65ce" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:38:26 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d2173bb8-8239-490d-8b3f-c85d815a9883 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "97f49889-df0b-48c1-97ce-5c331b6a65ce" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:38:26 user nova-compute[72418]: INFO nova.compute.manager [None req-d2173bb8-8239-490d-8b3f-c85d815a9883 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Detaching volume 311e1210-fd22-4cc0-bd88-c1d19fc0d8c3
Aug 09 18:38:26 user nova-compute[72418]: INFO nova.virt.block_device [None req-d2173bb8-8239-490d-8b3f-c85d815a9883 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Attempting to driver detach volume 311e1210-fd22-4cc0-bd88-c1d19fc0d8c3 from mountpoint /dev/vdc
Aug 09 18:38:26 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-d2173bb8-8239-490d-8b3f-c85d815a9883 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Attempting to detach device vdc from instance 97f49889-df0b-48c1-97ce-5c331b6a65ce from the persistent domain config. {{(pid=72418) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 18:38:26 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-d2173bb8-8239-490d-8b3f-c85d815a9883 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 18:38:26 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:38:26 user nova-compute[72418]:   <source dev="/dev/sdf"/>
Aug 09 18:38:26 user nova-compute[72418]:   <target dev="vdc" bus="virtio"/>
Aug 09 18:38:26 user nova-compute[72418]:   <serial>311e1210-fd22-4cc0-bd88-c1d19fc0d8c3</serial>
Aug 09 18:38:26 user nova-compute[72418]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 09 18:38:26 user nova-compute[72418]: </disk>
Aug 09 18:38:26 user nova-compute[72418]:  {{(pid=72418) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 18:38:26 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-d2173bb8-8239-490d-8b3f-c85d815a9883 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Successfully detached device vdc from instance 97f49889-df0b-48c1-97ce-5c331b6a65ce from the persistent domain config.
Aug 09 18:38:26 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-d2173bb8-8239-490d-8b3f-c85d815a9883 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 97f49889-df0b-48c1-97ce-5c331b6a65ce from the live domain config. {{(pid=72418) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 18:38:26 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-d2173bb8-8239-490d-8b3f-c85d815a9883 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 18:38:26 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:38:26 user nova-compute[72418]:   <source dev="/dev/sdf"/>
Aug 09 18:38:26 user nova-compute[72418]:   <target dev="vdc" bus="virtio"/>
Aug 09 18:38:26 user nova-compute[72418]:   <serial>311e1210-fd22-4cc0-bd88-c1d19fc0d8c3</serial>
Aug 09 18:38:26 user nova-compute[72418]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 09 18:38:26 user nova-compute[72418]: </disk>
Aug 09 18:38:26 user nova-compute[72418]:  {{(pid=72418) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 18:38:27 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Received event <DeviceRemovedEvent: 1691606307.1328707, 97f49889-df0b-48c1-97ce-5c331b6a65ce => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72418) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 18:38:27 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-d2173bb8-8239-490d-8b3f-c85d815a9883 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 97f49889-df0b-48c1-97ce-5c331b6a65ce {{(pid=72418) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 18:38:27 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-d2173bb8-8239-490d-8b3f-c85d815a9883 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Successfully detached device vdc from instance 97f49889-df0b-48c1-97ce-5c331b6a65ce from the live domain config.
Aug 09 18:38:27 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2173bb8-8239-490d-8b3f-c85d815a9883 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] calling os-brick to detach iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 18:38:27 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2173bb8-8239-490d-8b3f-c85d815a9883 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, {'target_iqns': ['iqn.2010-10.org.openstack:311e1210-fd22-4cc0-bd88-c1d19fc0d8c3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EZBdavuA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:38:27 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-d2173bb8-8239-490d-8b3f-c85d815a9883 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:38:27 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-d2173bb8-8239-490d-8b3f-c85d815a9883 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:38:27 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-d2173bb8-8239-490d-8b3f-c85d815a9883 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:38:27 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2173bb8-8239-490d-8b3f-c85d815a9883 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:311e1210-fd22-4cc0-bd88-c1d19fc0d8c3', 0)] {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 18:38:27 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:27 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:27 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[1846cabc-fce3-4f14-904c-0936c7254b59]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:311e1210-fd22-4cc0-bd88-c1d19fc0d8c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:38:27 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:27 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:27 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a1c7d7-f570-48f5-a076-72d9123ed1de]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311e1210-fd22-4cc0-bd88-c1d19fc0d8c3 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:38:27 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2173bb8-8239-490d-8b3f-c85d815a9883 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:38:27 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:38:27 user nova-compute[72418]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:38:27 user nova-compute[72418]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)
Aug 09 18:38:27 user nova-compute[72418]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311e1210-fd22-4cc0-bd88-c1d19fc0d8c3 (non-flash)
Aug 09 18:38:27 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:38:27 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2173bb8-8239-490d-8b3f-c85d815a9883 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:38:27 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:38:27 user nova-compute[72418]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:38:27 user nova-compute[72418]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)
Aug 09 18:38:27 user nova-compute[72418]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311e1210-fd22-4cc0-bd88-c1d19fc0d8c3 (non-flash)
Aug 09 18:38:27 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:38:27 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2173bb8-8239-490d-8b3f-c85d815a9883 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f42d4689120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:311e1210-fd22-4cc0-bd88-c1d19fc0d8c3'): ({'sdf'}, set())}) {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 18:38:27 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-d2173bb8-8239-490d-8b3f-c85d815a9883 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Removing single pathed devices sdf {{(pid=72418) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 18:38:27 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:27 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:27 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed2f351-eac6-4635-8f2b-4530bc36b32b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:38:27 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:27 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:27 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0fe6dfd-7f29-4e7a-a3e3-1ac373ab753c]: (4, ('ok\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:38:27 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-d2173bb8-8239-490d-8b3f-c85d815a9883 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Flushing IO for device /dev/sdf {{(pid=72418) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 18:38:27 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:27 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:27 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed84c65f-3f10-4d4c-a3fd-9a2e47447499]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:38:27 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-d2173bb8-8239-490d-8b3f-c85d815a9883 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72418) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 18:38:27 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:27 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.049s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:27 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bacccf7-2d1b-44cf-8630-0764985f0fea]: (4, ('1', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:38:27 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-d2173bb8-8239-490d-8b3f-c85d815a9883 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 18:38:27 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-d2173bb8-8239-490d-8b3f-c85d815a9883 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] SCSI volumes sdf have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 18:38:27 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2173bb8-8239-490d-8b3f-c85d815a9883 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:311e1210-fd22-4cc0-bd88-c1d19fc0d8c3')] {{(pid=72418) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 18:38:27 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:311e1210-fd22-4cc0-bd88-c1d19fc0d8c3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:27 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:311e1210-fd22-4cc0-bd88-c1d19fc0d8c3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:27 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b94e7e-303d-43a0-b43d-d74f8d60765a]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:38:27 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2173bb8-8239-490d-8b3f-c85d815a9883 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:38:27 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:311e1210-fd22-4cc0-bd88-c1d19fc0d8c3 -p 172.16.0.220:3260 --logout {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:27 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:311e1210-fd22-4cc0-bd88-c1d19fc0d8c3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:27 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ed9155-6c2c-4e95-a6f3-f6491d3e0793]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:311e1210-fd22-4cc0-bd88-c1d19fc0d8c3, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:311e1210-fd22-4cc0-bd88-c1d19fc0d8c3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:38:27 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2173bb8-8239-490d-8b3f-c85d815a9883 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:311e1210-fd22-4cc0-bd88-c1d19fc0d8c3, portal: 172.16.0.220,3260]
Aug 09 18:38:27 user nova-compute[72418]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:311e1210-fd22-4cc0-bd88-c1d19fc0d8c3, portal: 172.16.0.220,3260] successful.
Aug 09 18:38:27 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:38:27 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:311e1210-fd22-4cc0-bd88-c1d19fc0d8c3 -p 172.16.0.220:3260 --op delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:27 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:311e1210-fd22-4cc0-bd88-c1d19fc0d8c3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:27 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c314af4-6dd6-4f33-85dd-2913cb007052]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:38:27 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2173bb8-8239-490d-8b3f-c85d815a9883 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:38:27 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-d2173bb8-8239-490d-8b3f-c85d815a9883 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:38:27 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2173bb8-8239-490d-8b3f-c85d815a9883 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] <== disconnect_volume: return (296ms) None {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:38:27 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2173bb8-8239-490d-8b3f-c85d815a9883 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Disconnected iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 18:38:28 user nova-compute[72418]: DEBUG nova.objects.instance [None req-d2173bb8-8239-490d-8b3f-c85d815a9883 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lazy-loading 'flavor' on Instance uuid 97f49889-df0b-48c1-97ce-5c331b6a65ce {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:38:28 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d2173bb8-8239-490d-8b3f-c85d815a9883 tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "97f49889-df0b-48c1-97ce-5c331b6a65ce" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.619s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:38:28 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:38:29 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-6b3d4c88-6f8d-4d62-b99a-fdabce29947c tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Acquiring lock "97f49889-df0b-48c1-97ce-5c331b6a65ce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:38:29 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-6b3d4c88-6f8d-4d62-b99a-fdabce29947c tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "97f49889-df0b-48c1-97ce-5c331b6a65ce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:38:29 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-6b3d4c88-6f8d-4d62-b99a-fdabce29947c tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Acquiring lock "97f49889-df0b-48c1-97ce-5c331b6a65ce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:38:29 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-6b3d4c88-6f8d-4d62-b99a-fdabce29947c tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "97f49889-df0b-48c1-97ce-5c331b6a65ce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:38:29 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-6b3d4c88-6f8d-4d62-b99a-fdabce29947c tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "97f49889-df0b-48c1-97ce-5c331b6a65ce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:38:29 user nova-compute[72418]: INFO nova.compute.manager [None req-6b3d4c88-6f8d-4d62-b99a-fdabce29947c tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Terminating instance
Aug 09 18:38:29 user nova-compute[72418]: DEBUG nova.compute.manager [None req-6b3d4c88-6f8d-4d62-b99a-fdabce29947c tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Start destroying the instance on the hypervisor. {{(pid=72418) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 18:38:29 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:38:29 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:38:29 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:38:29 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:38:29 user nova-compute[72418]: DEBUG nova.compute.manager [req-1a41ed5d-550b-40c8-b724-5e69dc7ef171 req-9a0157c1-ebd9-4fa9-a4aa-410af03cd75b service nova] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Received event network-vif-unplugged-07c05457-6d05-4961-9642-02b3db4901c4 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:38:29 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-1a41ed5d-550b-40c8-b724-5e69dc7ef171 req-9a0157c1-ebd9-4fa9-a4aa-410af03cd75b service nova] Acquiring lock "97f49889-df0b-48c1-97ce-5c331b6a65ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:38:29 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-1a41ed5d-550b-40c8-b724-5e69dc7ef171 req-9a0157c1-ebd9-4fa9-a4aa-410af03cd75b service nova] Lock "97f49889-df0b-48c1-97ce-5c331b6a65ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:38:29 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-1a41ed5d-550b-40c8-b724-5e69dc7ef171 req-9a0157c1-ebd9-4fa9-a4aa-410af03cd75b service nova] Lock "97f49889-df0b-48c1-97ce-5c331b6a65ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:38:29 user nova-compute[72418]: DEBUG nova.compute.manager [req-1a41ed5d-550b-40c8-b724-5e69dc7ef171 req-9a0157c1-ebd9-4fa9-a4aa-410af03cd75b service nova] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] No waiting events found dispatching network-vif-unplugged-07c05457-6d05-4961-9642-02b3db4901c4 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:38:29 user nova-compute[72418]: DEBUG nova.compute.manager [req-1a41ed5d-550b-40c8-b724-5e69dc7ef171 req-9a0157c1-ebd9-4fa9-a4aa-410af03cd75b service nova] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Received event network-vif-unplugged-07c05457-6d05-4961-9642-02b3db4901c4 for instance with task_state deleting. {{(pid=72418) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 18:38:29 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Instance destroyed successfully.
Aug 09 18:38:29 user nova-compute[72418]: DEBUG nova.objects.instance [None req-6b3d4c88-6f8d-4d62-b99a-fdabce29947c tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lazy-loading 'resources' on Instance uuid 97f49889-df0b-48c1-97ce-5c331b6a65ce {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:38:29 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-6b3d4c88-6f8d-4d62-b99a-fdabce29947c tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:35:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-25939957',display_name='tempest-AttachVolumeTestJSON-server-25939957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-25939957',id=30,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAmy2QDCRjOg3oBY/Nf3FiX2HYTtdLvJkmnrKflpbuqVI2A7KTCLJCCiM2G7hBQoHuAN1kX7YgQCgbSbufrN4ld9s5IJ+ac8+tDzrQeZN/DcFEpF8Ng87foE92lpsE/bMQ==',key_name='tempest-keypair-936032845',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:36:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5242fb37f9664dbf9a8b50449f8dd129',ramdisk_id='',reservation_id='r-wh0ygz73',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1480837700',owner_user_name='tempest-AttachVolumeTestJSON-1480837700-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:36:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='236307357ebf43bc8150f86f832260ba',uuid=97f49889-df0b-48c1-97ce-5c331b6a65ce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "07c05457-6d05-4961-9642-02b3db4901c4", "address": "fa:16:3e:4c:1c:62", "network": {"id": "7621f03d-76ac-49da-89a8-0753bb11e329", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596253708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5242fb37f9664dbf9a8b50449f8dd129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07c05457-6d", "ovs_interfaceid": "07c05457-6d05-4961-9642-02b3db4901c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 18:38:30 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-6b3d4c88-6f8d-4d62-b99a-fdabce29947c tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Converting VIF {"id": "07c05457-6d05-4961-9642-02b3db4901c4", "address": "fa:16:3e:4c:1c:62", "network": {"id": "7621f03d-76ac-49da-89a8-0753bb11e329", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-596253708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5242fb37f9664dbf9a8b50449f8dd129", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07c05457-6d", "ovs_interfaceid": "07c05457-6d05-4961-9642-02b3db4901c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:38:30 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-6b3d4c88-6f8d-4d62-b99a-fdabce29947c tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4c:1c:62,bridge_name='br-int',has_traffic_filtering=True,id=07c05457-6d05-4961-9642-02b3db4901c4,network=Network(7621f03d-76ac-49da-89a8-0753bb11e329),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07c05457-6d') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:38:30 user nova-compute[72418]: DEBUG os_vif [None req-6b3d4c88-6f8d-4d62-b99a-fdabce29947c tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:1c:62,bridge_name='br-int',has_traffic_filtering=True,id=07c05457-6d05-4961-9642-02b3db4901c4,network=Network(7621f03d-76ac-49da-89a8-0753bb11e329),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07c05457-6d') {{(pid=72418) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 18:38:30 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:38:30 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap07c05457-6d, bridge=br-int, if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:38:30 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:38:30 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:38:30 user nova-compute[72418]: INFO os_vif [None req-6b3d4c88-6f8d-4d62-b99a-fdabce29947c tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:1c:62,bridge_name='br-int',has_traffic_filtering=True,id=07c05457-6d05-4961-9642-02b3db4901c4,network=Network(7621f03d-76ac-49da-89a8-0753bb11e329),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07c05457-6d')
Aug 09 18:38:30 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-6b3d4c88-6f8d-4d62-b99a-fdabce29947c tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Deleting instance files /opt/stack/data/nova/instances/97f49889-df0b-48c1-97ce-5c331b6a65ce_del
Aug 09 18:38:30 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-6b3d4c88-6f8d-4d62-b99a-fdabce29947c tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Deletion of /opt/stack/data/nova/instances/97f49889-df0b-48c1-97ce-5c331b6a65ce_del complete
Aug 09 18:38:30 user nova-compute[72418]: INFO nova.compute.manager [None req-6b3d4c88-6f8d-4d62-b99a-fdabce29947c tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 09 18:38:30 user nova-compute[72418]: DEBUG oslo.service.loopingcall [None req-6b3d4c88-6f8d-4d62-b99a-fdabce29947c tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72418) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 18:38:30 user nova-compute[72418]: DEBUG nova.compute.manager [-] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Deallocating network for instance {{(pid=72418) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 18:38:30 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] deallocate_for_instance() {{(pid=72418) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 18:38:31 user nova-compute[72418]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691606296.2717578, 01c46b33-6788-44a5-a43c-88ee4acc4d39 => Stopped> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:38:31 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] VM Stopped (Lifecycle Event)
Aug 09 18:38:31 user nova-compute[72418]: DEBUG nova.compute.manager [None req-351d6162-b1f5-4fc8-9eb5-905d46267af5 None None] [instance: 01c46b33-6788-44a5-a43c-88ee4acc4d39] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:38:31 user nova-compute[72418]: DEBUG nova.compute.manager [req-3f899070-a886-4ddf-9ec3-64e326a458b4 req-d58ca05d-61c8-464a-84a7-d4fb48f3e72a service nova] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Received event network-vif-plugged-07c05457-6d05-4961-9642-02b3db4901c4 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:38:31 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-3f899070-a886-4ddf-9ec3-64e326a458b4 req-d58ca05d-61c8-464a-84a7-d4fb48f3e72a service nova] Acquiring lock "97f49889-df0b-48c1-97ce-5c331b6a65ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:38:31 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-3f899070-a886-4ddf-9ec3-64e326a458b4 req-d58ca05d-61c8-464a-84a7-d4fb48f3e72a service nova] Lock "97f49889-df0b-48c1-97ce-5c331b6a65ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:38:31 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-3f899070-a886-4ddf-9ec3-64e326a458b4 req-d58ca05d-61c8-464a-84a7-d4fb48f3e72a service nova] Lock "97f49889-df0b-48c1-97ce-5c331b6a65ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:38:31 user nova-compute[72418]: DEBUG nova.compute.manager [req-3f899070-a886-4ddf-9ec3-64e326a458b4 req-d58ca05d-61c8-464a-84a7-d4fb48f3e72a service nova] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] No waiting events found dispatching network-vif-plugged-07c05457-6d05-4961-9642-02b3db4901c4 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:38:31 user nova-compute[72418]: WARNING nova.compute.manager [req-3f899070-a886-4ddf-9ec3-64e326a458b4 req-d58ca05d-61c8-464a-84a7-d4fb48f3e72a service nova] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Received unexpected event network-vif-plugged-07c05457-6d05-4961-9642-02b3db4901c4 for instance with vm_state active and task_state deleting.
Aug 09 18:38:32 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:38:32 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:38:32 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Took 2.14 seconds to deallocate network for instance.
Aug 09 18:38:32 user nova-compute[72418]: DEBUG nova.compute.manager [req-6345a284-4fc3-4c00-a677-4a677b7ce8c8 req-9969b582-67f6-4e55-80ca-cf8268fc6eaf service nova] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Received event network-vif-deleted-07c05457-6d05-4961-9642-02b3db4901c4 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:38:32 user nova-compute[72418]: INFO nova.compute.manager [req-6345a284-4fc3-4c00-a677-4a677b7ce8c8 req-9969b582-67f6-4e55-80ca-cf8268fc6eaf service nova] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Neutron deleted interface 07c05457-6d05-4961-9642-02b3db4901c4; detaching it from the instance and deleting it from the info cache
Aug 09 18:38:32 user nova-compute[72418]: DEBUG nova.network.neutron [req-6345a284-4fc3-4c00-a677-4a677b7ce8c8 req-9969b582-67f6-4e55-80ca-cf8268fc6eaf service nova] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:38:32 user nova-compute[72418]: DEBUG nova.compute.manager [req-6345a284-4fc3-4c00-a677-4a677b7ce8c8 req-9969b582-67f6-4e55-80ca-cf8268fc6eaf service nova] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Detach interface failed, port_id=07c05457-6d05-4961-9642-02b3db4901c4, reason: Instance 97f49889-df0b-48c1-97ce-5c331b6a65ce could not be found. {{(pid=72418) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 18:38:32 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-6b3d4c88-6f8d-4d62-b99a-fdabce29947c tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:38:32 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-6b3d4c88-6f8d-4d62-b99a-fdabce29947c tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:38:32 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-6b3d4c88-6f8d-4d62-b99a-fdabce29947c tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:38:32 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-6b3d4c88-6f8d-4d62-b99a-fdabce29947c tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:38:32 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-6b3d4c88-6f8d-4d62-b99a-fdabce29947c tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.410s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:38:32 user nova-compute[72418]: INFO nova.scheduler.client.report [None req-6b3d4c88-6f8d-4d62-b99a-fdabce29947c tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Deleted allocations for instance 97f49889-df0b-48c1-97ce-5c331b6a65ce
Aug 09 18:38:32 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-6b3d4c88-6f8d-4d62-b99a-fdabce29947c tempest-AttachVolumeTestJSON-1480837700 tempest-AttachVolumeTestJSON-1480837700-project-member] Lock "97f49889-df0b-48c1-97ce-5c331b6a65ce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.568s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:38:33 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:38:35 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:38:40 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:38:40 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:38:40 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72418) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 18:38:40 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72418) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 18:38:40 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72418) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 18:38:40 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:38:44 user nova-compute[72418]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691606309.9802105, 97f49889-df0b-48c1-97ce-5c331b6a65ce => Stopped> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:38:44 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] VM Stopped (Lifecycle Event)
Aug 09 18:38:45 user nova-compute[72418]: DEBUG nova.compute.manager [None req-4ea23437-9b6e-4385-a781-bd7aca2cda24 None None] [instance: 97f49889-df0b-48c1-97ce-5c331b6a65ce] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:38:45 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:38:50 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:38:50 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:38:50 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72418) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 18:38:50 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72418) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 18:38:50 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72418) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 18:38:50 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:38:50 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-02df2fb7-f5ba-4c37-a206-2d4e2f74e475 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Acquiring lock "03ad5bab-ab32-47fc-b7e8-b32282b9c20d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:38:50 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-02df2fb7-f5ba-4c37-a206-2d4e2f74e475 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lock "03ad5bab-ab32-47fc-b7e8-b32282b9c20d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:38:50 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-02df2fb7-f5ba-4c37-a206-2d4e2f74e475 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Acquiring lock "03ad5bab-ab32-47fc-b7e8-b32282b9c20d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:38:50 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-02df2fb7-f5ba-4c37-a206-2d4e2f74e475 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lock "03ad5bab-ab32-47fc-b7e8-b32282b9c20d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:38:50 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-02df2fb7-f5ba-4c37-a206-2d4e2f74e475 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lock "03ad5bab-ab32-47fc-b7e8-b32282b9c20d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:38:50 user nova-compute[72418]: INFO nova.compute.manager [None req-02df2fb7-f5ba-4c37-a206-2d4e2f74e475 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Terminating instance
Aug 09 18:38:50 user nova-compute[72418]: DEBUG nova.compute.manager [None req-02df2fb7-f5ba-4c37-a206-2d4e2f74e475 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Start destroying the instance on the hypervisor. {{(pid=72418) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 18:38:50 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:38:50 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:38:50 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:38:50 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:38:50 user nova-compute[72418]: DEBUG nova.compute.manager [req-b268996e-c0e1-4237-986e-7b69c0e07700 req-47e95f57-10b6-407a-9843-b0ab7c7094ad service nova] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Received event network-vif-unplugged-ea92909f-40d7-48a8-be09-50439674945c {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:38:50 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-b268996e-c0e1-4237-986e-7b69c0e07700 req-47e95f57-10b6-407a-9843-b0ab7c7094ad service nova] Acquiring lock "03ad5bab-ab32-47fc-b7e8-b32282b9c20d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:38:50 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-b268996e-c0e1-4237-986e-7b69c0e07700 req-47e95f57-10b6-407a-9843-b0ab7c7094ad service nova] Lock "03ad5bab-ab32-47fc-b7e8-b32282b9c20d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:38:50 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-b268996e-c0e1-4237-986e-7b69c0e07700 req-47e95f57-10b6-407a-9843-b0ab7c7094ad service nova] Lock "03ad5bab-ab32-47fc-b7e8-b32282b9c20d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:38:50 user nova-compute[72418]: DEBUG nova.compute.manager [req-b268996e-c0e1-4237-986e-7b69c0e07700 req-47e95f57-10b6-407a-9843-b0ab7c7094ad service nova] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] No waiting events found dispatching network-vif-unplugged-ea92909f-40d7-48a8-be09-50439674945c {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:38:50 user nova-compute[72418]: DEBUG nova.compute.manager [req-b268996e-c0e1-4237-986e-7b69c0e07700 req-47e95f57-10b6-407a-9843-b0ab7c7094ad service nova] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Received event network-vif-unplugged-ea92909f-40d7-48a8-be09-50439674945c for instance with task_state deleting. {{(pid=72418) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 18:38:51 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Instance destroyed successfully.
Aug 09 18:38:51 user nova-compute[72418]: DEBUG nova.objects.instance [None req-02df2fb7-f5ba-4c37-a206-2d4e2f74e475 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lazy-loading 'resources' on Instance uuid 03ad5bab-ab32-47fc-b7e8-b32282b9c20d {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:38:51 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-02df2fb7-f5ba-4c37-a206-2d4e2f74e475 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:30:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1873430052',display_name='tempest-ServerActionsTestOtherB-server-1873430052',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1873430052',id=22,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIcobG4HnuTYOQnNQv/MwdYT3LE/RLnOlgxtm9ZW7mVchwGrvFEE/XUOIJNiUK2ZNsyoG2e4ALumseJiS6y2HeRcRosbaQtxOHGtF7A55P++8WqVj1ISNQq63FhVymDdqQ==',key_name='tempest-keypair-1241971956',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:36:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='405587d223d54c5ab4f72a1994ac2862',ramdisk_id='',reservation_id='r-y3ado2eg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1643003262',owner_user_name='tempest-ServerActionsTestOtherB-1643003262-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:36:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8174362ccd88488d867db28e18906a62',uuid=03ad5bab-ab32-47fc-b7e8-b32282b9c20d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea92909f-40d7-48a8-be09-50439674945c", "address": "fa:16:3e:3e:5e:e7", "network": {"id": "8354f86b-1e91-42ca-9847-769bb0aadcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-664289957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405587d223d54c5ab4f72a1994ac2862", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea92909f-40", "ovs_interfaceid": "ea92909f-40d7-48a8-be09-50439674945c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 18:38:51 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-02df2fb7-f5ba-4c37-a206-2d4e2f74e475 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Converting VIF {"id": "ea92909f-40d7-48a8-be09-50439674945c", "address": "fa:16:3e:3e:5e:e7", "network": {"id": "8354f86b-1e91-42ca-9847-769bb0aadcd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-664289957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405587d223d54c5ab4f72a1994ac2862", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea92909f-40", "ovs_interfaceid": "ea92909f-40d7-48a8-be09-50439674945c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:38:51 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-02df2fb7-f5ba-4c37-a206-2d4e2f74e475 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:5e:e7,bridge_name='br-int',has_traffic_filtering=True,id=ea92909f-40d7-48a8-be09-50439674945c,network=Network(8354f86b-1e91-42ca-9847-769bb0aadcd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea92909f-40') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:38:51 user nova-compute[72418]: DEBUG os_vif [None req-02df2fb7-f5ba-4c37-a206-2d4e2f74e475 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:5e:e7,bridge_name='br-int',has_traffic_filtering=True,id=ea92909f-40d7-48a8-be09-50439674945c,network=Network(8354f86b-1e91-42ca-9847-769bb0aadcd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea92909f-40') {{(pid=72418) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 18:38:51 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:38:51 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea92909f-40, bridge=br-int, if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:38:51 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:38:51 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:38:51 user nova-compute[72418]: INFO os_vif [None req-02df2fb7-f5ba-4c37-a206-2d4e2f74e475 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:5e:e7,bridge_name='br-int',has_traffic_filtering=True,id=ea92909f-40d7-48a8-be09-50439674945c,network=Network(8354f86b-1e91-42ca-9847-769bb0aadcd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea92909f-40')
Aug 09 18:38:51 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02df2fb7-f5ba-4c37-a206-2d4e2f74e475 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] calling os-brick to detach iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 18:38:51 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-02df2fb7-f5ba-4c37-a206-2d4e2f74e475 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, {'target_iqns': ['iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EzlWwnfa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:38:51 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-02df2fb7-f5ba-4c37-a206-2d4e2f74e475 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:38:51 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-02df2fb7-f5ba-4c37-a206-2d4e2f74e475 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:38:51 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-02df2fb7-f5ba-4c37-a206-2d4e2f74e475 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:38:51 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-02df2fb7-f5ba-4c37-a206-2d4e2f74e475 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71', 0)] {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 18:38:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:51 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0dc466-2378-4275-8c65-3658cea8bc51]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:38:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:51 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f6edfe-deaa-4671-8358-26d0651a7688]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:38:51 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-02df2fb7-f5ba-4c37-a206-2d4e2f74e475 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:38:51 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:38:51 user nova-compute[72418]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:38:51 user nova-compute[72418]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)
Aug 09 18:38:51 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:38:51 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-02df2fb7-f5ba-4c37-a206-2d4e2f74e475 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:38:51 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:38:51 user nova-compute[72418]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 (non-flash)
Aug 09 18:38:51 user nova-compute[72418]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)
Aug 09 18:38:51 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:38:51 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-02df2fb7-f5ba-4c37-a206-2d4e2f74e475 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f42d478b130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71'): ({'sdd'}, set())}) {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 18:38:51 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-02df2fb7-f5ba-4c37-a206-2d4e2f74e475 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Removing single pathed devices sdd {{(pid=72418) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 18:38:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:51 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ee53c2-e5f4-4e16-9c85-e21b9746afa5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:38:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:51 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6320b9-08eb-4c12-b4dd-41b8c3a60275]: (4, ('ok\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:38:51 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-02df2fb7-f5ba-4c37-a206-2d4e2f74e475 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Flushing IO for device /dev/sdd {{(pid=72418) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 18:38:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:51 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be6ef9e-cb0b-4c10-86d9-5d2ae563761b]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:38:51 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-02df2fb7-f5ba-4c37-a206-2d4e2f74e475 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72418) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 18:38:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:51 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee18228-45fd-495b-bf63-ab015abf62c8]: (4, ('1', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:38:51 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-02df2fb7-f5ba-4c37-a206-2d4e2f74e475 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 18:38:51 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-02df2fb7-f5ba-4c37-a206-2d4e2f74e475 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] SCSI volumes sdd have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 18:38:51 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-02df2fb7-f5ba-4c37-a206-2d4e2f74e475 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71')] {{(pid=72418) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 18:38:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:51 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[4febaa16-61f7-427f-b259-9c7d4b0b8ce9]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:38:51 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-02df2fb7-f5ba-4c37-a206-2d4e2f74e475 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:38:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --logout {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:51 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4272b11-a282-40df-b8c2-1d9a1f09bb8e]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:38:51 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-02df2fb7-f5ba-4c37-a206-2d4e2f74e475 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71, portal: 172.16.0.220,3260]
Aug 09 18:38:51 user nova-compute[72418]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71, portal: 172.16.0.220,3260] successful.
Aug 09 18:38:51 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:38:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --op delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:38:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57cf2c50-486c-4ee4-a0f8-c48ad6790e71 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:38:51 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[083bd9f5-a79f-40ba-80e0-37c5489de90d]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:38:51 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-02df2fb7-f5ba-4c37-a206-2d4e2f74e475 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:38:51 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-02df2fb7-f5ba-4c37-a206-2d4e2f74e475 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:38:51 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-02df2fb7-f5ba-4c37-a206-2d4e2f74e475 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] <== disconnect_volume: return (284ms) None {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:38:51 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02df2fb7-f5ba-4c37-a206-2d4e2f74e475 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Disconnected iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 18:38:51 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-02df2fb7-f5ba-4c37-a206-2d4e2f74e475 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Deleting instance files /opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d_del
Aug 09 18:38:51 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-02df2fb7-f5ba-4c37-a206-2d4e2f74e475 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Deletion of /opt/stack/data/nova/instances/03ad5bab-ab32-47fc-b7e8-b32282b9c20d_del complete
Aug 09 18:38:51 user nova-compute[72418]: INFO nova.compute.manager [None req-02df2fb7-f5ba-4c37-a206-2d4e2f74e475 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Took 1.15 seconds to destroy the instance on the hypervisor.
Aug 09 18:38:51 user nova-compute[72418]: DEBUG oslo.service.loopingcall [None req-02df2fb7-f5ba-4c37-a206-2d4e2f74e475 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72418) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 18:38:51 user nova-compute[72418]: DEBUG nova.compute.manager [-] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Deallocating network for instance {{(pid=72418) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 18:38:51 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] deallocate_for_instance() {{(pid=72418) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 18:38:52 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:38:52 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Took 0.95 seconds to deallocate network for instance.
Aug 09 18:38:52 user nova-compute[72418]: DEBUG nova.compute.manager [req-9fe3226b-2184-4a37-af0d-60b62e44c160 req-918f8ee1-cb2d-471a-9c5d-c5d936832f64 service nova] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Received event network-vif-plugged-ea92909f-40d7-48a8-be09-50439674945c {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:38:52 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-9fe3226b-2184-4a37-af0d-60b62e44c160 req-918f8ee1-cb2d-471a-9c5d-c5d936832f64 service nova] Acquiring lock "03ad5bab-ab32-47fc-b7e8-b32282b9c20d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:38:52 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-9fe3226b-2184-4a37-af0d-60b62e44c160 req-918f8ee1-cb2d-471a-9c5d-c5d936832f64 service nova] Lock "03ad5bab-ab32-47fc-b7e8-b32282b9c20d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:38:52 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-9fe3226b-2184-4a37-af0d-60b62e44c160 req-918f8ee1-cb2d-471a-9c5d-c5d936832f64 service nova] Lock "03ad5bab-ab32-47fc-b7e8-b32282b9c20d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:38:52 user nova-compute[72418]: DEBUG nova.compute.manager [req-9fe3226b-2184-4a37-af0d-60b62e44c160 req-918f8ee1-cb2d-471a-9c5d-c5d936832f64 service nova] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] No waiting events found dispatching network-vif-plugged-ea92909f-40d7-48a8-be09-50439674945c {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:38:52 user nova-compute[72418]: WARNING nova.compute.manager [req-9fe3226b-2184-4a37-af0d-60b62e44c160 req-918f8ee1-cb2d-471a-9c5d-c5d936832f64 service nova] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Received unexpected event network-vif-plugged-ea92909f-40d7-48a8-be09-50439674945c for instance with vm_state active and task_state deleting.
Aug 09 18:38:52 user nova-compute[72418]: DEBUG nova.compute.manager [req-9fe3226b-2184-4a37-af0d-60b62e44c160 req-918f8ee1-cb2d-471a-9c5d-c5d936832f64 service nova] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Received event network-vif-deleted-ea92909f-40d7-48a8-be09-50439674945c {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:38:53 user nova-compute[72418]: INFO nova.compute.manager [None req-02df2fb7-f5ba-4c37-a206-2d4e2f74e475 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Took 0.75 seconds to detach 1 volumes for instance.
Aug 09 18:38:53 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-02df2fb7-f5ba-4c37-a206-2d4e2f74e475 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:38:53 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-02df2fb7-f5ba-4c37-a206-2d4e2f74e475 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:38:53 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-02df2fb7-f5ba-4c37-a206-2d4e2f74e475 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:38:53 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-02df2fb7-f5ba-4c37-a206-2d4e2f74e475 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:38:53 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-02df2fb7-f5ba-4c37-a206-2d4e2f74e475 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.337s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:38:53 user nova-compute[72418]: INFO nova.scheduler.client.report [None req-02df2fb7-f5ba-4c37-a206-2d4e2f74e475 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Deleted allocations for instance 03ad5bab-ab32-47fc-b7e8-b32282b9c20d
Aug 09 18:38:53 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-02df2fb7-f5ba-4c37-a206-2d4e2f74e475 tempest-ServerActionsTestOtherB-1643003262 tempest-ServerActionsTestOtherB-1643003262-project-member] Lock "03ad5bab-ab32-47fc-b7e8-b32282b9c20d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.375s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:38:54 user nova-compute[72418]: DEBUG nova.compute.manager [req-cf2772ea-e556-43b7-ab10-c2dece0ba85a req-4fcc888f-3f1c-4cde-9203-09318b180ecf service nova] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Received event network-changed-396cd02b-9a02-4b77-b06b-6253ca90f538 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:38:54 user nova-compute[72418]: DEBUG nova.compute.manager [req-cf2772ea-e556-43b7-ab10-c2dece0ba85a req-4fcc888f-3f1c-4cde-9203-09318b180ecf service nova] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Refreshing instance network info cache due to event network-changed-396cd02b-9a02-4b77-b06b-6253ca90f538. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:38:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-cf2772ea-e556-43b7-ab10-c2dece0ba85a req-4fcc888f-3f1c-4cde-9203-09318b180ecf service nova] Acquiring lock "refresh_cache-873654d4-9cf2-4dde-859c-ad26d05d6e0a" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:38:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-cf2772ea-e556-43b7-ab10-c2dece0ba85a req-4fcc888f-3f1c-4cde-9203-09318b180ecf service nova] Acquired lock "refresh_cache-873654d4-9cf2-4dde-859c-ad26d05d6e0a" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:38:54 user nova-compute[72418]: DEBUG nova.network.neutron [req-cf2772ea-e556-43b7-ab10-c2dece0ba85a req-4fcc888f-3f1c-4cde-9203-09318b180ecf service nova] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Refreshing network info cache for port 396cd02b-9a02-4b77-b06b-6253ca90f538 {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:38:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-369299e3-50cb-4c4f-88a7-79b0a4cece2b tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Acquiring lock "873654d4-9cf2-4dde-859c-ad26d05d6e0a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:38:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-369299e3-50cb-4c4f-88a7-79b0a4cece2b tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "873654d4-9cf2-4dde-859c-ad26d05d6e0a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:38:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-369299e3-50cb-4c4f-88a7-79b0a4cece2b tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Acquiring lock "873654d4-9cf2-4dde-859c-ad26d05d6e0a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:38:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-369299e3-50cb-4c4f-88a7-79b0a4cece2b tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "873654d4-9cf2-4dde-859c-ad26d05d6e0a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:38:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-369299e3-50cb-4c4f-88a7-79b0a4cece2b tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "873654d4-9cf2-4dde-859c-ad26d05d6e0a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:38:54 user nova-compute[72418]: INFO nova.compute.manager [None req-369299e3-50cb-4c4f-88a7-79b0a4cece2b tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Terminating instance
Aug 09 18:38:54 user nova-compute[72418]: DEBUG nova.compute.manager [None req-369299e3-50cb-4c4f-88a7-79b0a4cece2b tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Start destroying the instance on the hypervisor. {{(pid=72418) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 18:38:54 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:38:54 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:38:54 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:38:54 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:38:54 user nova-compute[72418]: DEBUG nova.network.neutron [req-cf2772ea-e556-43b7-ab10-c2dece0ba85a req-4fcc888f-3f1c-4cde-9203-09318b180ecf service nova] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Updated VIF entry in instance network info cache for port 396cd02b-9a02-4b77-b06b-6253ca90f538. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:38:54 user nova-compute[72418]: DEBUG nova.network.neutron [req-cf2772ea-e556-43b7-ab10-c2dece0ba85a req-4fcc888f-3f1c-4cde-9203-09318b180ecf service nova] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Updating instance_info_cache with network_info: [{"id": "396cd02b-9a02-4b77-b06b-6253ca90f538", "address": "fa:16:3e:47:8e:5a", "network": {"id": "0fbd02ef-7c74-46c2-a09c-3b69be222ffa", "bridge": "br-int", "label": "tempest-TestStampPattern-85008345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce18df915bca48109597ad4aa8f1d116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap396cd02b-9a", "ovs_interfaceid": "396cd02b-9a02-4b77-b06b-6253ca90f538", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:38:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-cf2772ea-e556-43b7-ab10-c2dece0ba85a req-4fcc888f-3f1c-4cde-9203-09318b180ecf service nova] Releasing lock "refresh_cache-873654d4-9cf2-4dde-859c-ad26d05d6e0a" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:38:54 user nova-compute[72418]: DEBUG nova.compute.manager [req-4d5e14c1-b725-498a-9ee2-0f17629594cb req-e7f51027-675f-48b6-9cc9-f3e5d19c678d service nova] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Received event network-vif-unplugged-396cd02b-9a02-4b77-b06b-6253ca90f538 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:38:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-4d5e14c1-b725-498a-9ee2-0f17629594cb req-e7f51027-675f-48b6-9cc9-f3e5d19c678d service nova] Acquiring lock "873654d4-9cf2-4dde-859c-ad26d05d6e0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:38:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-4d5e14c1-b725-498a-9ee2-0f17629594cb req-e7f51027-675f-48b6-9cc9-f3e5d19c678d service nova] Lock "873654d4-9cf2-4dde-859c-ad26d05d6e0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:38:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-4d5e14c1-b725-498a-9ee2-0f17629594cb req-e7f51027-675f-48b6-9cc9-f3e5d19c678d service nova] Lock "873654d4-9cf2-4dde-859c-ad26d05d6e0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:38:54 user nova-compute[72418]: DEBUG nova.compute.manager [req-4d5e14c1-b725-498a-9ee2-0f17629594cb req-e7f51027-675f-48b6-9cc9-f3e5d19c678d service nova] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] No waiting events found dispatching network-vif-unplugged-396cd02b-9a02-4b77-b06b-6253ca90f538 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:38:54 user nova-compute[72418]: DEBUG nova.compute.manager [req-4d5e14c1-b725-498a-9ee2-0f17629594cb req-e7f51027-675f-48b6-9cc9-f3e5d19c678d service nova] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Received event network-vif-unplugged-396cd02b-9a02-4b77-b06b-6253ca90f538 for instance with task_state deleting. {{(pid=72418) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 18:38:55 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Instance destroyed successfully.
Aug 09 18:38:55 user nova-compute[72418]: DEBUG nova.objects.instance [None req-369299e3-50cb-4c4f-88a7-79b0a4cece2b tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lazy-loading 'resources' on Instance uuid 873654d4-9cf2-4dde-859c-ad26d05d6e0a {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:38:55 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-369299e3-50cb-4c4f-88a7-79b0a4cece2b tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:35:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-42037781',display_name='tempest-TestStampPattern-server-42037781',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-42037781',id=31,image_ref='0a633be0-827f-4c6d-a40e-5896a0bc9bcf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyuC2STmNW21KgmVvu2UdySlXVI+0J2CQB6cC/06BFGS91M3K5pktxtEHOvDqMzVGj1CpM11aZmLQ8ny2sqKin/VSPS9fza7lm5UGhSckLWpV1uBCIlOPx80Bbo9A16oA==',key_name='tempest-TestStampPattern-872776389',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:36:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ce18df915bca48109597ad4aa8f1d116',ramdisk_id='',reservation_id='r-i1popns8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='2c9e974b-b993-4f4e-9446-14941c39f109',image_min_disk='1',image_min_ram='0',image_owner_id='ce18df915bca48109597ad4aa8f1d116',image_owner_project_name='tempest-TestStampPattern-1349806997',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1349806997-project-member',image_user_id='2af66759bfa54ffba6174c4f95a83789',owner_project_name='tempest-TestStampPattern-1349806997',owner_user_name='tempest-TestStampPattern-1349806997-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:36:09Z,user_data=None,user_id='2af66759bfa54ffba6174c4f95a83789',uuid=873654d4-9cf2-4dde-859c-ad26d05d6e0a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "396cd02b-9a02-4b77-b06b-6253ca90f538", "address": "fa:16:3e:47:8e:5a", "network": {"id": "0fbd02ef-7c74-46c2-a09c-3b69be222ffa", "bridge": "br-int", "label": "tempest-TestStampPattern-85008345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce18df915bca48109597ad4aa8f1d116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap396cd02b-9a", "ovs_interfaceid": "396cd02b-9a02-4b77-b06b-6253ca90f538", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 18:38:55 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-369299e3-50cb-4c4f-88a7-79b0a4cece2b tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Converting VIF {"id": "396cd02b-9a02-4b77-b06b-6253ca90f538", "address": "fa:16:3e:47:8e:5a", "network": {"id": "0fbd02ef-7c74-46c2-a09c-3b69be222ffa", "bridge": "br-int", "label": "tempest-TestStampPattern-85008345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce18df915bca48109597ad4aa8f1d116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap396cd02b-9a", "ovs_interfaceid": "396cd02b-9a02-4b77-b06b-6253ca90f538", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:38:55 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-369299e3-50cb-4c4f-88a7-79b0a4cece2b tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:8e:5a,bridge_name='br-int',has_traffic_filtering=True,id=396cd02b-9a02-4b77-b06b-6253ca90f538,network=Network(0fbd02ef-7c74-46c2-a09c-3b69be222ffa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap396cd02b-9a') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:38:55 user nova-compute[72418]: DEBUG os_vif [None req-369299e3-50cb-4c4f-88a7-79b0a4cece2b tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:8e:5a,bridge_name='br-int',has_traffic_filtering=True,id=396cd02b-9a02-4b77-b06b-6253ca90f538,network=Network(0fbd02ef-7c74-46c2-a09c-3b69be222ffa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap396cd02b-9a') {{(pid=72418) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 18:38:55 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:38:55 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap396cd02b-9a, bridge=br-int, if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:38:55 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:38:55 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:38:55 user nova-compute[72418]: INFO os_vif [None req-369299e3-50cb-4c4f-88a7-79b0a4cece2b tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:8e:5a,bridge_name='br-int',has_traffic_filtering=True,id=396cd02b-9a02-4b77-b06b-6253ca90f538,network=Network(0fbd02ef-7c74-46c2-a09c-3b69be222ffa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap396cd02b-9a')
Aug 09 18:38:55 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-369299e3-50cb-4c4f-88a7-79b0a4cece2b tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Deleting instance files /opt/stack/data/nova/instances/873654d4-9cf2-4dde-859c-ad26d05d6e0a_del
Aug 09 18:38:55 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-369299e3-50cb-4c4f-88a7-79b0a4cece2b tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Deletion of /opt/stack/data/nova/instances/873654d4-9cf2-4dde-859c-ad26d05d6e0a_del complete
Aug 09 18:38:55 user nova-compute[72418]: INFO nova.compute.manager [None req-369299e3-50cb-4c4f-88a7-79b0a4cece2b tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Took 1.02 seconds to destroy the instance on the hypervisor.
Aug 09 18:38:55 user nova-compute[72418]: DEBUG oslo.service.loopingcall [None req-369299e3-50cb-4c4f-88a7-79b0a4cece2b tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72418) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 18:38:55 user nova-compute[72418]: DEBUG nova.compute.manager [-] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Deallocating network for instance {{(pid=72418) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 18:38:55 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] deallocate_for_instance() {{(pid=72418) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 18:38:55 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:38:56 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:38:56 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Took 1.37 seconds to deallocate network for instance.
Aug 09 18:38:56 user nova-compute[72418]: DEBUG nova.compute.manager [req-e3ef5a71-0117-4b91-ae05-2b994aac98c9 req-663a30df-d472-4cfe-a7cd-6af45234faa2 service nova] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Received event network-vif-deleted-396cd02b-9a02-4b77-b06b-6253ca90f538 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:38:56 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-369299e3-50cb-4c4f-88a7-79b0a4cece2b tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:38:56 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-369299e3-50cb-4c4f-88a7-79b0a4cece2b tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:38:56 user nova-compute[72418]: DEBUG nova.compute.manager [req-754ed496-b3ab-463f-919b-bd1e7f3183ca req-93d8c1f2-c3e1-4298-a018-02f8974c11e6 service nova] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Received event network-vif-plugged-396cd02b-9a02-4b77-b06b-6253ca90f538 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:38:56 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-754ed496-b3ab-463f-919b-bd1e7f3183ca req-93d8c1f2-c3e1-4298-a018-02f8974c11e6 service nova] Acquiring lock "873654d4-9cf2-4dde-859c-ad26d05d6e0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:38:56 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-754ed496-b3ab-463f-919b-bd1e7f3183ca req-93d8c1f2-c3e1-4298-a018-02f8974c11e6 service nova] Lock "873654d4-9cf2-4dde-859c-ad26d05d6e0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:38:56 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-754ed496-b3ab-463f-919b-bd1e7f3183ca req-93d8c1f2-c3e1-4298-a018-02f8974c11e6 service nova] Lock "873654d4-9cf2-4dde-859c-ad26d05d6e0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:38:56 user nova-compute[72418]: DEBUG nova.compute.manager [req-754ed496-b3ab-463f-919b-bd1e7f3183ca req-93d8c1f2-c3e1-4298-a018-02f8974c11e6 service nova] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] No waiting events found dispatching network-vif-plugged-396cd02b-9a02-4b77-b06b-6253ca90f538 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:38:56 user nova-compute[72418]: WARNING nova.compute.manager [req-754ed496-b3ab-463f-919b-bd1e7f3183ca req-93d8c1f2-c3e1-4298-a018-02f8974c11e6 service nova] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Received unexpected event network-vif-plugged-396cd02b-9a02-4b77-b06b-6253ca90f538 for instance with vm_state deleted and task_state None.
Aug 09 18:38:57 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-369299e3-50cb-4c4f-88a7-79b0a4cece2b tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:38:57 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-369299e3-50cb-4c4f-88a7-79b0a4cece2b tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:38:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-369299e3-50cb-4c4f-88a7-79b0a4cece2b tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:38:57 user nova-compute[72418]: INFO nova.scheduler.client.report [None req-369299e3-50cb-4c4f-88a7-79b0a4cece2b tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Deleted allocations for instance 873654d4-9cf2-4dde-859c-ad26d05d6e0a
Aug 09 18:38:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-369299e3-50cb-4c4f-88a7-79b0a4cece2b tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "873654d4-9cf2-4dde-859c-ad26d05d6e0a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.875s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:38:58 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:38:58 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:38:58 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72418) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 18:38:59 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:38:59 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:39:00 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:39:00 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:39:00 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Starting heal instance info cache {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 18:39:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "refresh_cache-e019064c-955e-4f80-9b00-6b32b3835d58" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:39:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquired lock "refresh_cache-e019064c-955e-4f80-9b00-6b32b3835d58" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:39:01 user nova-compute[72418]: DEBUG nova.network.neutron [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Forcefully refreshing network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 18:39:01 user nova-compute[72418]: DEBUG nova.network.neutron [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Updating instance_info_cache with network_info: [{"id": "4c6c632a-142b-4cda-92c8-77026645af09", "address": "fa:16:3e:15:18:a4", "network": {"id": "beaefb5c-f5e4-47e7-ab68-60131f532ade", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e5863cda54487682a4edcc24202c91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c6c632a-14", "ovs_interfaceid": "4c6c632a-142b-4cda-92c8-77026645af09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:39:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Releasing lock "refresh_cache-e019064c-955e-4f80-9b00-6b32b3835d58" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:39:01 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Updated the network info_cache for instance {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 18:39:01 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:39:01 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:39:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-9b2643ee-615c-4474-b320-b972b490f5ad tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquiring lock "e24ebafb-73cb-42ea-a0b6-2263badd573f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:39:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-9b2643ee-615c-4474-b320-b972b490f5ad tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "e24ebafb-73cb-42ea-a0b6-2263badd573f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:39:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-9b2643ee-615c-4474-b320-b972b490f5ad tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquiring lock "e24ebafb-73cb-42ea-a0b6-2263badd573f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:39:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-9b2643ee-615c-4474-b320-b972b490f5ad tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "e24ebafb-73cb-42ea-a0b6-2263badd573f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:39:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-9b2643ee-615c-4474-b320-b972b490f5ad tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "e24ebafb-73cb-42ea-a0b6-2263badd573f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:39:03 user nova-compute[72418]: INFO nova.compute.manager [None req-9b2643ee-615c-4474-b320-b972b490f5ad tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Terminating instance
Aug 09 18:39:03 user nova-compute[72418]: DEBUG nova.compute.manager [None req-9b2643ee-615c-4474-b320-b972b490f5ad tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Start destroying the instance on the hypervisor. {{(pid=72418) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 18:39:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:39:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:39:03 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:39:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:39:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:39:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:39:03 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Auditing locally available compute resources for user (node: user) {{(pid=72418) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG nova.compute.manager [req-cf2e1370-5e99-4e9a-b4f9-a217e48928a6 req-104d5901-b17f-4578-8ed7-acf49d6290aa service nova] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Received event network-vif-unplugged-af96e29f-e6ad-495f-9703-9597a81cb2ef {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-cf2e1370-5e99-4e9a-b4f9-a217e48928a6 req-104d5901-b17f-4578-8ed7-acf49d6290aa service nova] Acquiring lock "e24ebafb-73cb-42ea-a0b6-2263badd573f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-cf2e1370-5e99-4e9a-b4f9-a217e48928a6 req-104d5901-b17f-4578-8ed7-acf49d6290aa service nova] Lock "e24ebafb-73cb-42ea-a0b6-2263badd573f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-cf2e1370-5e99-4e9a-b4f9-a217e48928a6 req-104d5901-b17f-4578-8ed7-acf49d6290aa service nova] Lock "e24ebafb-73cb-42ea-a0b6-2263badd573f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG nova.compute.manager [req-cf2e1370-5e99-4e9a-b4f9-a217e48928a6 req-104d5901-b17f-4578-8ed7-acf49d6290aa service nova] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] No waiting events found dispatching network-vif-unplugged-af96e29f-e6ad-495f-9703-9597a81cb2ef {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG nova.compute.manager [req-cf2e1370-5e99-4e9a-b4f9-a217e48928a6 req-104d5901-b17f-4578-8ed7-acf49d6290aa service nova] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Received event network-vif-unplugged-af96e29f-e6ad-495f-9703-9597a81cb2ef for instance with task_state deleting. {{(pid=72418) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 18:39:04 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Instance destroyed successfully.
Aug 09 18:39:04 user nova-compute[72418]: DEBUG nova.objects.instance [None req-9b2643ee-615c-4474-b320-b972b490f5ad tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lazy-loading 'resources' on Instance uuid e24ebafb-73cb-42ea-a0b6-2263badd573f {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-9b2643ee-615c-4474-b320-b972b490f5ad tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:33:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-469140945',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-469140945',id=27,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:35:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52e5863cda54487682a4edcc24202c91',ramdisk_id='',reservation_id='r-u0b4huj8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1120385592',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:37:17Z,user_data=None,user_id='621fd2b971c543d197a354c38e0d1867',uuid=e24ebafb-73cb-42ea-a0b6-2263badd573f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af96e29f-e6ad-495f-9703-9597a81cb2ef", "address": "fa:16:3e:4f:13:a9", "network": {"id": "beaefb5c-f5e4-47e7-ab68-60131f532ade", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e5863cda54487682a4edcc24202c91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf96e29f-e6", "ovs_interfaceid": "af96e29f-e6ad-495f-9703-9597a81cb2ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-9b2643ee-615c-4474-b320-b972b490f5ad tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Converting VIF {"id": "af96e29f-e6ad-495f-9703-9597a81cb2ef", "address": "fa:16:3e:4f:13:a9", "network": {"id": "beaefb5c-f5e4-47e7-ab68-60131f532ade", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e5863cda54487682a4edcc24202c91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf96e29f-e6", "ovs_interfaceid": "af96e29f-e6ad-495f-9703-9597a81cb2ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-9b2643ee-615c-4474-b320-b972b490f5ad tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:13:a9,bridge_name='br-int',has_traffic_filtering=True,id=af96e29f-e6ad-495f-9703-9597a81cb2ef,network=Network(beaefb5c-f5e4-47e7-ab68-60131f532ade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf96e29f-e6') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG os_vif [None req-9b2643ee-615c-4474-b320-b972b490f5ad tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:13:a9,bridge_name='br-int',has_traffic_filtering=True,id=af96e29f-e6ad-495f-9703-9597a81cb2ef,network=Network(beaefb5c-f5e4-47e7-ab68-60131f532ade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf96e29f-e6') {{(pid=72418) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf96e29f-e6, bridge=br-int, if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:39:04 user nova-compute[72418]: INFO os_vif [None req-9b2643ee-615c-4474-b320-b972b490f5ad tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:13:a9,bridge_name='br-int',has_traffic_filtering=True,id=af96e29f-e6ad-495f-9703-9597a81cb2ef,network=Network(beaefb5c-f5e4-47e7-ab68-60131f532ade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf96e29f-e6')
Aug 09 18:39:04 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b2643ee-615c-4474-b320-b972b490f5ad tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] calling os-brick to detach iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2643ee-615c-4474-b320-b972b490f5ad tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, {'target_iqns': ['iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ifyFsaxh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:39:04 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-9b2643ee-615c-4474-b320-b972b490f5ad tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:39:04 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-9b2643ee-615c-4474-b320-b972b490f5ad tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-9b2643ee-615c-4474-b320-b972b490f5ad tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2643ee-615c-4474-b320-b972b490f5ad tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40', 0)] {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[aacaf9ac-dca5-459c-b6ea-59ea10c081a9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf9dbd4-c13d-40a3-ab05-d682f35c4d4b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2643ee-615c-4474-b320-b972b490f5ad tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:39:04 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:39:04 user nova-compute[72418]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)
Aug 09 18:39:04 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2643ee-615c-4474-b320-b972b490f5ad tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:39:04 user nova-compute[72418]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 (non-flash)
Aug 09 18:39:04 user nova-compute[72418]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)
Aug 09 18:39:04 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2643ee-615c-4474-b320-b972b490f5ad tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f42d4707e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40'): ({'sdh'}, set())}) {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-9b2643ee-615c-4474-b320-b972b490f5ad tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Removing single pathed devices sdh {{(pid=72418) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[2783a966-71db-41bf-b6f2-22324f2517e6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[680bc1b8-d133-4163-84b9-3107c31e027c]: (4, ('ok\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-9b2643ee-615c-4474-b320-b972b490f5ad tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Flushing IO for device /dev/sdh {{(pid=72418) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9ccc02-8256-4e7a-90c7-dc17f81b967d]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-9b2643ee-615c-4474-b320-b972b490f5ad tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72418) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.101s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f31709-e3fd-4454-a6dc-162a398ec151]: (4, ('1', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-9b2643ee-615c-4474-b320-b972b490f5ad tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-9b2643ee-615c-4474-b320-b972b490f5ad tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] SCSI volumes sdh have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_db324209', '/dev/disk/by-id/scsi-1SCST_BIOdb324209-9e7f4a24e72120e6', '/dev/disk/by-id/scsi-23965376634613234') {{(pid=83046) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8372ea-6864-4202-be95-d4484502c5ed]: (4, None) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2643ee-615c-4474-b320-b972b490f5ad tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40')] {{(pid=72418) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[3354898b-b488-4d90-9737-0283f68d3a41]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2643ee-615c-4474-b320-b972b490f5ad tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 -p 172.16.0.220:3260 --logout {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:39:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:39:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:39:05 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed1d21c-65c9-4464-b3e7-78270057cd39]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:39:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2643ee-615c-4474-b320-b972b490f5ad tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40, portal: 172.16.0.220,3260]
Aug 09 18:39:05 user nova-compute[72418]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40, portal: 172.16.0.220,3260] successful.
Aug 09 18:39:05 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:39:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 -p 172.16.0.220:3260 --op delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:39:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcdb2460-ae98-4b7d-82ff-bbf5a3a63f40 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:39:05 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb33c44-e5bb-4260-9db8-fc411380a43a]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:39:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2643ee-615c-4474-b320-b972b490f5ad tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:39:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-9b2643ee-615c-4474-b320-b972b490f5ad tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.451s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:39:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2643ee-615c-4474-b320-b972b490f5ad tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] <== disconnect_volume: return (452ms) None {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:39:05 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b2643ee-615c-4474-b320-b972b490f5ad tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Disconnected iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 18:39:05 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-9b2643ee-615c-4474-b320-b972b490f5ad tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Deleting instance files /opt/stack/data/nova/instances/e24ebafb-73cb-42ea-a0b6-2263badd573f_del
Aug 09 18:39:05 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-9b2643ee-615c-4474-b320-b972b490f5ad tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Deletion of /opt/stack/data/nova/instances/e24ebafb-73cb-42ea-a0b6-2263badd573f_del complete
Aug 09 18:39:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:39:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:39:05 user nova-compute[72418]: INFO nova.compute.manager [None req-9b2643ee-615c-4474-b320-b972b490f5ad tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Took 1.39 seconds to destroy the instance on the hypervisor.
Aug 09 18:39:05 user nova-compute[72418]: DEBUG oslo.service.loopingcall [None req-9b2643ee-615c-4474-b320-b972b490f5ad tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72418) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 18:39:05 user nova-compute[72418]: DEBUG nova.compute.manager [-] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Deallocating network for instance {{(pid=72418) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 18:39:05 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] deallocate_for_instance() {{(pid=72418) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 18:39:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:39:05 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:39:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9e974b-b993-4f4e-9446-14941c39f109/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:39:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9e974b-b993-4f4e-9446-14941c39f109/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:39:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9e974b-b993-4f4e-9446-14941c39f109/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:39:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c9e974b-b993-4f4e-9446-14941c39f109/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:39:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:39:05 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:39:05 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Took 0.51 seconds to deallocate network for instance.
Aug 09 18:39:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:39:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:39:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:39:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:39:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:39:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:39:06 user nova-compute[72418]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691606331.0756648, 03ad5bab-ab32-47fc-b7e8-b32282b9c20d => Stopped> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:39:06 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] VM Stopped (Lifecycle Event)
Aug 09 18:39:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-21c2476c-cff8-43ef-8425-3b6f254395fe tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Acquiring lock "6af7918a-ce90-45ab-93d8-684e1489e891" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:39:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-21c2476c-cff8-43ef-8425-3b6f254395fe tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "6af7918a-ce90-45ab-93d8-684e1489e891" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:39:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-21c2476c-cff8-43ef-8425-3b6f254395fe tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Acquiring lock "6af7918a-ce90-45ab-93d8-684e1489e891-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:39:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-21c2476c-cff8-43ef-8425-3b6f254395fe tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "6af7918a-ce90-45ab-93d8-684e1489e891-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:39:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-21c2476c-cff8-43ef-8425-3b6f254395fe tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "6af7918a-ce90-45ab-93d8-684e1489e891-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:39:06 user nova-compute[72418]: DEBUG nova.compute.manager [None req-7387322a-ab48-4ee0-9b1d-ea58b8c458ee None None] [instance: 03ad5bab-ab32-47fc-b7e8-b32282b9c20d] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:39:06 user nova-compute[72418]: INFO nova.compute.manager [None req-21c2476c-cff8-43ef-8425-3b6f254395fe tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Terminating instance
Aug 09 18:39:06 user nova-compute[72418]: DEBUG nova.compute.manager [None req-21c2476c-cff8-43ef-8425-3b6f254395fe tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Start destroying the instance on the hypervisor. {{(pid=72418) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 18:39:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:39:06 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Error from libvirt while getting description of instance-0000001b: [Error Code 42] Domain not found: no domain with matching uuid 'e24ebafb-73cb-42ea-a0b6-2263badd573f' (instance-0000001b): libvirt.libvirtError: Domain not found: no domain with matching uuid 'e24ebafb-73cb-42ea-a0b6-2263badd573f' (instance-0000001b)
Aug 09 18:39:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e582b61c-d998-4a3f-8392-a7f0e94a4dec/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:39:06 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:39:06 user nova-compute[72418]: DEBUG nova.compute.manager [req-7ceed76a-6923-482d-af6c-7fe18b721765 req-e42384e0-a1d6-4280-9320-782828cbb0b6 service nova] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Received event network-vif-plugged-af96e29f-e6ad-495f-9703-9597a81cb2ef {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:39:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-7ceed76a-6923-482d-af6c-7fe18b721765 req-e42384e0-a1d6-4280-9320-782828cbb0b6 service nova] Acquiring lock "e24ebafb-73cb-42ea-a0b6-2263badd573f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:39:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-7ceed76a-6923-482d-af6c-7fe18b721765 req-e42384e0-a1d6-4280-9320-782828cbb0b6 service nova] Lock "e24ebafb-73cb-42ea-a0b6-2263badd573f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:39:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-7ceed76a-6923-482d-af6c-7fe18b721765 req-e42384e0-a1d6-4280-9320-782828cbb0b6 service nova] Lock "e24ebafb-73cb-42ea-a0b6-2263badd573f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:39:06 user nova-compute[72418]: DEBUG nova.compute.manager [req-7ceed76a-6923-482d-af6c-7fe18b721765 req-e42384e0-a1d6-4280-9320-782828cbb0b6 service nova] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] No waiting events found dispatching network-vif-plugged-af96e29f-e6ad-495f-9703-9597a81cb2ef {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:39:06 user nova-compute[72418]: WARNING nova.compute.manager [req-7ceed76a-6923-482d-af6c-7fe18b721765 req-e42384e0-a1d6-4280-9320-782828cbb0b6 service nova] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Received unexpected event network-vif-plugged-af96e29f-e6ad-495f-9703-9597a81cb2ef for instance with vm_state active and task_state deleting.
Aug 09 18:39:06 user nova-compute[72418]: DEBUG nova.compute.manager [req-7ceed76a-6923-482d-af6c-7fe18b721765 req-e42384e0-a1d6-4280-9320-782828cbb0b6 service nova] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Received event network-vif-deleted-af96e29f-e6ad-495f-9703-9597a81cb2ef {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:39:06 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:39:06 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:39:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e582b61c-d998-4a3f-8392-a7f0e94a4dec/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:39:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e582b61c-d998-4a3f-8392-a7f0e94a4dec/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:39:06 user nova-compute[72418]: DEBUG nova.compute.manager [req-d6952e9b-7705-40f6-9894-6e1b893deb23 req-dd5d3080-a6d2-4b93-88d8-611f72ca0655 service nova] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Received event network-vif-unplugged-2b44ecc4-13c5-43ba-8425-5f42d86bc716 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:39:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-d6952e9b-7705-40f6-9894-6e1b893deb23 req-dd5d3080-a6d2-4b93-88d8-611f72ca0655 service nova] Acquiring lock "6af7918a-ce90-45ab-93d8-684e1489e891-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:39:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-d6952e9b-7705-40f6-9894-6e1b893deb23 req-dd5d3080-a6d2-4b93-88d8-611f72ca0655 service nova] Lock "6af7918a-ce90-45ab-93d8-684e1489e891-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:39:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-d6952e9b-7705-40f6-9894-6e1b893deb23 req-dd5d3080-a6d2-4b93-88d8-611f72ca0655 service nova] Lock "6af7918a-ce90-45ab-93d8-684e1489e891-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:39:06 user nova-compute[72418]: DEBUG nova.compute.manager [req-d6952e9b-7705-40f6-9894-6e1b893deb23 req-dd5d3080-a6d2-4b93-88d8-611f72ca0655 service nova] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] No waiting events found dispatching network-vif-unplugged-2b44ecc4-13c5-43ba-8425-5f42d86bc716 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:39:06 user nova-compute[72418]: DEBUG nova.compute.manager [req-d6952e9b-7705-40f6-9894-6e1b893deb23 req-dd5d3080-a6d2-4b93-88d8-611f72ca0655 service nova] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Received event network-vif-unplugged-2b44ecc4-13c5-43ba-8425-5f42d86bc716 for instance with task_state deleting. {{(pid=72418) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 18:39:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e582b61c-d998-4a3f-8392-a7f0e94a4dec/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:39:06 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:39:06 user nova-compute[72418]: INFO nova.compute.manager [None req-9b2643ee-615c-4474-b320-b972b490f5ad tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Took 0.85 seconds to detach 1 volumes for instance.
Aug 09 18:39:07 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-9b2643ee-615c-4474-b320-b972b490f5ad tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:39:07 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-9b2643ee-615c-4474-b320-b972b490f5ad tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:39:07 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:39:07 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:39:07 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Hypervisor/Node resource view: name=user free_ram=7851MB free_disk=25.240493774414062GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72418) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 18:39:07 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:39:07 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Instance destroyed successfully.
Aug 09 18:39:07 user nova-compute[72418]: DEBUG nova.objects.instance [None req-21c2476c-cff8-43ef-8425-3b6f254395fe tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lazy-loading 'resources' on Instance uuid 6af7918a-ce90-45ab-93d8-684e1489e891 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:39:07 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-21c2476c-cff8-43ef-8425-3b6f254395fe tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:21:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-640969578',display_name='tempest-ServerRescueNegativeTestJSON-server-640969578',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-640969578',id=1,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:26:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5c68622cd79472ba6ad14a6876aeaea',ramdisk_id='',reservation_id='r-e2sltd8s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-326572915',owner_user_name='tempest-ServerRescueNegativeTestJSON-326572915-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:28:37Z,user_data=None,user_id='b3c4feb0a14841eeb757a79b6a05d1fa',uuid=6af7918a-ce90-45ab-93d8-684e1489e891,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b44ecc4-13c5-43ba-8425-5f42d86bc716", "address": "fa:16:3e:8d:41:82", "network": {"id": "15a49d9b-3c0d-449b-9473-29f219960e2c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c68622cd79472ba6ad14a6876aeaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b44ecc4-13", "ovs_interfaceid": "2b44ecc4-13c5-43ba-8425-5f42d86bc716", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 18:39:07 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-21c2476c-cff8-43ef-8425-3b6f254395fe tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Converting VIF {"id": "2b44ecc4-13c5-43ba-8425-5f42d86bc716", "address": "fa:16:3e:8d:41:82", "network": {"id": "15a49d9b-3c0d-449b-9473-29f219960e2c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1764067730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5c68622cd79472ba6ad14a6876aeaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b44ecc4-13", "ovs_interfaceid": "2b44ecc4-13c5-43ba-8425-5f42d86bc716", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:39:07 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-21c2476c-cff8-43ef-8425-3b6f254395fe tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:41:82,bridge_name='br-int',has_traffic_filtering=True,id=2b44ecc4-13c5-43ba-8425-5f42d86bc716,network=Network(15a49d9b-3c0d-449b-9473-29f219960e2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b44ecc4-13') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:39:07 user nova-compute[72418]: DEBUG os_vif [None req-21c2476c-cff8-43ef-8425-3b6f254395fe tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:41:82,bridge_name='br-int',has_traffic_filtering=True,id=2b44ecc4-13c5-43ba-8425-5f42d86bc716,network=Network(15a49d9b-3c0d-449b-9473-29f219960e2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b44ecc4-13') {{(pid=72418) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 18:39:07 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:39:07 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b44ecc4-13, bridge=br-int, if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:39:07 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:39:07 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:39:07 user nova-compute[72418]: INFO os_vif [None req-21c2476c-cff8-43ef-8425-3b6f254395fe tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:41:82,bridge_name='br-int',has_traffic_filtering=True,id=2b44ecc4-13c5-43ba-8425-5f42d86bc716,network=Network(15a49d9b-3c0d-449b-9473-29f219960e2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b44ecc4-13')
Aug 09 18:39:07 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-21c2476c-cff8-43ef-8425-3b6f254395fe tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Deleting instance files /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891_del
Aug 09 18:39:07 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-21c2476c-cff8-43ef-8425-3b6f254395fe tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Deletion of /opt/stack/data/nova/instances/6af7918a-ce90-45ab-93d8-684e1489e891_del complete
Aug 09 18:39:07 user nova-compute[72418]: INFO nova.compute.manager [None req-21c2476c-cff8-43ef-8425-3b6f254395fe tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Took 1.11 seconds to destroy the instance on the hypervisor.
Aug 09 18:39:07 user nova-compute[72418]: DEBUG oslo.service.loopingcall [None req-21c2476c-cff8-43ef-8425-3b6f254395fe tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72418) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 18:39:07 user nova-compute[72418]: DEBUG nova.compute.manager [-] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Deallocating network for instance {{(pid=72418) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 18:39:07 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] deallocate_for_instance() {{(pid=72418) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 18:39:07 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-9b2643ee-615c-4474-b320-b972b490f5ad tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:39:07 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-9b2643ee-615c-4474-b320-b972b490f5ad tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:39:07 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-9b2643ee-615c-4474-b320-b972b490f5ad tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.351s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:39:07 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.339s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:39:07 user nova-compute[72418]: INFO nova.scheduler.client.report [None req-9b2643ee-615c-4474-b320-b972b490f5ad tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Deleted allocations for instance e24ebafb-73cb-42ea-a0b6-2263badd573f
Aug 09 18:39:07 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Applying migration context for instance 0659fd5c-cb05-441e-94b6-9d05f7135893 as it has an incoming, in-progress migration f736d05d-3ba5-4d57-8e9c-332bae8c553f. Migration status is finished {{(pid=72418) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 09 18:39:07 user nova-compute[72418]: INFO nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Updating resource usage from migration f736d05d-3ba5-4d57-8e9c-332bae8c553f
Aug 09 18:39:07 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-9b2643ee-615c-4474-b320-b972b490f5ad tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "e24ebafb-73cb-42ea-a0b6-2263badd573f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.792s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:39:07 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 6af7918a-ce90-45ab-93d8-684e1489e891 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:39:07 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 8fe41968-a219-4a5a-afdb-32eb2082bb40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:39:07 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance e019064c-955e-4f80-9b00-6b32b3835d58 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:39:07 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance c46f2599-93f8-412e-9918-7ace8a9f19dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:39:07 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance e582b61c-d998-4a3f-8392-a7f0e94a4dec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:39:07 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 2c9e974b-b993-4f4e-9446-14941c39f109 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:39:07 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 4e1a095f-a2e7-4ab6-bb7e-38cda890d567 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:39:07 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Migration f736d05d-3ba5-4d57-8e9c-332bae8c553f is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 09 18:39:07 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 0659fd5c-cb05-441e-94b6-9d05f7135893 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:39:07 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 18:39:07 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 18:39:07 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:39:07 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Took 0.50 seconds to deallocate network for instance.
Aug 09 18:39:07 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-21c2476c-cff8-43ef-8425-3b6f254395fe tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:39:07 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:39:07 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:39:07 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Compute_service record updated for user:user {{(pid=72418) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 18:39:07 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.408s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:39:07 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-21c2476c-cff8-43ef-8425-3b6f254395fe tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.072s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:39:08 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-21c2476c-cff8-43ef-8425-3b6f254395fe tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:39:08 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-21c2476c-cff8-43ef-8425-3b6f254395fe tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:39:08 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-21c2476c-cff8-43ef-8425-3b6f254395fe tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.296s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:39:08 user nova-compute[72418]: INFO nova.scheduler.client.report [None req-21c2476c-cff8-43ef-8425-3b6f254395fe tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Deleted allocations for instance 6af7918a-ce90-45ab-93d8-684e1489e891
Aug 09 18:39:08 user nova-compute[72418]: DEBUG nova.compute.manager [req-685e1a14-fde0-4648-91a9-825bf5bbf943 req-e439a604-d247-4b97-8bcd-d0920b54c7c1 service nova] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Received event network-vif-deleted-2b44ecc4-13c5-43ba-8425-5f42d86bc716 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:39:08 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-21c2476c-cff8-43ef-8425-3b6f254395fe tempest-ServerRescueNegativeTestJSON-326572915 tempest-ServerRescueNegativeTestJSON-326572915-project-member] Lock "6af7918a-ce90-45ab-93d8-684e1489e891" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.182s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:39:08 user nova-compute[72418]: DEBUG nova.compute.manager [req-e6a4bcd0-e976-4646-97e0-826858e0580e req-a862e563-95e5-44ca-a595-29a05d37d700 service nova] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Received event network-vif-plugged-2b44ecc4-13c5-43ba-8425-5f42d86bc716 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:39:08 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-e6a4bcd0-e976-4646-97e0-826858e0580e req-a862e563-95e5-44ca-a595-29a05d37d700 service nova] Acquiring lock "6af7918a-ce90-45ab-93d8-684e1489e891-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:39:08 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-e6a4bcd0-e976-4646-97e0-826858e0580e req-a862e563-95e5-44ca-a595-29a05d37d700 service nova] Lock "6af7918a-ce90-45ab-93d8-684e1489e891-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:39:08 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-e6a4bcd0-e976-4646-97e0-826858e0580e req-a862e563-95e5-44ca-a595-29a05d37d700 service nova] Lock "6af7918a-ce90-45ab-93d8-684e1489e891-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:39:08 user nova-compute[72418]: DEBUG nova.compute.manager [req-e6a4bcd0-e976-4646-97e0-826858e0580e req-a862e563-95e5-44ca-a595-29a05d37d700 service nova] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] No waiting events found dispatching network-vif-plugged-2b44ecc4-13c5-43ba-8425-5f42d86bc716 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:39:08 user nova-compute[72418]: WARNING nova.compute.manager [req-e6a4bcd0-e976-4646-97e0-826858e0580e req-a862e563-95e5-44ca-a595-29a05d37d700 service nova] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Received unexpected event network-vif-plugged-2b44ecc4-13c5-43ba-8425-5f42d86bc716 for instance with vm_state deleted and task_state None.
Aug 09 18:39:09 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:39:09 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Triggering sync for uuid 8fe41968-a219-4a5a-afdb-32eb2082bb40 {{(pid=72418) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 18:39:09 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Triggering sync for uuid e019064c-955e-4f80-9b00-6b32b3835d58 {{(pid=72418) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 18:39:09 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Triggering sync for uuid c46f2599-93f8-412e-9918-7ace8a9f19dd {{(pid=72418) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 18:39:09 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Triggering sync for uuid e582b61c-d998-4a3f-8392-a7f0e94a4dec {{(pid=72418) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 18:39:09 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Triggering sync for uuid 2c9e974b-b993-4f4e-9446-14941c39f109 {{(pid=72418) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 18:39:09 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Triggering sync for uuid 0659fd5c-cb05-441e-94b6-9d05f7135893 {{(pid=72418) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 18:39:09 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Triggering sync for uuid 4e1a095f-a2e7-4ab6-bb7e-38cda890d567 {{(pid=72418) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 18:39:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "8fe41968-a219-4a5a-afdb-32eb2082bb40" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:39:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "8fe41968-a219-4a5a-afdb-32eb2082bb40" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:39:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "e019064c-955e-4f80-9b00-6b32b3835d58" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:39:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "e019064c-955e-4f80-9b00-6b32b3835d58" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:39:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "c46f2599-93f8-412e-9918-7ace8a9f19dd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:39:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "c46f2599-93f8-412e-9918-7ace8a9f19dd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:39:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "e582b61c-d998-4a3f-8392-a7f0e94a4dec" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:39:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "e582b61c-d998-4a3f-8392-a7f0e94a4dec" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:39:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "2c9e974b-b993-4f4e-9446-14941c39f109" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:39:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "2c9e974b-b993-4f4e-9446-14941c39f109" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:39:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "0659fd5c-cb05-441e-94b6-9d05f7135893" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:39:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "0659fd5c-cb05-441e-94b6-9d05f7135893" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:39:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "4e1a095f-a2e7-4ab6-bb7e-38cda890d567" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:39:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "4e1a095f-a2e7-4ab6-bb7e-38cda890d567" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:39:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "e019064c-955e-4f80-9b00-6b32b3835d58" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:39:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "8fe41968-a219-4a5a-afdb-32eb2082bb40" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:39:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "c46f2599-93f8-412e-9918-7ace8a9f19dd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:39:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "e582b61c-d998-4a3f-8392-a7f0e94a4dec" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:39:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "2c9e974b-b993-4f4e-9446-14941c39f109" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:39:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "4e1a095f-a2e7-4ab6-bb7e-38cda890d567" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:39:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "0659fd5c-cb05-441e-94b6-9d05f7135893" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:39:10 user nova-compute[72418]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691606335.1198497, 873654d4-9cf2-4dde-859c-ad26d05d6e0a => Stopped> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:39:10 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] VM Stopped (Lifecycle Event)
Aug 09 18:39:10 user nova-compute[72418]: DEBUG nova.compute.manager [None req-6e4a772c-257f-4b10-beff-0c49044396e6 None None] [instance: 873654d4-9cf2-4dde-859c-ad26d05d6e0a] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:39:11 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-3715e6c1-3176-4512-a434-6d2fb45fa7d8 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Acquiring lock "0659fd5c-cb05-441e-94b6-9d05f7135893" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:39:11 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-3715e6c1-3176-4512-a434-6d2fb45fa7d8 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "0659fd5c-cb05-441e-94b6-9d05f7135893" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:39:11 user nova-compute[72418]: DEBUG nova.compute.manager [None req-3715e6c1-3176-4512-a434-6d2fb45fa7d8 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Going to confirm migration 2 {{(pid=72418) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 09 18:39:12 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:39:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-3715e6c1-3176-4512-a434-6d2fb45fa7d8 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Acquiring lock "refresh_cache-0659fd5c-cb05-441e-94b6-9d05f7135893" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:39:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-3715e6c1-3176-4512-a434-6d2fb45fa7d8 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Acquired lock "refresh_cache-0659fd5c-cb05-441e-94b6-9d05f7135893" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:39:12 user nova-compute[72418]: DEBUG nova.network.neutron [None req-3715e6c1-3176-4512-a434-6d2fb45fa7d8 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:39:12 user nova-compute[72418]: DEBUG nova.objects.instance [None req-3715e6c1-3176-4512-a434-6d2fb45fa7d8 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lazy-loading 'info_cache' on Instance uuid 0659fd5c-cb05-441e-94b6-9d05f7135893 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:39:12 user nova-compute[72418]: DEBUG nova.network.neutron [None req-3715e6c1-3176-4512-a434-6d2fb45fa7d8 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Updating instance_info_cache with network_info: [{"id": "0cd6232b-ea64-4978-bc0e-0e84995fd9a4", "address": "fa:16:3e:65:a1:d2", "network": {"id": "bd36ef30-e57d-473f-97bc-c51b5db08aa7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-425133239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78b6e36a5b61456092ce7de9212c3c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd6232b-ea", "ovs_interfaceid": "0cd6232b-ea64-4978-bc0e-0e84995fd9a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:39:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-3715e6c1-3176-4512-a434-6d2fb45fa7d8 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Releasing lock "refresh_cache-0659fd5c-cb05-441e-94b6-9d05f7135893" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:39:12 user nova-compute[72418]: DEBUG nova.objects.instance [None req-3715e6c1-3176-4512-a434-6d2fb45fa7d8 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lazy-loading 'migration_context' on Instance uuid 0659fd5c-cb05-441e-94b6-9d05f7135893 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:39:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-3715e6c1-3176-4512-a434-6d2fb45fa7d8 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:39:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-3715e6c1-3176-4512-a434-6d2fb45fa7d8 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:39:12 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-3715e6c1-3176-4512-a434-6d2fb45fa7d8 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:39:12 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-3715e6c1-3176-4512-a434-6d2fb45fa7d8 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:39:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-3715e6c1-3176-4512-a434-6d2fb45fa7d8 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.282s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:39:13 user nova-compute[72418]: INFO nova.scheduler.client.report [None req-3715e6c1-3176-4512-a434-6d2fb45fa7d8 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Deleted allocation for migration f736d05d-3ba5-4d57-8e9c-332bae8c553f
Aug 09 18:39:13 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-3715e6c1-3176-4512-a434-6d2fb45fa7d8 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "0659fd5c-cb05-441e-94b6-9d05f7135893" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.276s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:39:17 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:39:17 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:39:17 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72418) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 18:39:17 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72418) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 18:39:17 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72418) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 18:39:17 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:39:19 user nova-compute[72418]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691606344.5378654, e24ebafb-73cb-42ea-a0b6-2263badd573f => Stopped> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:39:19 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] VM Stopped (Lifecycle Event)
Aug 09 18:39:19 user nova-compute[72418]: DEBUG nova.compute.manager [None req-53da5aa5-e497-4bdc-8e68-7a8abcad3af3 None None] [instance: e24ebafb-73cb-42ea-a0b6-2263badd573f] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:39:20 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:39:22 user nova-compute[72418]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691606346.8793366, 6af7918a-ce90-45ab-93d8-684e1489e891 => Stopped> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:39:22 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] VM Stopped (Lifecycle Event)
Aug 09 18:39:22 user nova-compute[72418]: DEBUG nova.compute.manager [None req-47025d34-bef9-4eac-8e15-2339f5a5b5b4 None None] [instance: 6af7918a-ce90-45ab-93d8-684e1489e891] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:39:22 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:39:27 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:39:32 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:39:37 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:39:41 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:39:42 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:39:42 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-4443124f-c6c7-4c0f-a795-9f9e6ea0b0ac tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Acquiring lock "4e1a095f-a2e7-4ab6-bb7e-38cda890d567" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:39:42 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-4443124f-c6c7-4c0f-a795-9f9e6ea0b0ac tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Lock "4e1a095f-a2e7-4ab6-bb7e-38cda890d567" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:39:42 user nova-compute[72418]: DEBUG nova.objects.instance [None req-4443124f-c6c7-4c0f-a795-9f9e6ea0b0ac tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Lazy-loading 'flavor' on Instance uuid 4e1a095f-a2e7-4ab6-bb7e-38cda890d567 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:39:42 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-4443124f-c6c7-4c0f-a795-9f9e6ea0b0ac tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Lock "4e1a095f-a2e7-4ab6-bb7e-38cda890d567" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:39:42 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-4443124f-c6c7-4c0f-a795-9f9e6ea0b0ac tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Acquiring lock "4e1a095f-a2e7-4ab6-bb7e-38cda890d567" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:39:42 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-4443124f-c6c7-4c0f-a795-9f9e6ea0b0ac tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Lock "4e1a095f-a2e7-4ab6-bb7e-38cda890d567" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:39:42 user nova-compute[72418]: INFO nova.compute.manager [None req-4443124f-c6c7-4c0f-a795-9f9e6ea0b0ac tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Attaching volume ba4c6fab-b988-4b6a-904a-2434e61b294c to /dev/vdb
Aug 09 18:39:42 user nova-compute[72418]: DEBUG os_brick.utils [None req-4443124f-c6c7-4c0f-a795-9f9e6ea0b0ac tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:39:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:39:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:39:42 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[116f9c02-010d-4bb9-8382-46ccf3488499]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ad56b243ad71\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:39:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:39:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:39:42 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c2f477-408a-4bcc-9121-dd63ffb6cadb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:39:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:39:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:39:42 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e19d80-7907-4e04-985e-d24865b13b07]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:39:42 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0dcd02e-146e-4750-a83c-8957da3ee405]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:39:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-4443124f-c6c7-4c0f-a795-9f9e6ea0b0ac tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Running cmd (subprocess): nvme version {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:39:42 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-4443124f-c6c7-4c0f-a795-9f9e6ea0b0ac tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] 'nvme version' failed. Not Retrying. {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:39:42 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4443124f-c6c7-4c0f-a795-9f9e6ea0b0ac tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] nvme not present on system {{(pid=72418) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 18:39:43 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:39:43 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:39:43 user nova-compute[72418]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 18:39:43 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c3f46e-7958-43c6-b425-5e1f48ed2e3e]: (4, '') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:39:43 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-4443124f-c6c7-4c0f-a795-9f9e6ea0b0ac tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72418) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 18:39:43 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-4443124f-c6c7-4c0f-a795-9f9e6ea0b0ac tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 18:39:43 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-4443124f-c6c7-4c0f-a795-9f9e6ea0b0ac tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] LIGHTOS: no hostnqn found. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 18:39:43 user nova-compute[72418]: DEBUG os_brick.utils [None req-4443124f-c6c7-4c0f-a795-9f9e6ea0b0ac tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ad56b243ad71', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:39:43 user nova-compute[72418]: DEBUG nova.virt.block_device [None req-4443124f-c6c7-4c0f-a795-9f9e6ea0b0ac tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Updating existing volume attachment record: cf8562dc-b212-4833-a43b-2cf1260a99ab {{(pid=72418) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 18:39:47 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:39:50 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:39:52 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:39:52 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4443124f-c6c7-4c0f-a795-9f9e6ea0b0ac tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Calling os-brick to attach iSCSI Volume {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 18:39:52 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-4443124f-c6c7-4c0f-a795-9f9e6ea0b0ac tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PCJXLeFp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:39:52 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-4443124f-c6c7-4c0f-a795-9f9e6ea0b0ac tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:39:52 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-4443124f-c6c7-4c0f-a795-9f9e6ea0b0ac tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:39:52 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-4443124f-c6c7-4c0f-a795-9f9e6ea0b0ac tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:39:52 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-4443124f-c6c7-4c0f-a795-9f9e6ea0b0ac tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:39:52 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-4443124f-c6c7-4c0f-a795-9f9e6ea0b0ac tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:39:52 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-4443124f-c6c7-4c0f-a795-9f9e6ea0b0ac tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:39:52 user nova-compute[72418]: INFO os_brick.initiator.connectors.iscsi [None req-4443124f-c6c7-4c0f-a795-9f9e6ea0b0ac tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 18:39:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c -p 172.16.0.220:3260 {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:39:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:39:52 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19de77b-322e-4b52-bdf6-9155b2afdf30]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:39:52 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-4443124f-c6c7-4c0f-a795-9f9e6ea0b0ac tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 18:39:52 user nova-compute[72418]:  {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:39:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c -p 172.16.0.220:3260 --interface default --op new {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:39:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:39:52 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5f253a-2161-432d-9375-7c95c89b2318]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c] added\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:39:52 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-4443124f-c6c7-4c0f-a795-9f9e6ea0b0ac tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c] added
Aug 09 18:39:52 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:39:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:39:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:39:52 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[40fb2b6f-5d41-4ed8-ad3a-12eb67602f21]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:39:52 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-4443124f-c6c7-4c0f-a795-9f9e6ea0b0ac tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:39:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:39:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:39:52 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca588262-b0a1-416e-b7c9-01bcdfb9917d]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:39:52 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-4443124f-c6c7-4c0f-a795-9f9e6ea0b0ac tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:39:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PCJXLeFp {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:39:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PCJXLeFp" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:39:52 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e9c68d-65d6-4158-8a91-027a4ea52f09]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:39:52 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-4443124f-c6c7-4c0f-a795-9f9e6ea0b0ac tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PCJXLeFp'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:39:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:39:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:39:52 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f8108c-1670-426a-ad12-6c0fae532213]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:39:52 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-4443124f-c6c7-4c0f-a795-9f9e6ea0b0ac tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:39:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:39:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:39:52 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc5710c-3465-49d0-8073-fda6056ec594]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:39:52 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-4443124f-c6c7-4c0f-a795-9f9e6ea0b0ac tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:39:52 user nova-compute[72418]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)
Aug 09 18:39:52 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:39:52 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-4443124f-c6c7-4c0f-a795-9f9e6ea0b0ac tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:39:52 user nova-compute[72418]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)
Aug 09 18:39:52 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:39:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c -p 172.16.0.220:3260 --login {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:39:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:39:52 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[350e2c0a-2d81-4706-b45b-98099d1d6621]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:39:52 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-4443124f-c6c7-4c0f-a795-9f9e6ea0b0ac tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c, portal: 172.16.0.220,3260]
Aug 09 18:39:52 user nova-compute[72418]: Login to [iface: default, target: iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c, portal: 172.16.0.220,3260] successful.
Aug 09 18:39:52 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:39:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:39:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:39:52 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52168ae-14a1-4091-b38f-f18d66dfeeb4]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:39:52 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-4443124f-c6c7-4c0f-a795-9f9e6ea0b0ac tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:39:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:39:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:39:52 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[378149af-9f2b-45ba-868c-f65d2d2cb569]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:39:52 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-4443124f-c6c7-4c0f-a795-9f9e6ea0b0ac tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:39:52 user nova-compute[72418]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)
Aug 09 18:39:52 user nova-compute[72418]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c (non-flash)
Aug 09 18:39:52 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:39:52 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-4443124f-c6c7-4c0f-a795-9f9e6ea0b0ac tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:39:52 user nova-compute[72418]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)
Aug 09 18:39:52 user nova-compute[72418]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c (non-flash)
Aug 09 18:39:52 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:39:52 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-4443124f-c6c7-4c0f-a795-9f9e6ea0b0ac tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:39:52 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-4443124f-c6c7-4c0f-a795-9f9e6ea0b0ac tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Connected to 172.16.0.220:3260 {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 18:39:52 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-4443124f-c6c7-4c0f-a795-9f9e6ea0b0ac tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] HCTL ('35', '-', '-', 0) found on session 39 with lun 0 {{(pid=72418) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 18:39:52 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-4443124f-c6c7-4c0f-a795-9f9e6ea0b0ac tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72418) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 18:39:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:39:52 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.026s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:39:52 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[933ad839-e88e-4a75-8dea-f4797567f9db]: (4, ('- - 0', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:39:52 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-4443124f-c6c7-4c0f-a795-9f9e6ea0b0ac tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72418) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 18:39:52 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-4443124f-c6c7-4c0f-a795-9f9e6ea0b0ac tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PCJXLeFp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 18:39:53 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-4443124f-c6c7-4c0f-a795-9f9e6ea0b0ac tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:39:53 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-4443124f-c6c7-4c0f-a795-9f9e6ea0b0ac tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '26236623433326563', 'path': '/dev/sdd'} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:39:53 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4443124f-c6c7-4c0f-a795-9f9e6ea0b0ac tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236623433326563', 'path': '/dev/sdd'} {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 18:39:53 user nova-compute[72418]: DEBUG nova.objects.instance [None req-4443124f-c6c7-4c0f-a795-9f9e6ea0b0ac tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Lazy-loading 'flavor' on Instance uuid 4e1a095f-a2e7-4ab6-bb7e-38cda890d567 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:39:53 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-4443124f-c6c7-4c0f-a795-9f9e6ea0b0ac tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 18:39:53 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:39:53 user nova-compute[72418]:   <source dev="/dev/sdd"/>
Aug 09 18:39:53 user nova-compute[72418]:   <target dev="vdb" bus="virtio"/>
Aug 09 18:39:53 user nova-compute[72418]:   <serial>ba4c6fab-b988-4b6a-904a-2434e61b294c</serial>
Aug 09 18:39:53 user nova-compute[72418]: </disk>
Aug 09 18:39:53 user nova-compute[72418]:  {{(pid=72418) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 18:39:54 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-4443124f-c6c7-4c0f-a795-9f9e6ea0b0ac tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:39:54 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-4443124f-c6c7-4c0f-a795-9f9e6ea0b0ac tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:39:54 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-4443124f-c6c7-4c0f-a795-9f9e6ea0b0ac tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] No VIF found with MAC fa:16:3e:42:1f:2f, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:39:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-4443124f-c6c7-4c0f-a795-9f9e6ea0b0ac tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Lock "4e1a095f-a2e7-4ab6-bb7e-38cda890d567" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.762s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:39:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-786522d0-6fe4-4703-bb79-fb1afe36ef35 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquiring lock "e582b61c-d998-4a3f-8392-a7f0e94a4dec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:39:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-786522d0-6fe4-4703-bb79-fb1afe36ef35 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "e582b61c-d998-4a3f-8392-a7f0e94a4dec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:39:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-786522d0-6fe4-4703-bb79-fb1afe36ef35 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquiring lock "e582b61c-d998-4a3f-8392-a7f0e94a4dec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:39:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-786522d0-6fe4-4703-bb79-fb1afe36ef35 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "e582b61c-d998-4a3f-8392-a7f0e94a4dec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:39:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-786522d0-6fe4-4703-bb79-fb1afe36ef35 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "e582b61c-d998-4a3f-8392-a7f0e94a4dec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:39:54 user nova-compute[72418]: INFO nova.compute.manager [None req-786522d0-6fe4-4703-bb79-fb1afe36ef35 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Terminating instance
Aug 09 18:39:54 user nova-compute[72418]: DEBUG nova.compute.manager [None req-786522d0-6fe4-4703-bb79-fb1afe36ef35 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Start destroying the instance on the hypervisor. {{(pid=72418) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 18:39:54 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:39:54 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:39:55 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:39:55 user nova-compute[72418]: DEBUG nova.compute.manager [req-d313d632-00d9-4b03-9740-4bfbdddf38a6 req-0ace09a7-838f-48aa-b793-cca3bcaa093c service nova] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Received event network-vif-unplugged-12a58797-57bf-44b6-8f44-d93bf97dd41f {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:39:55 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-d313d632-00d9-4b03-9740-4bfbdddf38a6 req-0ace09a7-838f-48aa-b793-cca3bcaa093c service nova] Acquiring lock "e582b61c-d998-4a3f-8392-a7f0e94a4dec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:39:55 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-d313d632-00d9-4b03-9740-4bfbdddf38a6 req-0ace09a7-838f-48aa-b793-cca3bcaa093c service nova] Lock "e582b61c-d998-4a3f-8392-a7f0e94a4dec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:39:55 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-d313d632-00d9-4b03-9740-4bfbdddf38a6 req-0ace09a7-838f-48aa-b793-cca3bcaa093c service nova] Lock "e582b61c-d998-4a3f-8392-a7f0e94a4dec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:39:55 user nova-compute[72418]: DEBUG nova.compute.manager [req-d313d632-00d9-4b03-9740-4bfbdddf38a6 req-0ace09a7-838f-48aa-b793-cca3bcaa093c service nova] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] No waiting events found dispatching network-vif-unplugged-12a58797-57bf-44b6-8f44-d93bf97dd41f {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:39:55 user nova-compute[72418]: DEBUG nova.compute.manager [req-d313d632-00d9-4b03-9740-4bfbdddf38a6 req-0ace09a7-838f-48aa-b793-cca3bcaa093c service nova] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Received event network-vif-unplugged-12a58797-57bf-44b6-8f44-d93bf97dd41f for instance with task_state deleting. {{(pid=72418) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 18:39:55 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:39:55 user nova-compute[72418]: INFO nova.compute.manager [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Rescuing
Aug 09 18:39:55 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Acquiring lock "refresh_cache-4e1a095f-a2e7-4ab6-bb7e-38cda890d567" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:39:55 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Acquired lock "refresh_cache-4e1a095f-a2e7-4ab6-bb7e-38cda890d567" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:39:55 user nova-compute[72418]: DEBUG nova.network.neutron [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:39:55 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Instance destroyed successfully.
Aug 09 18:39:55 user nova-compute[72418]: DEBUG nova.objects.instance [None req-786522d0-6fe4-4703-bb79-fb1afe36ef35 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lazy-loading 'resources' on Instance uuid e582b61c-d998-4a3f-8392-a7f0e94a4dec {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:39:55 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-786522d0-6fe4-4703-bb79-fb1afe36ef35 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:30:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-968235622',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-968235622',id=24,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:30:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52e5863cda54487682a4edcc24202c91',ramdisk_id='',reservation_id='r-nvwts06c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1120385592',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:32:28Z,user_data=None,user_id='621fd2b971c543d197a354c38e0d1867',uuid=e582b61c-d998-4a3f-8392-a7f0e94a4dec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "12a58797-57bf-44b6-8f44-d93bf97dd41f", "address": "fa:16:3e:18:83:79", "network": {"id": "beaefb5c-f5e4-47e7-ab68-60131f532ade", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e5863cda54487682a4edcc24202c91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a58797-57", "ovs_interfaceid": "12a58797-57bf-44b6-8f44-d93bf97dd41f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 18:39:55 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-786522d0-6fe4-4703-bb79-fb1afe36ef35 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Converting VIF {"id": "12a58797-57bf-44b6-8f44-d93bf97dd41f", "address": "fa:16:3e:18:83:79", "network": {"id": "beaefb5c-f5e4-47e7-ab68-60131f532ade", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e5863cda54487682a4edcc24202c91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a58797-57", "ovs_interfaceid": "12a58797-57bf-44b6-8f44-d93bf97dd41f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:39:55 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-786522d0-6fe4-4703-bb79-fb1afe36ef35 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:83:79,bridge_name='br-int',has_traffic_filtering=True,id=12a58797-57bf-44b6-8f44-d93bf97dd41f,network=Network(beaefb5c-f5e4-47e7-ab68-60131f532ade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12a58797-57') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:39:55 user nova-compute[72418]: DEBUG os_vif [None req-786522d0-6fe4-4703-bb79-fb1afe36ef35 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:83:79,bridge_name='br-int',has_traffic_filtering=True,id=12a58797-57bf-44b6-8f44-d93bf97dd41f,network=Network(beaefb5c-f5e4-47e7-ab68-60131f532ade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12a58797-57') {{(pid=72418) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 18:39:55 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:39:55 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap12a58797-57, bridge=br-int, if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:39:55 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:39:55 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:39:55 user nova-compute[72418]: INFO os_vif [None req-786522d0-6fe4-4703-bb79-fb1afe36ef35 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:83:79,bridge_name='br-int',has_traffic_filtering=True,id=12a58797-57bf-44b6-8f44-d93bf97dd41f,network=Network(beaefb5c-f5e4-47e7-ab68-60131f532ade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12a58797-57')
Aug 09 18:39:55 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-786522d0-6fe4-4703-bb79-fb1afe36ef35 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Deleting instance files /opt/stack/data/nova/instances/e582b61c-d998-4a3f-8392-a7f0e94a4dec_del
Aug 09 18:39:55 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-786522d0-6fe4-4703-bb79-fb1afe36ef35 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Deletion of /opt/stack/data/nova/instances/e582b61c-d998-4a3f-8392-a7f0e94a4dec_del complete
Aug 09 18:39:55 user nova-compute[72418]: INFO nova.compute.manager [None req-786522d0-6fe4-4703-bb79-fb1afe36ef35 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 09 18:39:55 user nova-compute[72418]: DEBUG oslo.service.loopingcall [None req-786522d0-6fe4-4703-bb79-fb1afe36ef35 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72418) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 18:39:55 user nova-compute[72418]: DEBUG nova.compute.manager [-] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Deallocating network for instance {{(pid=72418) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 18:39:55 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] deallocate_for_instance() {{(pid=72418) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 18:39:55 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:39:56 user nova-compute[72418]: DEBUG nova.network.neutron [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Updating instance_info_cache with network_info: [{"id": "e6df16f7-7151-450f-bbf8-dc3be066011e", "address": "fa:16:3e:42:1f:2f", "network": {"id": "aa563713-99b7-4830-bbc5-5390076a264d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1029161501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99d09208fba747f29a90f95c5bb5ee4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6df16f7-71", "ovs_interfaceid": "e6df16f7-7151-450f-bbf8-dc3be066011e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:39:56 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Releasing lock "refresh_cache-4e1a095f-a2e7-4ab6-bb7e-38cda890d567" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:39:57 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:39:57 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:39:57 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:39:57 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:39:57 user nova-compute[72418]: DEBUG nova.compute.manager [req-0013002a-ba97-4583-b63e-cc1b931dccd1 req-fb15711b-9edc-4380-a18d-c6cdf89e4d29 service nova] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Received event network-vif-plugged-12a58797-57bf-44b6-8f44-d93bf97dd41f {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:39:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-0013002a-ba97-4583-b63e-cc1b931dccd1 req-fb15711b-9edc-4380-a18d-c6cdf89e4d29 service nova] Acquiring lock "e582b61c-d998-4a3f-8392-a7f0e94a4dec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:39:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-0013002a-ba97-4583-b63e-cc1b931dccd1 req-fb15711b-9edc-4380-a18d-c6cdf89e4d29 service nova] Lock "e582b61c-d998-4a3f-8392-a7f0e94a4dec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:39:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-0013002a-ba97-4583-b63e-cc1b931dccd1 req-fb15711b-9edc-4380-a18d-c6cdf89e4d29 service nova] Lock "e582b61c-d998-4a3f-8392-a7f0e94a4dec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:39:57 user nova-compute[72418]: DEBUG nova.compute.manager [req-0013002a-ba97-4583-b63e-cc1b931dccd1 req-fb15711b-9edc-4380-a18d-c6cdf89e4d29 service nova] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] No waiting events found dispatching network-vif-plugged-12a58797-57bf-44b6-8f44-d93bf97dd41f {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:39:57 user nova-compute[72418]: WARNING nova.compute.manager [req-0013002a-ba97-4583-b63e-cc1b931dccd1 req-fb15711b-9edc-4380-a18d-c6cdf89e4d29 service nova] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Received unexpected event network-vif-plugged-12a58797-57bf-44b6-8f44-d93bf97dd41f for instance with vm_state active and task_state deleting.
Aug 09 18:39:57 user nova-compute[72418]: DEBUG nova.compute.manager [req-804cccf1-2bd9-4069-b1e3-51773ce2c39f req-8409f118-6629-4294-b2ca-af269e211fd4 service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Received event network-vif-unplugged-e6df16f7-7151-450f-bbf8-dc3be066011e {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:39:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-804cccf1-2bd9-4069-b1e3-51773ce2c39f req-8409f118-6629-4294-b2ca-af269e211fd4 service nova] Acquiring lock "4e1a095f-a2e7-4ab6-bb7e-38cda890d567-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:39:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-804cccf1-2bd9-4069-b1e3-51773ce2c39f req-8409f118-6629-4294-b2ca-af269e211fd4 service nova] Lock "4e1a095f-a2e7-4ab6-bb7e-38cda890d567-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.008s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:39:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-804cccf1-2bd9-4069-b1e3-51773ce2c39f req-8409f118-6629-4294-b2ca-af269e211fd4 service nova] Lock "4e1a095f-a2e7-4ab6-bb7e-38cda890d567-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:39:57 user nova-compute[72418]: DEBUG nova.compute.manager [req-804cccf1-2bd9-4069-b1e3-51773ce2c39f req-8409f118-6629-4294-b2ca-af269e211fd4 service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] No waiting events found dispatching network-vif-unplugged-e6df16f7-7151-450f-bbf8-dc3be066011e {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:39:57 user nova-compute[72418]: WARNING nova.compute.manager [req-804cccf1-2bd9-4069-b1e3-51773ce2c39f req-8409f118-6629-4294-b2ca-af269e211fd4 service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Received unexpected event network-vif-unplugged-e6df16f7-7151-450f-bbf8-dc3be066011e for instance with vm_state active and task_state rescuing.
Aug 09 18:39:57 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:39:57 user nova-compute[72418]: DEBUG nova.compute.manager [req-fe7c7caf-c41b-4cb5-88f2-3548cbf78464 req-2ea28462-3384-480e-9537-19f0292da314 service nova] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Received event network-vif-deleted-12a58797-57bf-44b6-8f44-d93bf97dd41f {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:39:57 user nova-compute[72418]: INFO nova.compute.manager [req-fe7c7caf-c41b-4cb5-88f2-3548cbf78464 req-2ea28462-3384-480e-9537-19f0292da314 service nova] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Neutron deleted interface 12a58797-57bf-44b6-8f44-d93bf97dd41f; detaching it from the instance and deleting it from the info cache
Aug 09 18:39:57 user nova-compute[72418]: DEBUG nova.network.neutron [req-fe7c7caf-c41b-4cb5-88f2-3548cbf78464 req-2ea28462-3384-480e-9537-19f0292da314 service nova] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:39:57 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Took 1.82 seconds to deallocate network for instance.
Aug 09 18:39:57 user nova-compute[72418]: DEBUG nova.compute.manager [req-fe7c7caf-c41b-4cb5-88f2-3548cbf78464 req-2ea28462-3384-480e-9537-19f0292da314 service nova] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Detach interface failed, port_id=12a58797-57bf-44b6-8f44-d93bf97dd41f, reason: Instance e582b61c-d998-4a3f-8392-a7f0e94a4dec could not be found. {{(pid=72418) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 18:39:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-786522d0-6fe4-4703-bb79-fb1afe36ef35 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:39:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-786522d0-6fe4-4703-bb79-fb1afe36ef35 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:39:57 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:39:57 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Instance destroyed successfully.
Aug 09 18:39:57 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Attempting a stable device rescue
Aug 09 18:39:57 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=72418) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 09 18:39:57 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Instance directory exists: not creating {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 18:39:57 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Creating image(s)
Aug 09 18:39:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Acquiring lock "/opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:39:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Lock "/opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:39:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Lock "/opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:39:57 user nova-compute[72418]: DEBUG nova.objects.instance [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4e1a095f-a2e7-4ab6-bb7e-38cda890d567 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:39:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Acquiring lock "ca7f121ddbfe94092f935207cfdf3105891a6c3f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:39:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Lock "ca7f121ddbfe94092f935207cfdf3105891a6c3f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:39:57 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:39:57 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-786522d0-6fe4-4703-bb79-fb1afe36ef35 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:39:57 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-786522d0-6fe4-4703-bb79-fb1afe36ef35 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:39:58 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-786522d0-6fe4-4703-bb79-fb1afe36ef35 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.394s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:39:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca7f121ddbfe94092f935207cfdf3105891a6c3f.part --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:39:59 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:39:59 user nova-compute[72418]: INFO nova.scheduler.client.report [None req-786522d0-6fe4-4703-bb79-fb1afe36ef35 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Deleted allocations for instance e582b61c-d998-4a3f-8392-a7f0e94a4dec
Aug 09 18:39:59 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:39:59 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72418) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 18:39:59 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-527c91a1-4580-428c-8d7e-0b9de628507d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Acquiring lock "2c9e974b-b993-4f4e-9446-14941c39f109" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:39:59 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-527c91a1-4580-428c-8d7e-0b9de628507d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "2c9e974b-b993-4f4e-9446-14941c39f109" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:39:59 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-527c91a1-4580-428c-8d7e-0b9de628507d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Acquiring lock "2c9e974b-b993-4f4e-9446-14941c39f109-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:39:59 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-527c91a1-4580-428c-8d7e-0b9de628507d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "2c9e974b-b993-4f4e-9446-14941c39f109-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:39:59 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-527c91a1-4580-428c-8d7e-0b9de628507d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "2c9e974b-b993-4f4e-9446-14941c39f109-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:39:59 user nova-compute[72418]: INFO nova.compute.manager [None req-527c91a1-4580-428c-8d7e-0b9de628507d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Terminating instance
Aug 09 18:39:59 user nova-compute[72418]: DEBUG nova.compute.manager [None req-527c91a1-4580-428c-8d7e-0b9de628507d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Start destroying the instance on the hypervisor. {{(pid=72418) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 18:39:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca7f121ddbfe94092f935207cfdf3105891a6c3f.part --force-share --output=json" returned: 0 in 0.150s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:39:59 user nova-compute[72418]: DEBUG nova.virt.images [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] 8371a9d0-c9a1-47ea-a86e-58603a82eeab was qcow2, converting to raw {{(pid=72418) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 18:39:59 user nova-compute[72418]: DEBUG nova.privsep.utils [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72418) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 18:39:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ca7f121ddbfe94092f935207cfdf3105891a6c3f.part /opt/stack/data/nova/instances/_base/ca7f121ddbfe94092f935207cfdf3105891a6c3f.converted {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:39:59 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-786522d0-6fe4-4703-bb79-fb1afe36ef35 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "e582b61c-d998-4a3f-8392-a7f0e94a4dec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.542s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:39:59 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:39:59 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:39:59 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:39:59 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:39:59 user nova-compute[72418]: DEBUG nova.compute.manager [req-289e802e-d417-4b94-adde-d2d72a14c6da req-96dd4dda-2582-4ebf-a325-3c921fd65f09 service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Received event network-vif-plugged-e6df16f7-7151-450f-bbf8-dc3be066011e {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:39:59 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-289e802e-d417-4b94-adde-d2d72a14c6da req-96dd4dda-2582-4ebf-a325-3c921fd65f09 service nova] Acquiring lock "4e1a095f-a2e7-4ab6-bb7e-38cda890d567-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:39:59 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-289e802e-d417-4b94-adde-d2d72a14c6da req-96dd4dda-2582-4ebf-a325-3c921fd65f09 service nova] Lock "4e1a095f-a2e7-4ab6-bb7e-38cda890d567-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:39:59 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-289e802e-d417-4b94-adde-d2d72a14c6da req-96dd4dda-2582-4ebf-a325-3c921fd65f09 service nova] Lock "4e1a095f-a2e7-4ab6-bb7e-38cda890d567-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:39:59 user nova-compute[72418]: DEBUG nova.compute.manager [req-289e802e-d417-4b94-adde-d2d72a14c6da req-96dd4dda-2582-4ebf-a325-3c921fd65f09 service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] No waiting events found dispatching network-vif-plugged-e6df16f7-7151-450f-bbf8-dc3be066011e {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:39:59 user nova-compute[72418]: WARNING nova.compute.manager [req-289e802e-d417-4b94-adde-d2d72a14c6da req-96dd4dda-2582-4ebf-a325-3c921fd65f09 service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Received unexpected event network-vif-plugged-e6df16f7-7151-450f-bbf8-dc3be066011e for instance with vm_state active and task_state rescuing.
Aug 09 18:39:59 user nova-compute[72418]: DEBUG nova.compute.manager [req-da352f4a-4c48-4550-8a7e-db67801aa4a8 req-c22cde7b-ac20-4ffe-b9c5-c44a288a57bd service nova] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Received event network-changed-1fa6e320-1b1b-41dc-8204-a7bed1172292 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:39:59 user nova-compute[72418]: DEBUG nova.compute.manager [req-da352f4a-4c48-4550-8a7e-db67801aa4a8 req-c22cde7b-ac20-4ffe-b9c5-c44a288a57bd service nova] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Refreshing instance network info cache due to event network-changed-1fa6e320-1b1b-41dc-8204-a7bed1172292. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:39:59 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-da352f4a-4c48-4550-8a7e-db67801aa4a8 req-c22cde7b-ac20-4ffe-b9c5-c44a288a57bd service nova] Acquiring lock "refresh_cache-2c9e974b-b993-4f4e-9446-14941c39f109" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:39:59 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-da352f4a-4c48-4550-8a7e-db67801aa4a8 req-c22cde7b-ac20-4ffe-b9c5-c44a288a57bd service nova] Acquired lock "refresh_cache-2c9e974b-b993-4f4e-9446-14941c39f109" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:39:59 user nova-compute[72418]: DEBUG nova.network.neutron [req-da352f4a-4c48-4550-8a7e-db67801aa4a8 req-c22cde7b-ac20-4ffe-b9c5-c44a288a57bd service nova] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Refreshing network info cache for port 1fa6e320-1b1b-41dc-8204-a7bed1172292 {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:39:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ca7f121ddbfe94092f935207cfdf3105891a6c3f.part /opt/stack/data/nova/instances/_base/ca7f121ddbfe94092f935207cfdf3105891a6c3f.converted" returned: 0 in 0.679s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:39:59 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca7f121ddbfe94092f935207cfdf3105891a6c3f.converted --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca7f121ddbfe94092f935207cfdf3105891a6c3f.converted --force-share --output=json" returned: 0 in 0.164s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Lock "ca7f121ddbfe94092f935207cfdf3105891a6c3f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.218s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Acquiring lock "ca7f121ddbfe94092f935207cfdf3105891a6c3f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Lock "ca7f121ddbfe94092f935207cfdf3105891a6c3f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca7f121ddbfe94092f935207cfdf3105891a6c3f --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:40:00 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Instance destroyed successfully.
Aug 09 18:40:00 user nova-compute[72418]: DEBUG nova.objects.instance [None req-527c91a1-4580-428c-8d7e-0b9de628507d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lazy-loading 'resources' on Instance uuid 2c9e974b-b993-4f4e-9446-14941c39f109 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-527c91a1-4580-428c-8d7e-0b9de628507d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:32:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-564523231',display_name='tempest-TestStampPattern-server-564523231',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-564523231',id=26,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyuC2STmNW21KgmVvu2UdySlXVI+0J2CQB6cC/06BFGS91M3K5pktxtEHOvDqMzVGj1CpM11aZmLQ8ny2sqKin/VSPS9fza7lm5UGhSckLWpV1uBCIlOPx80Bbo9A16oA==',key_name='tempest-TestStampPattern-872776389',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:32:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ce18df915bca48109597ad4aa8f1d116',ramdisk_id='',reservation_id='r-9tx2gsbh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1349806997',owner_user_name='tempest-TestStampPattern-1349806997-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:35:53Z,user_data=None,user_id='2af66759bfa54ffba6174c4f95a83789',uuid=2c9e974b-b993-4f4e-9446-14941c39f109,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1fa6e320-1b1b-41dc-8204-a7bed1172292", "address": "fa:16:3e:06:d3:3a", "network": {"id": "0fbd02ef-7c74-46c2-a09c-3b69be222ffa", "bridge": "br-int", "label": "tempest-TestStampPattern-85008345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce18df915bca48109597ad4aa8f1d116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fa6e320-1b", "ovs_interfaceid": "1fa6e320-1b1b-41dc-8204-a7bed1172292", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-527c91a1-4580-428c-8d7e-0b9de628507d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Converting VIF {"id": "1fa6e320-1b1b-41dc-8204-a7bed1172292", "address": "fa:16:3e:06:d3:3a", "network": {"id": "0fbd02ef-7c74-46c2-a09c-3b69be222ffa", "bridge": "br-int", "label": "tempest-TestStampPattern-85008345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce18df915bca48109597ad4aa8f1d116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fa6e320-1b", "ovs_interfaceid": "1fa6e320-1b1b-41dc-8204-a7bed1172292", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-527c91a1-4580-428c-8d7e-0b9de628507d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:d3:3a,bridge_name='br-int',has_traffic_filtering=True,id=1fa6e320-1b1b-41dc-8204-a7bed1172292,network=Network(0fbd02ef-7c74-46c2-a09c-3b69be222ffa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fa6e320-1b') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG os_vif [None req-527c91a1-4580-428c-8d7e-0b9de628507d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:d3:3a,bridge_name='br-int',has_traffic_filtering=True,id=1fa6e320-1b1b-41dc-8204-a7bed1172292,network=Network(0fbd02ef-7c74-46c2-a09c-3b69be222ffa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fa6e320-1b') {{(pid=72418) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1fa6e320-1b, bridge=br-int, if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca7f121ddbfe94092f935207cfdf3105891a6c3f --force-share --output=json" returned: 0 in 0.169s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca7f121ddbfe94092f935207cfdf3105891a6c3f,backing_fmt=raw /opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/disk.rescue {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:00 user nova-compute[72418]: INFO os_vif [None req-527c91a1-4580-428c-8d7e-0b9de628507d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:d3:3a,bridge_name='br-int',has_traffic_filtering=True,id=1fa6e320-1b1b-41dc-8204-a7bed1172292,network=Network(0fbd02ef-7c74-46c2-a09c-3b69be222ffa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fa6e320-1b')
Aug 09 18:40:00 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-527c91a1-4580-428c-8d7e-0b9de628507d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Deleting instance files /opt/stack/data/nova/instances/2c9e974b-b993-4f4e-9446-14941c39f109_del
Aug 09 18:40:00 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-527c91a1-4580-428c-8d7e-0b9de628507d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Deletion of /opt/stack/data/nova/instances/2c9e974b-b993-4f4e-9446-14941c39f109_del complete
Aug 09 18:40:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca7f121ddbfe94092f935207cfdf3105891a6c3f,backing_fmt=raw /opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/disk.rescue" returned: 0 in 0.069s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Lock "ca7f121ddbfe94092f935207cfdf3105891a6c3f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG nova.objects.instance [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Lazy-loading 'migration_context' on Instance uuid 4e1a095f-a2e7-4ab6-bb7e-38cda890d567 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Created local disks {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Start _get_guest_xml network_info=[{"id": "e6df16f7-7151-450f-bbf8-dc3be066011e", "address": "fa:16:3e:42:1f:2f", "network": {"id": "aa563713-99b7-4830-bbc5-5390076a264d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1029161501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1029161501-network", "vif_mac": "fa:16:3e:42:1f:2f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99d09208fba747f29a90f95c5bb5ee4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6df16f7-71", "ovs_interfaceid": "e6df16f7-7151-450f-bbf8-dc3be066011e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '8371a9d0-c9a1-47ea-a86e-58603a82eeab', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'attachment_id': 'cf8562dc-b212-4833-a43b-2cf1260a99ab', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PCJXLeFp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '4e1a095f-a2e7-4ab6-bb7e-38cda890d567', 'attached_at': '', 'detached_at': '', 'volume_id': 'ba4c6fab-b988-4b6a-904a-2434e61b294c', 'serial': 'ba4c6fab-b988-4b6a-904a-2434e61b294c'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'volume_type': None} {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG nova.objects.instance [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Lazy-loading 'resources' on Instance uuid 4e1a095f-a2e7-4ab6-bb7e-38cda890d567 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG nova.objects.instance [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Lazy-loading 'numa_topology' on Instance uuid 4e1a095f-a2e7-4ab6-bb7e-38cda890d567 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:40:00 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:40:00 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:40:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] CPU controller missing on host. {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] CPU controller found on host. {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72418) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T18:17:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Flavor limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Image limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Flavor pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Image pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Got 1 possible topologies {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG nova.objects.instance [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4e1a095f-a2e7-4ab6-bb7e-38cda890d567 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Calling os-brick to attach iSCSI Volume {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PCJXLeFp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:40:00 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:40:00 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:40:00 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:40:00 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:40:00 user nova-compute[72418]: INFO os_brick.initiator.connectors.iscsi [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 18:40:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c -p 172.16.0.220:3260 {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:40:00 user nova-compute[72418]: INFO nova.compute.manager [None req-527c91a1-4580-428c-8d7e-0b9de628507d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Took 1.31 seconds to destroy the instance on the hypervisor.
Aug 09 18:40:00 user nova-compute[72418]: DEBUG oslo.service.loopingcall [None req-527c91a1-4580-428c-8d7e-0b9de628507d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72418) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG nova.compute.manager [-] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Deallocating network for instance {{(pid=72418) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] deallocate_for_instance() {{(pid=72418) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c -p 172.16.0.220:3260" returned: 0 in 0.026s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[f207cd9d-ea9f-4267-93ba-7aff84561793]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = PCJXLeFp\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 09 18:40:00 user nova-compute[72418]: node.name = iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c
Aug 09 18:40:00 user nova-compute[72418]: node.tpgt = -1
Aug 09 18:40:00 user nova-compute[72418]: node.startup = automatic
Aug 09 18:40:00 user nova-compute[72418]: node.leading_login = No
Aug 09 18:40:00 user nova-compute[72418]: iface.iscsi_ifacename = default
Aug 09 18:40:00 user nova-compute[72418]: iface.net_ifacename = <empty>
Aug 09 18:40:00 user nova-compute[72418]: iface.ipaddress = <empty>
Aug 09 18:40:00 user nova-compute[72418]: iface.prefix_len = 0
Aug 09 18:40:00 user nova-compute[72418]: iface.hwaddress = <empty>
Aug 09 18:40:00 user nova-compute[72418]: iface.transport_name = tcp
Aug 09 18:40:00 user nova-compute[72418]: iface.initiatorname = <empty>
Aug 09 18:40:00 user nova-compute[72418]: iface.state = <empty>
Aug 09 18:40:00 user nova-compute[72418]: iface.vlan_id = 0
Aug 09 18:40:00 user nova-compute[72418]: iface.vlan_priority = 0
Aug 09 18:40:00 user nova-compute[72418]: iface.vlan_state = <empty>
Aug 09 18:40:00 user nova-compute[72418]: iface.iface_num = 0
Aug 09 18:40:00 user nova-compute[72418]: iface.mtu = 0
Aug 09 18:40:00 user nova-compute[72418]: iface.port = 0
Aug 09 18:40:00 user nova-compute[72418]: iface.bootproto = <empty>
Aug 09 18:40:00 user nova-compute[72418]: iface.subnet_mask = <empty>
Aug 09 18:40:00 user nova-compute[72418]: iface.gateway = <empty>
Aug 09 18:40:00 user nova-compute[72418]: iface.dhcp_alt_client_id_state = <empty>
Aug 09 18:40:00 user nova-compute[72418]: iface.dhcp_alt_client_id = <empty>
Aug 09 18:40:00 user nova-compute[72418]: iface.dhcp_dns = <empty>
Aug 09 18:40:00 user nova-compute[72418]: iface.dhcp_learn_iqn = <empty>
Aug 09 18:40:00 user nova-compute[72418]: iface.dhcp_req_vendor_id_state = <empty>
Aug 09 18:40:00 user nova-compute[72418]: iface.dhcp_vendor_id_state = <empty>
Aug 09 18:40:00 user nova-compute[72418]: iface.dhcp_vendor_id = <empty>
Aug 09 18:40:00 user nova-compute[72418]: iface.dhcp_slp_da = <empty>
Aug 09 18:40:00 user nova-compute[72418]: iface.fragmentation = <empty>
Aug 09 18:40:00 user nova-compute[72418]: iface.gratuitous_arp = <empty>
Aug 09 18:40:00 user nova-compute[72418]: iface.incoming_forwarding = <empty>
Aug 09 18:40:00 user nova-compute[72418]: iface.tos_state = <empty>
Aug 09 18:40:00 user nova-compute[72418]: iface.tos = 0
Aug 09 18:40:00 user nova-compute[72418]: iface.ttl = 0
Aug 09 18:40:00 user nova-compute[72418]: iface.delayed_ack = <empty>
Aug 09 18:40:00 user nova-compute[72418]: iface.tcp_nagle = <empty>
Aug 09 18:40:00 user nova-compute[72418]: iface.tcp_wsf_state = <empty>
Aug 09 18:40:00 user nova-compute[72418]: iface.tcp_wsf = 0
Aug 09 18:40:00 user nova-compute[72418]: iface.tcp_timer_scale = 0
Aug 09 18:40:00 user nova-compute[72418]: iface.tcp_timestamp = <empty>
Aug 09 18:40:00 user nova-compute[72418]: iface.redirect = <empty>
Aug 09 18:40:00 user nova-compute[72418]: iface.def_task_mgmt_timeout = 0
Aug 09 18:40:00 user nova-compute[72418]: iface.header_digest = <empty>
Aug 09 18:40:00 user nova-compute[72418]: iface.data_digest = <empty>
Aug 09 18:40:00 user nova-compute[72418]: iface.immediate_data = <empty>
Aug 09 18:40:00 user nova-compute[72418]: iface.initial_r2t = <empty>
Aug 09 18:40:00 user nova-compute[72418]: iface.data_seq_inorder = <empty>
Aug 09 18:40:00 user nova-compute[72418]: iface.data_pdu_inorder = <empty>
Aug 09 18:40:00 user nova-compute[72418]: iface.erl = 0
Aug 09 18:40:00 user nova-compute[72418]: iface.max_receive_data_len = 0
Aug 09 18:40:00 user nova-compute[72418]: iface.first_burst_len = 0
Aug 09 18:40:00 user nova-compute[72418]: iface.max_outstanding_r2t = 0
Aug 09 18:40:00 user nova-compute[72418]: iface.max_burst_len = 0
Aug 09 18:40:00 user nova-compute[72418]: iface.chap_auth = <empty>
Aug 09 18:40:00 user nova-compute[72418]: iface.bidi_chap = <empty>
Aug 09 18:40:00 user nova-compute[72418]: iface.strict_login_compliance = <empty>
Aug 09 18:40:00 user nova-compute[72418]: iface.discovery_auth = <empty>
Aug 09 18:40:00 user nova-compute[72418]: iface.discovery_logout = <empty>
Aug 09 18:40:00 user nova-compute[72418]: node.discovery_address = <empty>
Aug 09 18:40:00 user nova-compute[72418]: node.discovery_port = 0
Aug 09 18:40:00 user nova-compute[72418]: node.discovery_type = static
Aug 09 18:40:00 user nova-compute[72418]: node.session.initial_cmdsn = 0
Aug 09 18:40:00 user nova-compute[72418]: node.session.initial_login_retry_max = 8
Aug 09 18:40:00 user nova-compute[72418]: node.session.xmit_thread_priority = -20
Aug 09 18:40:00 user nova-compute[72418]: node.session.cmds_max = 128
Aug 09 18:40:00 user nova-compute[72418]: node.session.queue_depth = 32
Aug 09 18:40:00 user nova-compute[72418]: node.session.nr_sessions = 1
Aug 09 18:40:00 user nova-compute[72418]: node.session.auth.authmethod = CHAP
Aug 09 18:40:00 user nova-compute[72418]: node.session.auth.username = PCJXLeFp
Aug 09 18:40:00 user nova-compute[72418]: node.session.auth.password = ***
Aug 09 18:40:00 user nova-compute[72418]: node.session.auth.username_in = <empty>
Aug 09 18:40:00 user nova-compute[72418]: node.session.auth.password_in = <empty>
Aug 09 18:40:00 user nova-compute[72418]: node.session.auth.chap_algs = MD5
Aug 09 18:40:00 user nova-compute[72418]: node.session.timeo.replacement_timeout = 120
Aug 09 18:40:00 user nova-compute[72418]: node.session.err_timeo.abort_timeout = 15
Aug 09 18:40:00 user nova-compute[72418]: node.session.err_timeo.lu_reset_timeout = 30
Aug 09 18:40:00 user nova-compute[72418]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 09 18:40:00 user nova-compute[72418]: node.session.err_timeo.host_reset_timeout = 60
Aug 09 18:40:00 user nova-compute[72418]: node.session.iscsi.FastAbort = Yes
Aug 09 18:40:00 user nova-compute[72418]: node.session.iscsi.InitialR2T = No
Aug 09 18:40:00 user nova-compute[72418]: node.session.iscsi.ImmediateData = Yes
Aug 09 18:40:00 user nova-compute[72418]: node.session.iscsi.FirstBurstLength = 262144
Aug 09 18:40:00 user nova-compute[72418]: node.session.iscsi.MaxBurstLength = 16776192
Aug 09 18:40:00 user nova-compute[72418]: node.session.iscsi.DefaultTime2Retain = 0
Aug 09 18:40:00 user nova-compute[72418]: node.session.iscsi.DefaultTime2Wait = 2
Aug 09 18:40:00 user nova-compute[72418]: node.session.iscsi.MaxConnections = 1
Aug 09 18:40:00 user nova-compute[72418]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 09 18:40:00 user nova-compute[72418]: node.session.iscsi.ERL = 0
Aug 09 18:40:00 user nova-compute[72418]: node.session.scan = manual
Aug 09 18:40:00 user nova-compute[72418]: node.session.reopen_max = 0
Aug 09 18:40:00 user nova-compute[72418]: node.conn[0].address = 172.16.0.220
Aug 09 18:40:00 user nova-compute[72418]: node.conn[0].port = 3260
Aug 09 18:40:00 user nova-compute[72418]: node.conn[0].startup = manual
Aug 09 18:40:00 user nova-compute[72418]: node.conn[0].tcp.window_size = 524288
Aug 09 18:40:00 user nova-compute[72418]: node.conn[0].tcp.type_of_service = 0
Aug 09 18:40:00 user nova-compute[72418]: node.conn[0].timeo.logout_timeout = 15
Aug 09 18:40:00 user nova-compute[72418]: node.conn[0].timeo.login_timeout = 15
Aug 09 18:40:00 user nova-compute[72418]: node.conn[0].timeo.auth_timeout = 45
Aug 09 18:40:00 user nova-compute[72418]: node.conn[0].timeo.noop_out_interval = 5
Aug 09 18:40:00 user nova-compute[72418]: node.conn[0].timeo.noop_out_timeout = 5
Aug 09 18:40:00 user nova-compute[72418]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 09 18:40:00 user nova-compute[72418]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 09 18:40:00 user nova-compute[72418]: node.conn[0].iscsi.HeaderDigest = None
Aug 09 18:40:00 user nova-compute[72418]: node.conn[0].iscsi.DataDigest = None
Aug 09 18:40:00 user nova-compute[72418]: node.conn[0].iscsi.IFMarker = No
Aug 09 18:40:00 user nova-compute[72418]: node.conn[0].iscsi.OFMarker = No
Aug 09 18:40:00 user nova-compute[72418]: # END RECORD
Aug 09 18:40:00 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed314f49-bddf-4de4-bc0d-cc19335f8a70]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[af483ed2-8e40-45d6-a5b0-3bb12319af8a]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PCJXLeFp {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PCJXLeFp" returned: 0 in 0.031s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ba78a6-189a-4a13-a0a6-8240a924629e]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PCJXLeFp'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[208bfaac-896a-407a-ba63-c36a961bf21a]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae21c71-3a5a-4776-bdd9-b00b6c674dc1]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:40:00 user nova-compute[72418]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)
Aug 09 18:40:00 user nova-compute[72418]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c (non-flash)
Aug 09 18:40:00 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:40:00 user nova-compute[72418]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)
Aug 09 18:40:00 user nova-compute[72418]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c (non-flash)
Aug 09 18:40:00 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.204s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Connected to 172.16.0.220:3260 {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] HCTL ('35', '0', '0', 0) found on session 39 with lun 0 {{(pid=72418) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=72418) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.014s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[86368b09-8572-44e5-8635-bd6e1f1a6481]: (4, ('0 0 0', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Searching for a device in session 39 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=72418) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PCJXLeFp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.229s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] <== connect_volume: return (230ms) {'type': 'block', 'scsi_wwn': '26236623433326563', 'path': '/dev/sdd'} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236623433326563', 'path': '/dev/sdd'} {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:35:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-282255292',display_name='tempest-ServerStableDeviceRescueTest-server-282255292',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-282255292',id=32,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgi7F7Tiv948MGw/JMyBSz5f1UT2yZOhFMKoN0Kxyc1NKE7bns5u1xaa+LItbZrpXzqSR4y26XuN7XvDcLQtVjZPLJIQgwHu1xdN7N2Gz0+VfLK4SeEyvDU0D1TyNj8Uw==',key_name='tempest-keypair-376055827',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:36:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='99d09208fba747f29a90f95c5bb5ee4b',ramdisk_id='',reservation_id='r-10tk9714',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-307010011',owner_user_name='tempest-ServerStableDeviceRescueTest-307010011-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:37:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ec7129a7bf6444ab241ca8dc20211fd',uuid=4e1a095f-a2e7-4ab6-bb7e-38cda890d567,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6df16f7-7151-450f-bbf8-dc3be066011e", "address": "fa:16:3e:42:1f:2f", "network": {"id": "aa563713-99b7-4830-bbc5-5390076a264d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1029161501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1029161501-network", "vif_mac": "fa:16:3e:42:1f:2f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99d09208fba747f29a90f95c5bb5ee4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6df16f7-71", "ovs_interfaceid": "e6df16f7-7151-450f-bbf8-dc3be066011e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Converting VIF {"id": "e6df16f7-7151-450f-bbf8-dc3be066011e", "address": "fa:16:3e:42:1f:2f", "network": {"id": "aa563713-99b7-4830-bbc5-5390076a264d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1029161501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1029161501-network", "vif_mac": "fa:16:3e:42:1f:2f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99d09208fba747f29a90f95c5bb5ee4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6df16f7-71", "ovs_interfaceid": "e6df16f7-7151-450f-bbf8-dc3be066011e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:1f:2f,bridge_name='br-int',has_traffic_filtering=True,id=e6df16f7-7151-450f-bbf8-dc3be066011e,network=Network(aa563713-99b7-4830-bbc5-5390076a264d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6df16f7-71') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG nova.objects.instance [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Lazy-loading 'pci_devices' on Instance uuid 4e1a095f-a2e7-4ab6-bb7e-38cda890d567 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] End _get_guest_xml xml=<domain type="kvm">
Aug 09 18:40:00 user nova-compute[72418]:   <uuid>4e1a095f-a2e7-4ab6-bb7e-38cda890d567</uuid>
Aug 09 18:40:00 user nova-compute[72418]:   <name>instance-00000020</name>
Aug 09 18:40:00 user nova-compute[72418]:   <memory>524288</memory>
Aug 09 18:40:00 user nova-compute[72418]:   <vcpu>1</vcpu>
Aug 09 18:40:00 user nova-compute[72418]:   <metadata>
Aug 09 18:40:00 user nova-compute[72418]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:40:00 user nova-compute[72418]:       <nova:package version="0.0.0"/>
Aug 09 18:40:00 user nova-compute[72418]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-282255292</nova:name>
Aug 09 18:40:00 user nova-compute[72418]:       <nova:creationTime>2023-08-09 18:40:00</nova:creationTime>
Aug 09 18:40:00 user nova-compute[72418]:       <nova:flavor name="m1.tiny">
Aug 09 18:40:00 user nova-compute[72418]:         <nova:memory>512</nova:memory>
Aug 09 18:40:00 user nova-compute[72418]:         <nova:disk>1</nova:disk>
Aug 09 18:40:00 user nova-compute[72418]:         <nova:swap>0</nova:swap>
Aug 09 18:40:00 user nova-compute[72418]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:40:00 user nova-compute[72418]:         <nova:vcpus>1</nova:vcpus>
Aug 09 18:40:00 user nova-compute[72418]:       </nova:flavor>
Aug 09 18:40:00 user nova-compute[72418]:       <nova:owner>
Aug 09 18:40:00 user nova-compute[72418]:         <nova:user uuid="8ec7129a7bf6444ab241ca8dc20211fd">tempest-ServerStableDeviceRescueTest-307010011-project-member</nova:user>
Aug 09 18:40:00 user nova-compute[72418]:         <nova:project uuid="99d09208fba747f29a90f95c5bb5ee4b">tempest-ServerStableDeviceRescueTest-307010011</nova:project>
Aug 09 18:40:00 user nova-compute[72418]:       </nova:owner>
Aug 09 18:40:00 user nova-compute[72418]:       <nova:root type="image" uuid="8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e"/>
Aug 09 18:40:00 user nova-compute[72418]:       <nova:ports>
Aug 09 18:40:00 user nova-compute[72418]:         <nova:port uuid="e6df16f7-7151-450f-bbf8-dc3be066011e">
Aug 09 18:40:00 user nova-compute[72418]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 09 18:40:00 user nova-compute[72418]:         </nova:port>
Aug 09 18:40:00 user nova-compute[72418]:       </nova:ports>
Aug 09 18:40:00 user nova-compute[72418]:     </nova:instance>
Aug 09 18:40:00 user nova-compute[72418]:   </metadata>
Aug 09 18:40:00 user nova-compute[72418]:   <sysinfo type="smbios">
Aug 09 18:40:00 user nova-compute[72418]:     <system>
Aug 09 18:40:00 user nova-compute[72418]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 18:40:00 user nova-compute[72418]:       <entry name="product">OpenStack Nova</entry>
Aug 09 18:40:00 user nova-compute[72418]:       <entry name="version">0.0.0</entry>
Aug 09 18:40:00 user nova-compute[72418]:       <entry name="serial">4e1a095f-a2e7-4ab6-bb7e-38cda890d567</entry>
Aug 09 18:40:00 user nova-compute[72418]:       <entry name="uuid">4e1a095f-a2e7-4ab6-bb7e-38cda890d567</entry>
Aug 09 18:40:00 user nova-compute[72418]:       <entry name="family">Virtual Machine</entry>
Aug 09 18:40:00 user nova-compute[72418]:     </system>
Aug 09 18:40:00 user nova-compute[72418]:   </sysinfo>
Aug 09 18:40:00 user nova-compute[72418]:   <os>
Aug 09 18:40:00 user nova-compute[72418]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 18:40:00 user nova-compute[72418]:     <smbios mode="sysinfo"/>
Aug 09 18:40:00 user nova-compute[72418]:   </os>
Aug 09 18:40:00 user nova-compute[72418]:   <features>
Aug 09 18:40:00 user nova-compute[72418]:     <acpi/>
Aug 09 18:40:00 user nova-compute[72418]:     <apic/>
Aug 09 18:40:00 user nova-compute[72418]:     <vmcoreinfo/>
Aug 09 18:40:00 user nova-compute[72418]:   </features>
Aug 09 18:40:00 user nova-compute[72418]:   <clock offset="utc">
Aug 09 18:40:00 user nova-compute[72418]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 18:40:00 user nova-compute[72418]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 18:40:00 user nova-compute[72418]:     <timer name="hpet" present="no"/>
Aug 09 18:40:00 user nova-compute[72418]:   </clock>
Aug 09 18:40:00 user nova-compute[72418]:   <cpu mode="custom" match="exact">
Aug 09 18:40:00 user nova-compute[72418]:     <model>Nehalem</model>
Aug 09 18:40:00 user nova-compute[72418]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 18:40:00 user nova-compute[72418]:   </cpu>
Aug 09 18:40:00 user nova-compute[72418]:   <devices>
Aug 09 18:40:00 user nova-compute[72418]:     <disk type="file" device="disk">
Aug 09 18:40:00 user nova-compute[72418]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 18:40:00 user nova-compute[72418]:       <source file="/opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/disk"/>
Aug 09 18:40:00 user nova-compute[72418]:       <target dev="vda" bus="virtio"/>
Aug 09 18:40:00 user nova-compute[72418]:     </disk>
Aug 09 18:40:00 user nova-compute[72418]:     <disk type="block" device="disk">
Aug 09 18:40:00 user nova-compute[72418]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:40:00 user nova-compute[72418]:       <source dev="/dev/sdd"/>
Aug 09 18:40:00 user nova-compute[72418]:       <target dev="vdb" bus="virtio"/>
Aug 09 18:40:00 user nova-compute[72418]:       <serial>ba4c6fab-b988-4b6a-904a-2434e61b294c</serial>
Aug 09 18:40:00 user nova-compute[72418]:     </disk>
Aug 09 18:40:00 user nova-compute[72418]:     <disk type="file" device="disk">
Aug 09 18:40:00 user nova-compute[72418]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 18:40:00 user nova-compute[72418]:       <source file="/opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/disk.rescue"/>
Aug 09 18:40:00 user nova-compute[72418]:       <target dev="vdc" bus="virtio"/>
Aug 09 18:40:00 user nova-compute[72418]:       <boot order="1"/>
Aug 09 18:40:00 user nova-compute[72418]:     </disk>
Aug 09 18:40:00 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:40:00 user nova-compute[72418]:       <mac address="fa:16:3e:42:1f:2f"/>
Aug 09 18:40:00 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:40:00 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:40:00 user nova-compute[72418]:       <target dev="tape6df16f7-71"/>
Aug 09 18:40:00 user nova-compute[72418]:     </interface>
Aug 09 18:40:00 user nova-compute[72418]:     <serial type="pty">
Aug 09 18:40:00 user nova-compute[72418]:       <log file="/opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/console.log" append="off"/>
Aug 09 18:40:00 user nova-compute[72418]:     </serial>
Aug 09 18:40:00 user nova-compute[72418]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 18:40:00 user nova-compute[72418]:     <video>
Aug 09 18:40:00 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:40:00 user nova-compute[72418]:     </video>
Aug 09 18:40:00 user nova-compute[72418]:     <rng model="virtio">
Aug 09 18:40:00 user nova-compute[72418]:       <backend model="random">/dev/urandom</backend>
Aug 09 18:40:00 user nova-compute[72418]:     </rng>
Aug 09 18:40:00 user nova-compute[72418]:     <controller type="usb" index="0" model="none"/>
Aug 09 18:40:00 user nova-compute[72418]:     <memballoon model="virtio">
Aug 09 18:40:00 user nova-compute[72418]:       <stats period="10"/>
Aug 09 18:40:00 user nova-compute[72418]:     </memballoon>
Aug 09 18:40:00 user nova-compute[72418]:   </devices>
Aug 09 18:40:00 user nova-compute[72418]: </domain>
Aug 09 18:40:00 user nova-compute[72418]:  {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 18:40:00 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Instance destroyed successfully.
Aug 09 18:40:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] No VIF found with MAC fa:16:3e:42:1f:2f, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:40:00 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:40:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:01 user nova-compute[72418]: DEBUG nova.compute.manager [req-0687b572-14ab-4995-94f8-7d2f1c28db0b req-5ff9fa21-511b-4f48-9bb9-fd4853ceb77a service nova] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Received event network-vif-unplugged-1fa6e320-1b1b-41dc-8204-a7bed1172292 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:40:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-0687b572-14ab-4995-94f8-7d2f1c28db0b req-5ff9fa21-511b-4f48-9bb9-fd4853ceb77a service nova] Acquiring lock "2c9e974b-b993-4f4e-9446-14941c39f109-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:40:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-0687b572-14ab-4995-94f8-7d2f1c28db0b req-5ff9fa21-511b-4f48-9bb9-fd4853ceb77a service nova] Lock "2c9e974b-b993-4f4e-9446-14941c39f109-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:40:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-0687b572-14ab-4995-94f8-7d2f1c28db0b req-5ff9fa21-511b-4f48-9bb9-fd4853ceb77a service nova] Lock "2c9e974b-b993-4f4e-9446-14941c39f109-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:40:01 user nova-compute[72418]: DEBUG nova.compute.manager [req-0687b572-14ab-4995-94f8-7d2f1c28db0b req-5ff9fa21-511b-4f48-9bb9-fd4853ceb77a service nova] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] No waiting events found dispatching network-vif-unplugged-1fa6e320-1b1b-41dc-8204-a7bed1172292 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:40:01 user nova-compute[72418]: DEBUG nova.compute.manager [req-0687b572-14ab-4995-94f8-7d2f1c28db0b req-5ff9fa21-511b-4f48-9bb9-fd4853ceb77a service nova] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Received event network-vif-unplugged-1fa6e320-1b1b-41dc-8204-a7bed1172292 for instance with task_state deleting. {{(pid=72418) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 18:40:01 user nova-compute[72418]: DEBUG nova.compute.manager [req-0687b572-14ab-4995-94f8-7d2f1c28db0b req-5ff9fa21-511b-4f48-9bb9-fd4853ceb77a service nova] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Received event network-vif-plugged-1fa6e320-1b1b-41dc-8204-a7bed1172292 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:40:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-0687b572-14ab-4995-94f8-7d2f1c28db0b req-5ff9fa21-511b-4f48-9bb9-fd4853ceb77a service nova] Acquiring lock "2c9e974b-b993-4f4e-9446-14941c39f109-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:40:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-0687b572-14ab-4995-94f8-7d2f1c28db0b req-5ff9fa21-511b-4f48-9bb9-fd4853ceb77a service nova] Lock "2c9e974b-b993-4f4e-9446-14941c39f109-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:40:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-0687b572-14ab-4995-94f8-7d2f1c28db0b req-5ff9fa21-511b-4f48-9bb9-fd4853ceb77a service nova] Lock "2c9e974b-b993-4f4e-9446-14941c39f109-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:40:01 user nova-compute[72418]: DEBUG nova.compute.manager [req-0687b572-14ab-4995-94f8-7d2f1c28db0b req-5ff9fa21-511b-4f48-9bb9-fd4853ceb77a service nova] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] No waiting events found dispatching network-vif-plugged-1fa6e320-1b1b-41dc-8204-a7bed1172292 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:40:01 user nova-compute[72418]: WARNING nova.compute.manager [req-0687b572-14ab-4995-94f8-7d2f1c28db0b req-5ff9fa21-511b-4f48-9bb9-fd4853ceb77a service nova] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Received unexpected event network-vif-plugged-1fa6e320-1b1b-41dc-8204-a7bed1172292 for instance with vm_state active and task_state deleting.
Aug 09 18:40:01 user nova-compute[72418]: DEBUG nova.network.neutron [req-da352f4a-4c48-4550-8a7e-db67801aa4a8 req-c22cde7b-ac20-4ffe-b9c5-c44a288a57bd service nova] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Updated VIF entry in instance network info cache for port 1fa6e320-1b1b-41dc-8204-a7bed1172292. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:40:01 user nova-compute[72418]: DEBUG nova.network.neutron [req-da352f4a-4c48-4550-8a7e-db67801aa4a8 req-c22cde7b-ac20-4ffe-b9c5-c44a288a57bd service nova] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Updating instance_info_cache with network_info: [{"id": "1fa6e320-1b1b-41dc-8204-a7bed1172292", "address": "fa:16:3e:06:d3:3a", "network": {"id": "0fbd02ef-7c74-46c2-a09c-3b69be222ffa", "bridge": "br-int", "label": "tempest-TestStampPattern-85008345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce18df915bca48109597ad4aa8f1d116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fa6e320-1b", "ovs_interfaceid": "1fa6e320-1b1b-41dc-8204-a7bed1172292", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:40:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-da352f4a-4c48-4550-8a7e-db67801aa4a8 req-c22cde7b-ac20-4ffe-b9c5-c44a288a57bd service nova] Releasing lock "refresh_cache-2c9e974b-b993-4f4e-9446-14941c39f109" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:40:01 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:40:01 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Starting heal instance info cache {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 18:40:02 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Skipping network cache update for instance because it is being deleted. {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9891}}
Aug 09 18:40:02 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:02 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:02 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:02 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:02 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "refresh_cache-0659fd5c-cb05-441e-94b6-9d05f7135893" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:40:02 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquired lock "refresh_cache-0659fd5c-cb05-441e-94b6-9d05f7135893" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:40:02 user nova-compute[72418]: DEBUG nova.network.neutron [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Forcefully refreshing network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 18:40:02 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:40:02 user nova-compute[72418]: DEBUG nova.compute.manager [req-92e3bd90-06e5-4017-9781-679255d6c8a0 req-65e04c2c-dc3a-4789-b148-89fb17b980df service nova] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Received event network-vif-deleted-1fa6e320-1b1b-41dc-8204-a7bed1172292 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:40:02 user nova-compute[72418]: INFO nova.compute.manager [req-92e3bd90-06e5-4017-9781-679255d6c8a0 req-65e04c2c-dc3a-4789-b148-89fb17b980df service nova] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Neutron deleted interface 1fa6e320-1b1b-41dc-8204-a7bed1172292; detaching it from the instance and deleting it from the info cache
Aug 09 18:40:02 user nova-compute[72418]: DEBUG nova.network.neutron [req-92e3bd90-06e5-4017-9781-679255d6c8a0 req-65e04c2c-dc3a-4789-b148-89fb17b980df service nova] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:40:02 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Took 1.94 seconds to deallocate network for instance.
Aug 09 18:40:02 user nova-compute[72418]: DEBUG nova.compute.manager [req-92e3bd90-06e5-4017-9781-679255d6c8a0 req-65e04c2c-dc3a-4789-b148-89fb17b980df service nova] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Detach interface failed, port_id=1fa6e320-1b1b-41dc-8204-a7bed1172292, reason: Instance 2c9e974b-b993-4f4e-9446-14941c39f109 could not be found. {{(pid=72418) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 18:40:02 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-527c91a1-4580-428c-8d7e-0b9de628507d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:40:02 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-527c91a1-4580-428c-8d7e-0b9de628507d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:40:02 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-527c91a1-4580-428c-8d7e-0b9de628507d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:40:02 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-527c91a1-4580-428c-8d7e-0b9de628507d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:40:02 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-527c91a1-4580-428c-8d7e-0b9de628507d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.350s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:40:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:03 user nova-compute[72418]: INFO nova.scheduler.client.report [None req-527c91a1-4580-428c-8d7e-0b9de628507d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Deleted allocations for instance 2c9e974b-b993-4f4e-9446-14941c39f109
Aug 09 18:40:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-527c91a1-4580-428c-8d7e-0b9de628507d tempest-TestStampPattern-1349806997 tempest-TestStampPattern-1349806997-project-member] Lock "2c9e974b-b993-4f4e-9446-14941c39f109" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.941s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:40:03 user nova-compute[72418]: DEBUG nova.network.neutron [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Updating instance_info_cache with network_info: [{"id": "0cd6232b-ea64-4978-bc0e-0e84995fd9a4", "address": "fa:16:3e:65:a1:d2", "network": {"id": "bd36ef30-e57d-473f-97bc-c51b5db08aa7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-425133239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78b6e36a5b61456092ce7de9212c3c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd6232b-ea", "ovs_interfaceid": "0cd6232b-ea64-4978-bc0e-0e84995fd9a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:40:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Releasing lock "refresh_cache-0659fd5c-cb05-441e-94b6-9d05f7135893" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:40:03 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Updated the network info_cache for instance {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 18:40:03 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:40:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:03 user nova-compute[72418]: DEBUG nova.compute.manager [req-6b8e56ad-53f7-4e32-9adc-fe9d677238aa req-9ec69722-39a9-415a-8f5d-f08aadefad50 service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Received event network-vif-plugged-e6df16f7-7151-450f-bbf8-dc3be066011e {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:40:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-6b8e56ad-53f7-4e32-9adc-fe9d677238aa req-9ec69722-39a9-415a-8f5d-f08aadefad50 service nova] Acquiring lock "4e1a095f-a2e7-4ab6-bb7e-38cda890d567-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:40:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-6b8e56ad-53f7-4e32-9adc-fe9d677238aa req-9ec69722-39a9-415a-8f5d-f08aadefad50 service nova] Lock "4e1a095f-a2e7-4ab6-bb7e-38cda890d567-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:40:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-6b8e56ad-53f7-4e32-9adc-fe9d677238aa req-9ec69722-39a9-415a-8f5d-f08aadefad50 service nova] Lock "4e1a095f-a2e7-4ab6-bb7e-38cda890d567-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:40:03 user nova-compute[72418]: DEBUG nova.compute.manager [req-6b8e56ad-53f7-4e32-9adc-fe9d677238aa req-9ec69722-39a9-415a-8f5d-f08aadefad50 service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] No waiting events found dispatching network-vif-plugged-e6df16f7-7151-450f-bbf8-dc3be066011e {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:40:03 user nova-compute[72418]: WARNING nova.compute.manager [req-6b8e56ad-53f7-4e32-9adc-fe9d677238aa req-9ec69722-39a9-415a-8f5d-f08aadefad50 service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Received unexpected event network-vif-plugged-e6df16f7-7151-450f-bbf8-dc3be066011e for instance with vm_state active and task_state rescuing.
Aug 09 18:40:03 user nova-compute[72418]: DEBUG nova.compute.manager [req-6b8e56ad-53f7-4e32-9adc-fe9d677238aa req-9ec69722-39a9-415a-8f5d-f08aadefad50 service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Received event network-vif-plugged-e6df16f7-7151-450f-bbf8-dc3be066011e {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:40:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-6b8e56ad-53f7-4e32-9adc-fe9d677238aa req-9ec69722-39a9-415a-8f5d-f08aadefad50 service nova] Acquiring lock "4e1a095f-a2e7-4ab6-bb7e-38cda890d567-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:40:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-6b8e56ad-53f7-4e32-9adc-fe9d677238aa req-9ec69722-39a9-415a-8f5d-f08aadefad50 service nova] Lock "4e1a095f-a2e7-4ab6-bb7e-38cda890d567-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:40:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-6b8e56ad-53f7-4e32-9adc-fe9d677238aa req-9ec69722-39a9-415a-8f5d-f08aadefad50 service nova] Lock "4e1a095f-a2e7-4ab6-bb7e-38cda890d567-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:40:03 user nova-compute[72418]: DEBUG nova.compute.manager [req-6b8e56ad-53f7-4e32-9adc-fe9d677238aa req-9ec69722-39a9-415a-8f5d-f08aadefad50 service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] No waiting events found dispatching network-vif-plugged-e6df16f7-7151-450f-bbf8-dc3be066011e {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:40:03 user nova-compute[72418]: WARNING nova.compute.manager [req-6b8e56ad-53f7-4e32-9adc-fe9d677238aa req-9ec69722-39a9-415a-8f5d-f08aadefad50 service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Received unexpected event network-vif-plugged-e6df16f7-7151-450f-bbf8-dc3be066011e for instance with vm_state active and task_state rescuing.
Aug 09 18:40:03 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:40:04 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Removed pending event for 4e1a095f-a2e7-4ab6-bb7e-38cda890d567 due to event {{(pid=72418) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 18:40:04 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691606404.733512, 4e1a095f-a2e7-4ab6-bb7e-38cda890d567 => Resumed> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:40:04 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] VM Resumed (Lifecycle Event)
Aug 09 18:40:04 user nova-compute[72418]: DEBUG nova.compute.manager [None req-76e52e22-0469-431c-b39e-157d41543535 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:40:04 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:40:04 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:40:04 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 09 18:40:04 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691606404.7351303, 4e1a095f-a2e7-4ab6-bb7e-38cda890d567 => Started> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:40:04 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] VM Started (Lifecycle Event)
Aug 09 18:40:04 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:40:04 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:40:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:05 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Acquiring lock "2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:40:05 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Lock "2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:40:05 user nova-compute[72418]: DEBUG nova.compute.manager [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Starting instance... {{(pid=72418) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 18:40:05 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:40:05 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:40:05 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72418) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 18:40:05 user nova-compute[72418]: INFO nova.compute.claims [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Claim successful on node user
Aug 09 18:40:05 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:40:05 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:40:05 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:40:06 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:40:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.355s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:40:06 user nova-compute[72418]: DEBUG nova.compute.manager [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Start building networks asynchronously for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 18:40:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.079s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:40:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:40:06 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Auditing locally available compute resources for user (node: user) {{(pid=72418) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 18:40:06 user nova-compute[72418]: DEBUG nova.compute.manager [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Allocating IP information in the background. {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 18:40:06 user nova-compute[72418]: DEBUG nova.network.neutron [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] allocate_for_instance() {{(pid=72418) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 18:40:06 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 18:40:06 user nova-compute[72418]: DEBUG nova.compute.manager [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Start building block device mappings for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 18:40:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:40:06 user nova-compute[72418]: DEBUG nova.policy [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f8908bf793844843a5f5953d5d5569c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9ba244a629475189a823dd40c4afb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72418) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 18:40:06 user nova-compute[72418]: DEBUG nova.compute.manager [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Start spawning the instance on the hypervisor. {{(pid=72418) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 18:40:06 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Creating instance directory {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 18:40:06 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Creating image(s)
Aug 09 18:40:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Acquiring lock "/opt/stack/data/nova/instances/2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:40:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Lock "/opt/stack/data/nova/instances/2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:40:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Lock "/opt/stack/data/nova/instances/2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:40:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:40:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:40:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:40:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.149s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:40:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Acquiring lock "458773cfa7230b717e41c60277832e9f83806d71" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:40:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:40:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:40:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:40:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:40:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.199s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:40:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c/disk 1073741824 {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:40:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:40:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:40:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c/disk 1073741824" returned: 0 in 0.089s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:40:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.297s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:40:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:40:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:40:06 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:40:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/disk.rescue --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:40:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.169s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:40:07 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c/disk. size=1073741824 {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 18:40:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:40:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:40:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/disk.rescue --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:40:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:40:07 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Cannot resize image /opt/stack/data/nova/instances/2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c/disk to a smaller size. {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 18:40:07 user nova-compute[72418]: DEBUG nova.objects.instance [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Lazy-loading 'migration_context' on Instance uuid 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:40:07 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Created local disks {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 18:40:07 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Ensure instance console log exists: /opt/stack/data/nova/instances/2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c/console.log {{(pid=72418) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 18:40:07 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:40:07 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:40:07 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:40:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:40:07 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:40:07 user nova-compute[72418]: DEBUG nova.network.neutron [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Successfully created port: 2caa8c0b-8aea-4f61-9e3a-0728beb92ff1 {{(pid=72418) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 18:40:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:40:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:40:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:40:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:40:07 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:40:08 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:40:08 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:40:08 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Hypervisor/Node resource view: name=user free_ram=8243MB free_disk=25.4122314453125GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72418) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 18:40:08 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:40:08 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:40:08 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 8fe41968-a219-4a5a-afdb-32eb2082bb40 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:40:08 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance e019064c-955e-4f80-9b00-6b32b3835d58 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:40:08 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance c46f2599-93f8-412e-9918-7ace8a9f19dd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:40:08 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 4e1a095f-a2e7-4ab6-bb7e-38cda890d567 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:40:08 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 0659fd5c-cb05-441e-94b6-9d05f7135893 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:40:08 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:40:08 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 18:40:08 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 18:40:08 user nova-compute[72418]: DEBUG nova.network.neutron [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Successfully updated port: 2caa8c0b-8aea-4f61-9e3a-0728beb92ff1 {{(pid=72418) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 18:40:08 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:08 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Acquiring lock "refresh_cache-2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:40:08 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Acquired lock "refresh_cache-2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:40:08 user nova-compute[72418]: DEBUG nova.network.neutron [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:40:08 user nova-compute[72418]: DEBUG nova.compute.manager [req-9825d250-42c7-4bb3-b20a-c8964ddbd42f req-01bd3d64-e6d7-455e-8a7a-01c31a3776d4 service nova] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Received event network-changed-2caa8c0b-8aea-4f61-9e3a-0728beb92ff1 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:40:08 user nova-compute[72418]: DEBUG nova.compute.manager [req-9825d250-42c7-4bb3-b20a-c8964ddbd42f req-01bd3d64-e6d7-455e-8a7a-01c31a3776d4 service nova] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Refreshing instance network info cache due to event network-changed-2caa8c0b-8aea-4f61-9e3a-0728beb92ff1. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:40:08 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-9825d250-42c7-4bb3-b20a-c8964ddbd42f req-01bd3d64-e6d7-455e-8a7a-01c31a3776d4 service nova] Acquiring lock "refresh_cache-2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:40:08 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:40:08 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:40:08 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Compute_service record updated for user:user {{(pid=72418) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 18:40:08 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.427s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:40:08 user nova-compute[72418]: DEBUG nova.network.neutron [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Instance cache missing network info. {{(pid=72418) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 18:40:08 user nova-compute[72418]: DEBUG nova.network.neutron [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Updating instance_info_cache with network_info: [{"id": "2caa8c0b-8aea-4f61-9e3a-0728beb92ff1", "address": "fa:16:3e:96:4c:20", "network": {"id": "ea44ae8b-622b-48d7-8a2b-52c482edf74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1686271510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9ba244a629475189a823dd40c4afb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2caa8c0b-8a", "ovs_interfaceid": "2caa8c0b-8aea-4f61-9e3a-0728beb92ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:40:08 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Releasing lock "refresh_cache-2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:40:08 user nova-compute[72418]: DEBUG nova.compute.manager [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Instance network_info: |[{"id": "2caa8c0b-8aea-4f61-9e3a-0728beb92ff1", "address": "fa:16:3e:96:4c:20", "network": {"id": "ea44ae8b-622b-48d7-8a2b-52c482edf74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1686271510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9ba244a629475189a823dd40c4afb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2caa8c0b-8a", "ovs_interfaceid": "2caa8c0b-8aea-4f61-9e3a-0728beb92ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 18:40:08 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-9825d250-42c7-4bb3-b20a-c8964ddbd42f req-01bd3d64-e6d7-455e-8a7a-01c31a3776d4 service nova] Acquired lock "refresh_cache-2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:40:08 user nova-compute[72418]: DEBUG nova.network.neutron [req-9825d250-42c7-4bb3-b20a-c8964ddbd42f req-01bd3d64-e6d7-455e-8a7a-01c31a3776d4 service nova] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Refreshing network info cache for port 2caa8c0b-8aea-4f61-9e3a-0728beb92ff1 {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:40:08 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Start _get_guest_xml network_info=[{"id": "2caa8c0b-8aea-4f61-9e3a-0728beb92ff1", "address": "fa:16:3e:96:4c:20", "network": {"id": "ea44ae8b-622b-48d7-8a2b-52c482edf74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1686271510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9ba244a629475189a823dd40c4afb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2caa8c0b-8a", "ovs_interfaceid": "2caa8c0b-8aea-4f61-9e3a-0728beb92ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 18:40:08 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:40:08 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:40:08 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 18:40:08 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] CPU controller missing on host. {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 18:40:08 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 18:40:08 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] CPU controller found on host. {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 18:40:08 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72418) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 18:40:08 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T18:17:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 18:40:08 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Flavor limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 18:40:08 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Image limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 18:40:08 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Flavor pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 18:40:08 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Image pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 18:40:08 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 18:40:08 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 18:40:08 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 18:40:08 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Got 1 possible topologies {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 18:40:08 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 18:40:08 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 18:40:08 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:40:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1804567865',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1804567865',id=33,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXPX4meYC5q9Csb94cFY2/ntXnwmXU606njw4i1PD9gqISyDPNlWH5uWkogo9cTLkS/m6+tiFXzn5yykKRVbH+S12MVrbYY9aSknuunPeXthY5ETNGFNDIRXye5758pQA==',key_name='tempest-keypair-885533390',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d9ba244a629475189a823dd40c4afb9',ramdisk_id='',reservation_id='r-hlq30p7b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-531665400',owner_user_name='tempest-AttachVolumeShelveTestJSON-531665400-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:40:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8908bf793844843a5f5953d5d5569c9',uuid=2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2caa8c0b-8aea-4f61-9e3a-0728beb92ff1", "address": "fa:16:3e:96:4c:20", "network": {"id": "ea44ae8b-622b-48d7-8a2b-52c482edf74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1686271510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9ba244a629475189a823dd40c4afb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2caa8c0b-8a", "ovs_interfaceid": "2caa8c0b-8aea-4f61-9e3a-0728beb92ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:40:08 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Converting VIF {"id": "2caa8c0b-8aea-4f61-9e3a-0728beb92ff1", "address": "fa:16:3e:96:4c:20", "network": {"id": "ea44ae8b-622b-48d7-8a2b-52c482edf74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1686271510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9ba244a629475189a823dd40c4afb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2caa8c0b-8a", "ovs_interfaceid": "2caa8c0b-8aea-4f61-9e3a-0728beb92ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:40:08 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:4c:20,bridge_name='br-int',has_traffic_filtering=True,id=2caa8c0b-8aea-4f61-9e3a-0728beb92ff1,network=Network(ea44ae8b-622b-48d7-8a2b-52c482edf74a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2caa8c0b-8a') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:40:08 user nova-compute[72418]: DEBUG nova.objects.instance [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Lazy-loading 'pci_devices' on Instance uuid 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:40:08 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] End _get_guest_xml xml=<domain type="kvm">
Aug 09 18:40:08 user nova-compute[72418]:   <uuid>2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c</uuid>
Aug 09 18:40:08 user nova-compute[72418]:   <name>instance-00000021</name>
Aug 09 18:40:08 user nova-compute[72418]:   <memory>524288</memory>
Aug 09 18:40:08 user nova-compute[72418]:   <vcpu>1</vcpu>
Aug 09 18:40:08 user nova-compute[72418]:   <metadata>
Aug 09 18:40:08 user nova-compute[72418]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:40:08 user nova-compute[72418]:       <nova:package version="0.0.0"/>
Aug 09 18:40:08 user nova-compute[72418]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1804567865</nova:name>
Aug 09 18:40:08 user nova-compute[72418]:       <nova:creationTime>2023-08-09 18:40:08</nova:creationTime>
Aug 09 18:40:08 user nova-compute[72418]:       <nova:flavor name="m1.tiny">
Aug 09 18:40:08 user nova-compute[72418]:         <nova:memory>512</nova:memory>
Aug 09 18:40:08 user nova-compute[72418]:         <nova:disk>1</nova:disk>
Aug 09 18:40:08 user nova-compute[72418]:         <nova:swap>0</nova:swap>
Aug 09 18:40:08 user nova-compute[72418]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:40:08 user nova-compute[72418]:         <nova:vcpus>1</nova:vcpus>
Aug 09 18:40:08 user nova-compute[72418]:       </nova:flavor>
Aug 09 18:40:08 user nova-compute[72418]:       <nova:owner>
Aug 09 18:40:08 user nova-compute[72418]:         <nova:user uuid="f8908bf793844843a5f5953d5d5569c9">tempest-AttachVolumeShelveTestJSON-531665400-project-member</nova:user>
Aug 09 18:40:08 user nova-compute[72418]:         <nova:project uuid="2d9ba244a629475189a823dd40c4afb9">tempest-AttachVolumeShelveTestJSON-531665400</nova:project>
Aug 09 18:40:08 user nova-compute[72418]:       </nova:owner>
Aug 09 18:40:08 user nova-compute[72418]:       <nova:root type="image" uuid="8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e"/>
Aug 09 18:40:08 user nova-compute[72418]:       <nova:ports>
Aug 09 18:40:08 user nova-compute[72418]:         <nova:port uuid="2caa8c0b-8aea-4f61-9e3a-0728beb92ff1">
Aug 09 18:40:08 user nova-compute[72418]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 09 18:40:08 user nova-compute[72418]:         </nova:port>
Aug 09 18:40:08 user nova-compute[72418]:       </nova:ports>
Aug 09 18:40:08 user nova-compute[72418]:     </nova:instance>
Aug 09 18:40:08 user nova-compute[72418]:   </metadata>
Aug 09 18:40:08 user nova-compute[72418]:   <sysinfo type="smbios">
Aug 09 18:40:08 user nova-compute[72418]:     <system>
Aug 09 18:40:08 user nova-compute[72418]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 18:40:08 user nova-compute[72418]:       <entry name="product">OpenStack Nova</entry>
Aug 09 18:40:08 user nova-compute[72418]:       <entry name="version">0.0.0</entry>
Aug 09 18:40:08 user nova-compute[72418]:       <entry name="serial">2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c</entry>
Aug 09 18:40:08 user nova-compute[72418]:       <entry name="uuid">2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c</entry>
Aug 09 18:40:08 user nova-compute[72418]:       <entry name="family">Virtual Machine</entry>
Aug 09 18:40:08 user nova-compute[72418]:     </system>
Aug 09 18:40:08 user nova-compute[72418]:   </sysinfo>
Aug 09 18:40:08 user nova-compute[72418]:   <os>
Aug 09 18:40:08 user nova-compute[72418]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 18:40:08 user nova-compute[72418]:     <boot dev="hd"/>
Aug 09 18:40:08 user nova-compute[72418]:     <smbios mode="sysinfo"/>
Aug 09 18:40:08 user nova-compute[72418]:   </os>
Aug 09 18:40:08 user nova-compute[72418]:   <features>
Aug 09 18:40:08 user nova-compute[72418]:     <acpi/>
Aug 09 18:40:08 user nova-compute[72418]:     <apic/>
Aug 09 18:40:08 user nova-compute[72418]:     <vmcoreinfo/>
Aug 09 18:40:08 user nova-compute[72418]:   </features>
Aug 09 18:40:08 user nova-compute[72418]:   <clock offset="utc">
Aug 09 18:40:08 user nova-compute[72418]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 18:40:08 user nova-compute[72418]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 18:40:08 user nova-compute[72418]:     <timer name="hpet" present="no"/>
Aug 09 18:40:08 user nova-compute[72418]:   </clock>
Aug 09 18:40:08 user nova-compute[72418]:   <cpu mode="custom" match="exact">
Aug 09 18:40:08 user nova-compute[72418]:     <model>Nehalem</model>
Aug 09 18:40:08 user nova-compute[72418]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 18:40:08 user nova-compute[72418]:   </cpu>
Aug 09 18:40:08 user nova-compute[72418]:   <devices>
Aug 09 18:40:08 user nova-compute[72418]:     <disk type="file" device="disk">
Aug 09 18:40:08 user nova-compute[72418]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 18:40:08 user nova-compute[72418]:       <source file="/opt/stack/data/nova/instances/2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c/disk"/>
Aug 09 18:40:08 user nova-compute[72418]:       <target dev="vda" bus="virtio"/>
Aug 09 18:40:08 user nova-compute[72418]:     </disk>
Aug 09 18:40:08 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:40:08 user nova-compute[72418]:       <mac address="fa:16:3e:96:4c:20"/>
Aug 09 18:40:08 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:40:08 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:40:08 user nova-compute[72418]:       <target dev="tap2caa8c0b-8a"/>
Aug 09 18:40:08 user nova-compute[72418]:     </interface>
Aug 09 18:40:08 user nova-compute[72418]:     <serial type="pty">
Aug 09 18:40:08 user nova-compute[72418]:       <log file="/opt/stack/data/nova/instances/2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c/console.log" append="off"/>
Aug 09 18:40:08 user nova-compute[72418]:     </serial>
Aug 09 18:40:08 user nova-compute[72418]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 18:40:08 user nova-compute[72418]:     <video>
Aug 09 18:40:08 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:40:08 user nova-compute[72418]:     </video>
Aug 09 18:40:08 user nova-compute[72418]:     <rng model="virtio">
Aug 09 18:40:08 user nova-compute[72418]:       <backend model="random">/dev/urandom</backend>
Aug 09 18:40:08 user nova-compute[72418]:     </rng>
Aug 09 18:40:08 user nova-compute[72418]:     <controller type="usb" index="0" model="none"/>
Aug 09 18:40:08 user nova-compute[72418]:     <memballoon model="virtio">
Aug 09 18:40:08 user nova-compute[72418]:       <stats period="10"/>
Aug 09 18:40:08 user nova-compute[72418]:     </memballoon>
Aug 09 18:40:08 user nova-compute[72418]:   </devices>
Aug 09 18:40:08 user nova-compute[72418]: </domain>
Aug 09 18:40:08 user nova-compute[72418]:  {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 18:40:08 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:40:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1804567865',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1804567865',id=33,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXPX4meYC5q9Csb94cFY2/ntXnwmXU606njw4i1PD9gqISyDPNlWH5uWkogo9cTLkS/m6+tiFXzn5yykKRVbH+S12MVrbYY9aSknuunPeXthY5ETNGFNDIRXye5758pQA==',key_name='tempest-keypair-885533390',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d9ba244a629475189a823dd40c4afb9',ramdisk_id='',reservation_id='r-hlq30p7b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-531665400',owner_user_name='tempest-AttachVolumeShelveTestJSON-531665400-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:40:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8908bf793844843a5f5953d5d5569c9',uuid=2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2caa8c0b-8aea-4f61-9e3a-0728beb92ff1", "address": "fa:16:3e:96:4c:20", "network": {"id": "ea44ae8b-622b-48d7-8a2b-52c482edf74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1686271510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9ba244a629475189a823dd40c4afb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2caa8c0b-8a", "ovs_interfaceid": "2caa8c0b-8aea-4f61-9e3a-0728beb92ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:40:08 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Converting VIF {"id": "2caa8c0b-8aea-4f61-9e3a-0728beb92ff1", "address": "fa:16:3e:96:4c:20", "network": {"id": "ea44ae8b-622b-48d7-8a2b-52c482edf74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1686271510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9ba244a629475189a823dd40c4afb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2caa8c0b-8a", "ovs_interfaceid": "2caa8c0b-8aea-4f61-9e3a-0728beb92ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:40:08 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:4c:20,bridge_name='br-int',has_traffic_filtering=True,id=2caa8c0b-8aea-4f61-9e3a-0728beb92ff1,network=Network(ea44ae8b-622b-48d7-8a2b-52c482edf74a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2caa8c0b-8a') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:40:08 user nova-compute[72418]: DEBUG os_vif [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:4c:20,bridge_name='br-int',has_traffic_filtering=True,id=2caa8c0b-8aea-4f61-9e3a-0728beb92ff1,network=Network(ea44ae8b-622b-48d7-8a2b-52c482edf74a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2caa8c0b-8a') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:40:08 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:08 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:40:08 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:40:09 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:09 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2caa8c0b-8a, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:40:09 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2caa8c0b-8a, col_values=(('external_ids', {'iface-id': '2caa8c0b-8aea-4f61-9e3a-0728beb92ff1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:4c:20', 'vm-uuid': '2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:40:09 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:09 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:40:09 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:09 user nova-compute[72418]: INFO os_vif [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:4c:20,bridge_name='br-int',has_traffic_filtering=True,id=2caa8c0b-8aea-4f61-9e3a-0728beb92ff1,network=Network(ea44ae8b-622b-48d7-8a2b-52c482edf74a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2caa8c0b-8a')
Aug 09 18:40:09 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:40:09 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] No VIF found with MAC fa:16:3e:96:4c:20, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:40:09 user nova-compute[72418]: DEBUG nova.network.neutron [req-9825d250-42c7-4bb3-b20a-c8964ddbd42f req-01bd3d64-e6d7-455e-8a7a-01c31a3776d4 service nova] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Updated VIF entry in instance network info cache for port 2caa8c0b-8aea-4f61-9e3a-0728beb92ff1. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:40:09 user nova-compute[72418]: DEBUG nova.network.neutron [req-9825d250-42c7-4bb3-b20a-c8964ddbd42f req-01bd3d64-e6d7-455e-8a7a-01c31a3776d4 service nova] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Updating instance_info_cache with network_info: [{"id": "2caa8c0b-8aea-4f61-9e3a-0728beb92ff1", "address": "fa:16:3e:96:4c:20", "network": {"id": "ea44ae8b-622b-48d7-8a2b-52c482edf74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1686271510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9ba244a629475189a823dd40c4afb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2caa8c0b-8a", "ovs_interfaceid": "2caa8c0b-8aea-4f61-9e3a-0728beb92ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:40:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-9825d250-42c7-4bb3-b20a-c8964ddbd42f req-01bd3d64-e6d7-455e-8a7a-01c31a3776d4 service nova] Releasing lock "refresh_cache-2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:40:10 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:10 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:10 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:10 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:10 user nova-compute[72418]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691606395.5750296, e582b61c-d998-4a3f-8392-a7f0e94a4dec => Stopped> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:40:10 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] VM Stopped (Lifecycle Event)
Aug 09 18:40:10 user nova-compute[72418]: DEBUG nova.compute.manager [None req-eb8eb345-0440-4628-a3b1-4bc378ff50fc None None] [instance: e582b61c-d998-4a3f-8392-a7f0e94a4dec] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:40:10 user nova-compute[72418]: DEBUG nova.compute.manager [req-d46df156-cb62-4644-bc75-3b826a44a500 req-0ddb0223-b150-4a4e-bd6b-3d7d9cbab97b service nova] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Received event network-vif-plugged-2caa8c0b-8aea-4f61-9e3a-0728beb92ff1 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:40:10 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-d46df156-cb62-4644-bc75-3b826a44a500 req-0ddb0223-b150-4a4e-bd6b-3d7d9cbab97b service nova] Acquiring lock "2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:40:10 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-d46df156-cb62-4644-bc75-3b826a44a500 req-0ddb0223-b150-4a4e-bd6b-3d7d9cbab97b service nova] Lock "2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:40:10 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-d46df156-cb62-4644-bc75-3b826a44a500 req-0ddb0223-b150-4a4e-bd6b-3d7d9cbab97b service nova] Lock "2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:40:10 user nova-compute[72418]: DEBUG nova.compute.manager [req-d46df156-cb62-4644-bc75-3b826a44a500 req-0ddb0223-b150-4a4e-bd6b-3d7d9cbab97b service nova] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] No waiting events found dispatching network-vif-plugged-2caa8c0b-8aea-4f61-9e3a-0728beb92ff1 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:40:10 user nova-compute[72418]: WARNING nova.compute.manager [req-d46df156-cb62-4644-bc75-3b826a44a500 req-0ddb0223-b150-4a4e-bd6b-3d7d9cbab97b service nova] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Received unexpected event network-vif-plugged-2caa8c0b-8aea-4f61-9e3a-0728beb92ff1 for instance with vm_state building and task_state spawning.
Aug 09 18:40:11 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:11 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:11 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:11 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:11 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:12 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691606412.6881535, 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c => Resumed> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:40:12 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] VM Resumed (Lifecycle Event)
Aug 09 18:40:12 user nova-compute[72418]: DEBUG nova.compute.manager [req-a17bf314-ed98-43f6-aaf9-cd4bae5ed917 req-d5f2c72d-fa4c-4a6a-8b7c-0072dab8a604 service nova] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Received event network-vif-plugged-2caa8c0b-8aea-4f61-9e3a-0728beb92ff1 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:40:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a17bf314-ed98-43f6-aaf9-cd4bae5ed917 req-d5f2c72d-fa4c-4a6a-8b7c-0072dab8a604 service nova] Acquiring lock "2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:40:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a17bf314-ed98-43f6-aaf9-cd4bae5ed917 req-d5f2c72d-fa4c-4a6a-8b7c-0072dab8a604 service nova] Lock "2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:40:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a17bf314-ed98-43f6-aaf9-cd4bae5ed917 req-d5f2c72d-fa4c-4a6a-8b7c-0072dab8a604 service nova] Lock "2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:40:12 user nova-compute[72418]: DEBUG nova.compute.manager [req-a17bf314-ed98-43f6-aaf9-cd4bae5ed917 req-d5f2c72d-fa4c-4a6a-8b7c-0072dab8a604 service nova] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] No waiting events found dispatching network-vif-plugged-2caa8c0b-8aea-4f61-9e3a-0728beb92ff1 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:40:12 user nova-compute[72418]: WARNING nova.compute.manager [req-a17bf314-ed98-43f6-aaf9-cd4bae5ed917 req-d5f2c72d-fa4c-4a6a-8b7c-0072dab8a604 service nova] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Received unexpected event network-vif-plugged-2caa8c0b-8aea-4f61-9e3a-0728beb92ff1 for instance with vm_state building and task_state spawning.
Aug 09 18:40:12 user nova-compute[72418]: DEBUG nova.compute.manager [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Instance event wait completed in 0 seconds for  {{(pid=72418) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 18:40:12 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Guest created on hypervisor {{(pid=72418) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 18:40:12 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Instance spawned successfully.
Aug 09 18:40:12 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 18:40:12 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:40:12 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:40:12 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Found default for hw_cdrom_bus of ide {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:40:12 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Found default for hw_disk_bus of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:40:12 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Found default for hw_input_bus of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:40:12 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Found default for hw_pointer_model of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:40:12 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Found default for hw_video_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:40:12 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Found default for hw_vif_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:40:12 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:40:12 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691606412.6907976, 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c => Started> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:40:12 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] VM Started (Lifecycle Event)
Aug 09 18:40:12 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:40:12 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:40:12 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:40:12 user nova-compute[72418]: INFO nova.compute.manager [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Took 6.45 seconds to spawn the instance on the hypervisor.
Aug 09 18:40:12 user nova-compute[72418]: DEBUG nova.compute.manager [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:40:12 user nova-compute[72418]: INFO nova.compute.manager [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Took 7.25 seconds to build instance.
Aug 09 18:40:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-5dd90e22-54d3-45e4-b278-c1d67a0f96b5 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Lock "2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.370s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:40:13 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:14 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:15 user nova-compute[72418]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691606400.266394, 2c9e974b-b993-4f4e-9446-14941c39f109 => Stopped> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:40:15 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] VM Stopped (Lifecycle Event)
Aug 09 18:40:15 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52a5b97d-991d-43c5-8f0e-e7c1137a5810 None None] [instance: 2c9e974b-b993-4f4e-9446-14941c39f109] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:40:19 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:19 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:21 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:21 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:23 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:24 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:26 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:28 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:28 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:29 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:29 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Acquiring lock "8893bd80-5708-47a5-a9d0-cd0ed6d73e52" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:40:29 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Lock "8893bd80-5708-47a5-a9d0-cd0ed6d73e52" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:40:29 user nova-compute[72418]: DEBUG nova.compute.manager [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Starting instance... {{(pid=72418) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 18:40:29 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:40:29 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:40:29 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72418) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 18:40:29 user nova-compute[72418]: INFO nova.compute.claims [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Claim successful on node user
Aug 09 18:40:30 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:40:30 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:40:30 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.308s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:40:30 user nova-compute[72418]: DEBUG nova.compute.manager [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Start building networks asynchronously for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 18:40:30 user nova-compute[72418]: DEBUG nova.compute.manager [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Allocating IP information in the background. {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 18:40:30 user nova-compute[72418]: DEBUG nova.network.neutron [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] allocate_for_instance() {{(pid=72418) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 18:40:30 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 18:40:30 user nova-compute[72418]: DEBUG nova.compute.manager [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Start building block device mappings for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 18:40:30 user nova-compute[72418]: DEBUG nova.policy [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6ca9b88eef594d3d9fe150c21b3113fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a06fd12204e28b42e073812d67248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72418) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 18:40:30 user nova-compute[72418]: DEBUG nova.compute.manager [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Start spawning the instance on the hypervisor. {{(pid=72418) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 18:40:30 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Creating instance directory {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 18:40:30 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Creating image(s)
Aug 09 18:40:30 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Acquiring lock "/opt/stack/data/nova/instances/8893bd80-5708-47a5-a9d0-cd0ed6d73e52/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:40:30 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Lock "/opt/stack/data/nova/instances/8893bd80-5708-47a5-a9d0-cd0ed6d73e52/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:40:30 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Lock "/opt/stack/data/nova/instances/8893bd80-5708-47a5-a9d0-cd0ed6d73e52/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:40:30 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:40:30 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.139s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:40:30 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Acquiring lock "458773cfa7230b717e41c60277832e9f83806d71" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:40:30 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:40:30 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:40:30 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.141s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:40:30 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/8893bd80-5708-47a5-a9d0-cd0ed6d73e52/disk 1073741824 {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:40:30 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/8893bd80-5708-47a5-a9d0-cd0ed6d73e52/disk 1073741824" returned: 0 in 0.051s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:40:30 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:40:30 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:40:30 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.138s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:40:30 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8893bd80-5708-47a5-a9d0-cd0ed6d73e52/disk. size=1073741824 {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 18:40:30 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8893bd80-5708-47a5-a9d0-cd0ed6d73e52/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:40:31 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8893bd80-5708-47a5-a9d0-cd0ed6d73e52/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:40:31 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Cannot resize image /opt/stack/data/nova/instances/8893bd80-5708-47a5-a9d0-cd0ed6d73e52/disk to a smaller size. {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 18:40:31 user nova-compute[72418]: DEBUG nova.objects.instance [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Lazy-loading 'migration_context' on Instance uuid 8893bd80-5708-47a5-a9d0-cd0ed6d73e52 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:40:31 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Created local disks {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 18:40:31 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Ensure instance console log exists: /opt/stack/data/nova/instances/8893bd80-5708-47a5-a9d0-cd0ed6d73e52/console.log {{(pid=72418) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 18:40:31 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:40:31 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:40:31 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:40:31 user nova-compute[72418]: DEBUG nova.network.neutron [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Successfully created port: 00b2459b-f98c-46c5-8e73-07894ab10384 {{(pid=72418) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 18:40:31 user nova-compute[72418]: DEBUG nova.network.neutron [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Successfully updated port: 00b2459b-f98c-46c5-8e73-07894ab10384 {{(pid=72418) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 18:40:31 user nova-compute[72418]: DEBUG nova.compute.manager [req-5459a876-d6be-47fc-b4ba-97b6c5c5c114 req-1586beed-368f-4e23-b28c-00d80b841c3c service nova] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Received event network-changed-00b2459b-f98c-46c5-8e73-07894ab10384 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:40:31 user nova-compute[72418]: DEBUG nova.compute.manager [req-5459a876-d6be-47fc-b4ba-97b6c5c5c114 req-1586beed-368f-4e23-b28c-00d80b841c3c service nova] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Refreshing instance network info cache due to event network-changed-00b2459b-f98c-46c5-8e73-07894ab10384. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:40:31 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-5459a876-d6be-47fc-b4ba-97b6c5c5c114 req-1586beed-368f-4e23-b28c-00d80b841c3c service nova] Acquiring lock "refresh_cache-8893bd80-5708-47a5-a9d0-cd0ed6d73e52" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:40:31 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-5459a876-d6be-47fc-b4ba-97b6c5c5c114 req-1586beed-368f-4e23-b28c-00d80b841c3c service nova] Acquired lock "refresh_cache-8893bd80-5708-47a5-a9d0-cd0ed6d73e52" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:40:31 user nova-compute[72418]: DEBUG nova.network.neutron [req-5459a876-d6be-47fc-b4ba-97b6c5c5c114 req-1586beed-368f-4e23-b28c-00d80b841c3c service nova] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Refreshing network info cache for port 00b2459b-f98c-46c5-8e73-07894ab10384 {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:40:31 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Acquiring lock "refresh_cache-8893bd80-5708-47a5-a9d0-cd0ed6d73e52" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:40:32 user nova-compute[72418]: DEBUG nova.network.neutron [req-5459a876-d6be-47fc-b4ba-97b6c5c5c114 req-1586beed-368f-4e23-b28c-00d80b841c3c service nova] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Instance cache missing network info. {{(pid=72418) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 18:40:32 user nova-compute[72418]: DEBUG nova.network.neutron [req-5459a876-d6be-47fc-b4ba-97b6c5c5c114 req-1586beed-368f-4e23-b28c-00d80b841c3c service nova] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:40:32 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-5459a876-d6be-47fc-b4ba-97b6c5c5c114 req-1586beed-368f-4e23-b28c-00d80b841c3c service nova] Releasing lock "refresh_cache-8893bd80-5708-47a5-a9d0-cd0ed6d73e52" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:40:32 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Acquired lock "refresh_cache-8893bd80-5708-47a5-a9d0-cd0ed6d73e52" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:40:32 user nova-compute[72418]: DEBUG nova.network.neutron [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:40:32 user nova-compute[72418]: DEBUG nova.network.neutron [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Instance cache missing network info. {{(pid=72418) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 18:40:32 user nova-compute[72418]: DEBUG nova.network.neutron [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Updating instance_info_cache with network_info: [{"id": "00b2459b-f98c-46c5-8e73-07894ab10384", "address": "fa:16:3e:0c:6e:ea", "network": {"id": "5052c479-912b-48b4-b29a-770428231240", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1712606204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d3a06fd12204e28b42e073812d67248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00b2459b-f9", "ovs_interfaceid": "00b2459b-f98c-46c5-8e73-07894ab10384", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:40:32 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Releasing lock "refresh_cache-8893bd80-5708-47a5-a9d0-cd0ed6d73e52" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:40:32 user nova-compute[72418]: DEBUG nova.compute.manager [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Instance network_info: |[{"id": "00b2459b-f98c-46c5-8e73-07894ab10384", "address": "fa:16:3e:0c:6e:ea", "network": {"id": "5052c479-912b-48b4-b29a-770428231240", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1712606204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d3a06fd12204e28b42e073812d67248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00b2459b-f9", "ovs_interfaceid": "00b2459b-f98c-46c5-8e73-07894ab10384", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 18:40:32 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Start _get_guest_xml network_info=[{"id": "00b2459b-f98c-46c5-8e73-07894ab10384", "address": "fa:16:3e:0c:6e:ea", "network": {"id": "5052c479-912b-48b4-b29a-770428231240", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1712606204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d3a06fd12204e28b42e073812d67248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00b2459b-f9", "ovs_interfaceid": "00b2459b-f98c-46c5-8e73-07894ab10384", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 18:40:32 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:40:32 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:40:32 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 18:40:32 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] CPU controller missing on host. {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 18:40:32 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 18:40:32 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] CPU controller found on host. {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 18:40:32 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72418) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 18:40:32 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T18:17:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 18:40:32 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Flavor limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 18:40:32 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Image limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 18:40:32 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Flavor pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 18:40:32 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Image pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 18:40:32 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 18:40:32 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 18:40:32 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 18:40:32 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Got 1 possible topologies {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 18:40:32 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 18:40:32 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 18:40:32 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:40:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1416142219',display_name='tempest-VolumesActionsTest-instance-1416142219',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1416142219',id=34,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d3a06fd12204e28b42e073812d67248',ramdisk_id='',reservation_id='r-pvb56h4p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1233815310',owner_user_name='tempest-VolumesActionsTest-1233815310-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:40:30Z,user_data=None,user_id='6ca9b88eef594d3d9fe150c21b3113fc',uuid=8893bd80-5708-47a5-a9d0-cd0ed6d73e52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00b2459b-f98c-46c5-8e73-07894ab10384", "address": "fa:16:3e:0c:6e:ea", "network": {"id": "5052c479-912b-48b4-b29a-770428231240", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1712606204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d3a06fd12204e28b42e073812d67248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00b2459b-f9", "ovs_interfaceid": "00b2459b-f98c-46c5-8e73-07894ab10384", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:40:32 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Converting VIF {"id": "00b2459b-f98c-46c5-8e73-07894ab10384", "address": "fa:16:3e:0c:6e:ea", "network": {"id": "5052c479-912b-48b4-b29a-770428231240", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1712606204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d3a06fd12204e28b42e073812d67248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00b2459b-f9", "ovs_interfaceid": "00b2459b-f98c-46c5-8e73-07894ab10384", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:40:32 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:6e:ea,bridge_name='br-int',has_traffic_filtering=True,id=00b2459b-f98c-46c5-8e73-07894ab10384,network=Network(5052c479-912b-48b4-b29a-770428231240),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00b2459b-f9') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:40:32 user nova-compute[72418]: DEBUG nova.objects.instance [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Lazy-loading 'pci_devices' on Instance uuid 8893bd80-5708-47a5-a9d0-cd0ed6d73e52 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:40:32 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] End _get_guest_xml xml=<domain type="kvm">
Aug 09 18:40:32 user nova-compute[72418]:   <uuid>8893bd80-5708-47a5-a9d0-cd0ed6d73e52</uuid>
Aug 09 18:40:32 user nova-compute[72418]:   <name>instance-00000022</name>
Aug 09 18:40:32 user nova-compute[72418]:   <memory>524288</memory>
Aug 09 18:40:32 user nova-compute[72418]:   <vcpu>1</vcpu>
Aug 09 18:40:32 user nova-compute[72418]:   <metadata>
Aug 09 18:40:32 user nova-compute[72418]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:40:32 user nova-compute[72418]:       <nova:package version="0.0.0"/>
Aug 09 18:40:32 user nova-compute[72418]:       <nova:name>tempest-VolumesActionsTest-instance-1416142219</nova:name>
Aug 09 18:40:32 user nova-compute[72418]:       <nova:creationTime>2023-08-09 18:40:32</nova:creationTime>
Aug 09 18:40:32 user nova-compute[72418]:       <nova:flavor name="m1.tiny">
Aug 09 18:40:32 user nova-compute[72418]:         <nova:memory>512</nova:memory>
Aug 09 18:40:32 user nova-compute[72418]:         <nova:disk>1</nova:disk>
Aug 09 18:40:32 user nova-compute[72418]:         <nova:swap>0</nova:swap>
Aug 09 18:40:32 user nova-compute[72418]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:40:32 user nova-compute[72418]:         <nova:vcpus>1</nova:vcpus>
Aug 09 18:40:32 user nova-compute[72418]:       </nova:flavor>
Aug 09 18:40:32 user nova-compute[72418]:       <nova:owner>
Aug 09 18:40:32 user nova-compute[72418]:         <nova:user uuid="6ca9b88eef594d3d9fe150c21b3113fc">tempest-VolumesActionsTest-1233815310-project-member</nova:user>
Aug 09 18:40:32 user nova-compute[72418]:         <nova:project uuid="2d3a06fd12204e28b42e073812d67248">tempest-VolumesActionsTest-1233815310</nova:project>
Aug 09 18:40:32 user nova-compute[72418]:       </nova:owner>
Aug 09 18:40:32 user nova-compute[72418]:       <nova:root type="image" uuid="8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e"/>
Aug 09 18:40:32 user nova-compute[72418]:       <nova:ports>
Aug 09 18:40:32 user nova-compute[72418]:         <nova:port uuid="00b2459b-f98c-46c5-8e73-07894ab10384">
Aug 09 18:40:32 user nova-compute[72418]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 09 18:40:32 user nova-compute[72418]:         </nova:port>
Aug 09 18:40:32 user nova-compute[72418]:       </nova:ports>
Aug 09 18:40:32 user nova-compute[72418]:     </nova:instance>
Aug 09 18:40:32 user nova-compute[72418]:   </metadata>
Aug 09 18:40:32 user nova-compute[72418]:   <sysinfo type="smbios">
Aug 09 18:40:32 user nova-compute[72418]:     <system>
Aug 09 18:40:32 user nova-compute[72418]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 18:40:32 user nova-compute[72418]:       <entry name="product">OpenStack Nova</entry>
Aug 09 18:40:32 user nova-compute[72418]:       <entry name="version">0.0.0</entry>
Aug 09 18:40:32 user nova-compute[72418]:       <entry name="serial">8893bd80-5708-47a5-a9d0-cd0ed6d73e52</entry>
Aug 09 18:40:32 user nova-compute[72418]:       <entry name="uuid">8893bd80-5708-47a5-a9d0-cd0ed6d73e52</entry>
Aug 09 18:40:32 user nova-compute[72418]:       <entry name="family">Virtual Machine</entry>
Aug 09 18:40:32 user nova-compute[72418]:     </system>
Aug 09 18:40:32 user nova-compute[72418]:   </sysinfo>
Aug 09 18:40:32 user nova-compute[72418]:   <os>
Aug 09 18:40:32 user nova-compute[72418]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 18:40:32 user nova-compute[72418]:     <boot dev="hd"/>
Aug 09 18:40:32 user nova-compute[72418]:     <smbios mode="sysinfo"/>
Aug 09 18:40:32 user nova-compute[72418]:   </os>
Aug 09 18:40:32 user nova-compute[72418]:   <features>
Aug 09 18:40:32 user nova-compute[72418]:     <acpi/>
Aug 09 18:40:32 user nova-compute[72418]:     <apic/>
Aug 09 18:40:32 user nova-compute[72418]:     <vmcoreinfo/>
Aug 09 18:40:32 user nova-compute[72418]:   </features>
Aug 09 18:40:32 user nova-compute[72418]:   <clock offset="utc">
Aug 09 18:40:32 user nova-compute[72418]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 18:40:32 user nova-compute[72418]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 18:40:32 user nova-compute[72418]:     <timer name="hpet" present="no"/>
Aug 09 18:40:32 user nova-compute[72418]:   </clock>
Aug 09 18:40:32 user nova-compute[72418]:   <cpu mode="custom" match="exact">
Aug 09 18:40:32 user nova-compute[72418]:     <model>Nehalem</model>
Aug 09 18:40:32 user nova-compute[72418]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 18:40:32 user nova-compute[72418]:   </cpu>
Aug 09 18:40:32 user nova-compute[72418]:   <devices>
Aug 09 18:40:32 user nova-compute[72418]:     <disk type="file" device="disk">
Aug 09 18:40:32 user nova-compute[72418]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 18:40:32 user nova-compute[72418]:       <source file="/opt/stack/data/nova/instances/8893bd80-5708-47a5-a9d0-cd0ed6d73e52/disk"/>
Aug 09 18:40:32 user nova-compute[72418]:       <target dev="vda" bus="virtio"/>
Aug 09 18:40:32 user nova-compute[72418]:     </disk>
Aug 09 18:40:32 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:40:32 user nova-compute[72418]:       <mac address="fa:16:3e:0c:6e:ea"/>
Aug 09 18:40:32 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:40:32 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:40:32 user nova-compute[72418]:       <target dev="tap00b2459b-f9"/>
Aug 09 18:40:32 user nova-compute[72418]:     </interface>
Aug 09 18:40:32 user nova-compute[72418]:     <serial type="pty">
Aug 09 18:40:32 user nova-compute[72418]:       <log file="/opt/stack/data/nova/instances/8893bd80-5708-47a5-a9d0-cd0ed6d73e52/console.log" append="off"/>
Aug 09 18:40:32 user nova-compute[72418]:     </serial>
Aug 09 18:40:32 user nova-compute[72418]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 18:40:32 user nova-compute[72418]:     <video>
Aug 09 18:40:32 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:40:32 user nova-compute[72418]:     </video>
Aug 09 18:40:32 user nova-compute[72418]:     <rng model="virtio">
Aug 09 18:40:32 user nova-compute[72418]:       <backend model="random">/dev/urandom</backend>
Aug 09 18:40:32 user nova-compute[72418]:     </rng>
Aug 09 18:40:32 user nova-compute[72418]:     <controller type="usb" index="0" model="none"/>
Aug 09 18:40:32 user nova-compute[72418]:     <memballoon model="virtio">
Aug 09 18:40:32 user nova-compute[72418]:       <stats period="10"/>
Aug 09 18:40:32 user nova-compute[72418]:     </memballoon>
Aug 09 18:40:32 user nova-compute[72418]:   </devices>
Aug 09 18:40:32 user nova-compute[72418]: </domain>
Aug 09 18:40:32 user nova-compute[72418]:  {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 18:40:32 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:40:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1416142219',display_name='tempest-VolumesActionsTest-instance-1416142219',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1416142219',id=34,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d3a06fd12204e28b42e073812d67248',ramdisk_id='',reservation_id='r-pvb56h4p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1233815310',owner_user_name='tempest-VolumesActionsTest-1233815310-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:40:30Z,user_data=None,user_id='6ca9b88eef594d3d9fe150c21b3113fc',uuid=8893bd80-5708-47a5-a9d0-cd0ed6d73e52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00b2459b-f98c-46c5-8e73-07894ab10384", "address": "fa:16:3e:0c:6e:ea", "network": {"id": "5052c479-912b-48b4-b29a-770428231240", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1712606204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d3a06fd12204e28b42e073812d67248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00b2459b-f9", "ovs_interfaceid": "00b2459b-f98c-46c5-8e73-07894ab10384", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:40:32 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Converting VIF {"id": "00b2459b-f98c-46c5-8e73-07894ab10384", "address": "fa:16:3e:0c:6e:ea", "network": {"id": "5052c479-912b-48b4-b29a-770428231240", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1712606204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d3a06fd12204e28b42e073812d67248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00b2459b-f9", "ovs_interfaceid": "00b2459b-f98c-46c5-8e73-07894ab10384", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:40:32 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:6e:ea,bridge_name='br-int',has_traffic_filtering=True,id=00b2459b-f98c-46c5-8e73-07894ab10384,network=Network(5052c479-912b-48b4-b29a-770428231240),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00b2459b-f9') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:40:32 user nova-compute[72418]: DEBUG os_vif [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:6e:ea,bridge_name='br-int',has_traffic_filtering=True,id=00b2459b-f98c-46c5-8e73-07894ab10384,network=Network(5052c479-912b-48b4-b29a-770428231240),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00b2459b-f9') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:40:32 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:32 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:40:32 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:40:32 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:32 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap00b2459b-f9, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:40:32 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap00b2459b-f9, col_values=(('external_ids', {'iface-id': '00b2459b-f98c-46c5-8e73-07894ab10384', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:6e:ea', 'vm-uuid': '8893bd80-5708-47a5-a9d0-cd0ed6d73e52'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:40:32 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:32 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:40:32 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:32 user nova-compute[72418]: INFO os_vif [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:6e:ea,bridge_name='br-int',has_traffic_filtering=True,id=00b2459b-f98c-46c5-8e73-07894ab10384,network=Network(5052c479-912b-48b4-b29a-770428231240),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00b2459b-f9')
Aug 09 18:40:32 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:40:32 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] No VIF found with MAC fa:16:3e:0c:6e:ea, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:40:33 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:34 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:34 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:34 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:34 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:34 user nova-compute[72418]: DEBUG nova.compute.manager [req-938a8a3a-d5bd-4b16-9e09-99ad7c1142b8 req-71664062-ba20-4e99-a93b-167975419fdd service nova] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Received event network-vif-plugged-00b2459b-f98c-46c5-8e73-07894ab10384 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:40:34 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-938a8a3a-d5bd-4b16-9e09-99ad7c1142b8 req-71664062-ba20-4e99-a93b-167975419fdd service nova] Acquiring lock "8893bd80-5708-47a5-a9d0-cd0ed6d73e52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:40:34 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-938a8a3a-d5bd-4b16-9e09-99ad7c1142b8 req-71664062-ba20-4e99-a93b-167975419fdd service nova] Lock "8893bd80-5708-47a5-a9d0-cd0ed6d73e52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:40:34 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-938a8a3a-d5bd-4b16-9e09-99ad7c1142b8 req-71664062-ba20-4e99-a93b-167975419fdd service nova] Lock "8893bd80-5708-47a5-a9d0-cd0ed6d73e52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:40:34 user nova-compute[72418]: DEBUG nova.compute.manager [req-938a8a3a-d5bd-4b16-9e09-99ad7c1142b8 req-71664062-ba20-4e99-a93b-167975419fdd service nova] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] No waiting events found dispatching network-vif-plugged-00b2459b-f98c-46c5-8e73-07894ab10384 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:40:34 user nova-compute[72418]: WARNING nova.compute.manager [req-938a8a3a-d5bd-4b16-9e09-99ad7c1142b8 req-71664062-ba20-4e99-a93b-167975419fdd service nova] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Received unexpected event network-vif-plugged-00b2459b-f98c-46c5-8e73-07894ab10384 for instance with vm_state building and task_state spawning.
Aug 09 18:40:34 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:34 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:34 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:36 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691606436.2779722, 8893bd80-5708-47a5-a9d0-cd0ed6d73e52 => Resumed> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:40:36 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] VM Resumed (Lifecycle Event)
Aug 09 18:40:36 user nova-compute[72418]: DEBUG nova.compute.manager [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Instance event wait completed in 0 seconds for  {{(pid=72418) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 18:40:36 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Guest created on hypervisor {{(pid=72418) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 18:40:36 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Instance spawned successfully.
Aug 09 18:40:36 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 18:40:36 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:40:36 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:40:36 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Found default for hw_cdrom_bus of ide {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:40:36 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Found default for hw_disk_bus of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:40:36 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Found default for hw_input_bus of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:40:36 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Found default for hw_pointer_model of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:40:36 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Found default for hw_video_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:40:36 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Found default for hw_vif_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:40:36 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:40:36 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691606436.2814116, 8893bd80-5708-47a5-a9d0-cd0ed6d73e52 => Started> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:40:36 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] VM Started (Lifecycle Event)
Aug 09 18:40:36 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:40:36 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:40:36 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:40:36 user nova-compute[72418]: DEBUG nova.compute.manager [req-faf3fcf6-3705-4ac4-8e11-28d5f3c3d6f3 req-b4da9cab-8c0e-4475-96b8-bdbedcd9e017 service nova] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Received event network-vif-plugged-00b2459b-f98c-46c5-8e73-07894ab10384 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:40:36 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-faf3fcf6-3705-4ac4-8e11-28d5f3c3d6f3 req-b4da9cab-8c0e-4475-96b8-bdbedcd9e017 service nova] Acquiring lock "8893bd80-5708-47a5-a9d0-cd0ed6d73e52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:40:36 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-faf3fcf6-3705-4ac4-8e11-28d5f3c3d6f3 req-b4da9cab-8c0e-4475-96b8-bdbedcd9e017 service nova] Lock "8893bd80-5708-47a5-a9d0-cd0ed6d73e52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:40:36 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-faf3fcf6-3705-4ac4-8e11-28d5f3c3d6f3 req-b4da9cab-8c0e-4475-96b8-bdbedcd9e017 service nova] Lock "8893bd80-5708-47a5-a9d0-cd0ed6d73e52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:40:36 user nova-compute[72418]: DEBUG nova.compute.manager [req-faf3fcf6-3705-4ac4-8e11-28d5f3c3d6f3 req-b4da9cab-8c0e-4475-96b8-bdbedcd9e017 service nova] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] No waiting events found dispatching network-vif-plugged-00b2459b-f98c-46c5-8e73-07894ab10384 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:40:36 user nova-compute[72418]: WARNING nova.compute.manager [req-faf3fcf6-3705-4ac4-8e11-28d5f3c3d6f3 req-b4da9cab-8c0e-4475-96b8-bdbedcd9e017 service nova] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Received unexpected event network-vif-plugged-00b2459b-f98c-46c5-8e73-07894ab10384 for instance with vm_state building and task_state spawning.
Aug 09 18:40:36 user nova-compute[72418]: INFO nova.compute.manager [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Took 6.00 seconds to spawn the instance on the hypervisor.
Aug 09 18:40:36 user nova-compute[72418]: DEBUG nova.compute.manager [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:40:36 user nova-compute[72418]: INFO nova.compute.manager [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Took 6.62 seconds to build instance.
Aug 09 18:40:36 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-bce5fa85-8bdd-4d97-be7e-f90060bb507d tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Lock "8893bd80-5708-47a5-a9d0-cd0ed6d73e52" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.730s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:40:37 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:38 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:42 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:43 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:45 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-646a8a0d-3048-4978-973f-ab8f165c8752 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquiring lock "e019064c-955e-4f80-9b00-6b32b3835d58" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:40:45 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-646a8a0d-3048-4978-973f-ab8f165c8752 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "e019064c-955e-4f80-9b00-6b32b3835d58" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:40:45 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-646a8a0d-3048-4978-973f-ab8f165c8752 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquiring lock "e019064c-955e-4f80-9b00-6b32b3835d58-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:40:45 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-646a8a0d-3048-4978-973f-ab8f165c8752 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "e019064c-955e-4f80-9b00-6b32b3835d58-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:40:45 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-646a8a0d-3048-4978-973f-ab8f165c8752 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "e019064c-955e-4f80-9b00-6b32b3835d58-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:40:45 user nova-compute[72418]: INFO nova.compute.manager [None req-646a8a0d-3048-4978-973f-ab8f165c8752 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Terminating instance
Aug 09 18:40:45 user nova-compute[72418]: DEBUG nova.compute.manager [None req-646a8a0d-3048-4978-973f-ab8f165c8752 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Start destroying the instance on the hypervisor. {{(pid=72418) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 18:40:45 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:45 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:45 user nova-compute[72418]: DEBUG nova.compute.manager [req-51fec42b-34c3-4290-9f72-4ac27e3166f4 req-40ead95a-2274-4ce8-b286-34dd20f6674d service nova] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Received event network-vif-unplugged-4c6c632a-142b-4cda-92c8-77026645af09 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:40:45 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-51fec42b-34c3-4290-9f72-4ac27e3166f4 req-40ead95a-2274-4ce8-b286-34dd20f6674d service nova] Acquiring lock "e019064c-955e-4f80-9b00-6b32b3835d58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:40:45 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-51fec42b-34c3-4290-9f72-4ac27e3166f4 req-40ead95a-2274-4ce8-b286-34dd20f6674d service nova] Lock "e019064c-955e-4f80-9b00-6b32b3835d58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:40:45 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-51fec42b-34c3-4290-9f72-4ac27e3166f4 req-40ead95a-2274-4ce8-b286-34dd20f6674d service nova] Lock "e019064c-955e-4f80-9b00-6b32b3835d58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:40:45 user nova-compute[72418]: DEBUG nova.compute.manager [req-51fec42b-34c3-4290-9f72-4ac27e3166f4 req-40ead95a-2274-4ce8-b286-34dd20f6674d service nova] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] No waiting events found dispatching network-vif-unplugged-4c6c632a-142b-4cda-92c8-77026645af09 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:40:45 user nova-compute[72418]: DEBUG nova.compute.manager [req-51fec42b-34c3-4290-9f72-4ac27e3166f4 req-40ead95a-2274-4ce8-b286-34dd20f6674d service nova] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Received event network-vif-unplugged-4c6c632a-142b-4cda-92c8-77026645af09 for instance with task_state deleting. {{(pid=72418) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 18:40:45 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:45 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:46 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Instance destroyed successfully.
Aug 09 18:40:46 user nova-compute[72418]: DEBUG nova.objects.instance [None req-646a8a0d-3048-4978-973f-ab8f165c8752 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lazy-loading 'resources' on Instance uuid e019064c-955e-4f80-9b00-6b32b3835d58 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-646a8a0d-3048-4978-973f-ab8f165c8752 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:24:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1312766715',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1312766715',id=14,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:26:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52e5863cda54487682a4edcc24202c91',ramdisk_id='',reservation_id='r-k5vy0lqf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1120385592',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:28:42Z,user_data=None,user_id='621fd2b971c543d197a354c38e0d1867',uuid=e019064c-955e-4f80-9b00-6b32b3835d58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c6c632a-142b-4cda-92c8-77026645af09", "address": "fa:16:3e:15:18:a4", "network": {"id": "beaefb5c-f5e4-47e7-ab68-60131f532ade", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e5863cda54487682a4edcc24202c91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c6c632a-14", "ovs_interfaceid": "4c6c632a-142b-4cda-92c8-77026645af09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-646a8a0d-3048-4978-973f-ab8f165c8752 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Converting VIF {"id": "4c6c632a-142b-4cda-92c8-77026645af09", "address": "fa:16:3e:15:18:a4", "network": {"id": "beaefb5c-f5e4-47e7-ab68-60131f532ade", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e5863cda54487682a4edcc24202c91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c6c632a-14", "ovs_interfaceid": "4c6c632a-142b-4cda-92c8-77026645af09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-646a8a0d-3048-4978-973f-ab8f165c8752 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:18:a4,bridge_name='br-int',has_traffic_filtering=True,id=4c6c632a-142b-4cda-92c8-77026645af09,network=Network(beaefb5c-f5e4-47e7-ab68-60131f532ade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c6c632a-14') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG os_vif [None req-646a8a0d-3048-4978-973f-ab8f165c8752 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:18:a4,bridge_name='br-int',has_traffic_filtering=True,id=4c6c632a-142b-4cda-92c8-77026645af09,network=Network(beaefb5c-f5e4-47e7-ab68-60131f532ade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c6c632a-14') {{(pid=72418) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c6c632a-14, bridge=br-int, if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:46 user nova-compute[72418]: INFO os_vif [None req-646a8a0d-3048-4978-973f-ab8f165c8752 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:18:a4,bridge_name='br-int',has_traffic_filtering=True,id=4c6c632a-142b-4cda-92c8-77026645af09,network=Network(beaefb5c-f5e4-47e7-ab68-60131f532ade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c6c632a-14')
Aug 09 18:40:46 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-646a8a0d-3048-4978-973f-ab8f165c8752 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] calling os-brick to detach iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-646a8a0d-3048-4978-973f-ab8f165c8752 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, {'target_iqns': ['iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EYQJoplb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:40:46 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-646a8a0d-3048-4978-973f-ab8f165c8752 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:40:46 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-646a8a0d-3048-4978-973f-ab8f165c8752 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-646a8a0d-3048-4978-973f-ab8f165c8752 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-646a8a0d-3048-4978-973f-ab8f165c8752 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292', 0)] {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4f2b80-e3dc-434f-8e01-a17a97b8dd3f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[85199255-f7b3-4fd1-a02f-eac4dd386e44]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-646a8a0d-3048-4978-973f-ab8f165c8752 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:40:46 user nova-compute[72418]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)
Aug 09 18:40:46 user nova-compute[72418]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c (non-flash)
Aug 09 18:40:46 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-646a8a0d-3048-4978-973f-ab8f165c8752 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 (non-flash)
Aug 09 18:40:46 user nova-compute[72418]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)
Aug 09 18:40:46 user nova-compute[72418]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c (non-flash)
Aug 09 18:40:46 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-646a8a0d-3048-4978-973f-ab8f165c8752 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f42d4689ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292'): ({'sdb'}, set())}) {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-646a8a0d-3048-4978-973f-ab8f165c8752 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Removing single pathed devices sdb {{(pid=72418) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6e24f5-f8a5-40fe-bf1a-3670e7cb616e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74588ef-771e-432a-9e43-aec157e2dff6]: (4, ('ok\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-646a8a0d-3048-4978-973f-ab8f165c8752 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Flushing IO for device /dev/sdb {{(pid=72418) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[184a96de-c4a1-463e-a898-a25fa57baf13]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-646a8a0d-3048-4978-973f-ab8f165c8752 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72418) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e7658a-57b9-4439-808b-e31ecabbef15]: (4, ('1', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-646a8a0d-3048-4978-973f-ab8f165c8752 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-646a8a0d-3048-4978-973f-ab8f165c8752 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] SCSI volumes sdb have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-646a8a0d-3048-4978-973f-ab8f165c8752 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292')] {{(pid=72418) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[37dbeff2-c30d-492c-8c05-1b94cd74163b]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-646a8a0d-3048-4978-973f-ab8f165c8752 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 -p 172.16.0.220:3260 --logout {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2526160-b315-460f-8771-cbe58d994fd2]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-646a8a0d-3048-4978-973f-ab8f165c8752 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292, portal: 172.16.0.220,3260]
Aug 09 18:40:46 user nova-compute[72418]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292, portal: 172.16.0.220,3260] successful.
Aug 09 18:40:46 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 -p 172.16.0.220:3260 --op delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf6e1fe4-e93e-4920-bdab-02a219161292 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[8092adf0-f664-4e2e-ac46-11e71556e57d]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-646a8a0d-3048-4978-973f-ab8f165c8752 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-646a8a0d-3048-4978-973f-ab8f165c8752 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-646a8a0d-3048-4978-973f-ab8f165c8752 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] <== disconnect_volume: return (310ms) None {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-646a8a0d-3048-4978-973f-ab8f165c8752 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Disconnected iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 18:40:46 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-646a8a0d-3048-4978-973f-ab8f165c8752 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Deleting instance files /opt/stack/data/nova/instances/e019064c-955e-4f80-9b00-6b32b3835d58_del
Aug 09 18:40:46 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-646a8a0d-3048-4978-973f-ab8f165c8752 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Deletion of /opt/stack/data/nova/instances/e019064c-955e-4f80-9b00-6b32b3835d58_del complete
Aug 09 18:40:46 user nova-compute[72418]: INFO nova.compute.manager [None req-646a8a0d-3048-4978-973f-ab8f165c8752 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Took 1.24 seconds to destroy the instance on the hypervisor.
Aug 09 18:40:46 user nova-compute[72418]: DEBUG oslo.service.loopingcall [None req-646a8a0d-3048-4978-973f-ab8f165c8752 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72418) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG nova.compute.manager [-] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Deallocating network for instance {{(pid=72418) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] deallocate_for_instance() {{(pid=72418) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:46 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:47 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:40:47 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Took 0.45 seconds to deallocate network for instance.
Aug 09 18:40:47 user nova-compute[72418]: DEBUG nova.compute.manager [req-28ff8381-7d68-4623-b14d-9e24d94b26fc req-585de3c4-6490-40dd-b899-15dede8013c7 service nova] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Received event network-vif-deleted-4c6c632a-142b-4cda-92c8-77026645af09 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:40:47 user nova-compute[72418]: INFO nova.compute.manager [req-28ff8381-7d68-4623-b14d-9e24d94b26fc req-585de3c4-6490-40dd-b899-15dede8013c7 service nova] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Neutron deleted interface 4c6c632a-142b-4cda-92c8-77026645af09; detaching it from the instance and deleting it from the info cache
Aug 09 18:40:47 user nova-compute[72418]: DEBUG nova.network.neutron [req-28ff8381-7d68-4623-b14d-9e24d94b26fc req-585de3c4-6490-40dd-b899-15dede8013c7 service nova] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:40:47 user nova-compute[72418]: DEBUG nova.compute.manager [req-28ff8381-7d68-4623-b14d-9e24d94b26fc req-585de3c4-6490-40dd-b899-15dede8013c7 service nova] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Detach interface failed, port_id=4c6c632a-142b-4cda-92c8-77026645af09, reason: Instance e019064c-955e-4f80-9b00-6b32b3835d58 could not be found. {{(pid=72418) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 18:40:47 user nova-compute[72418]: DEBUG nova.compute.manager [req-e68eb4bb-98ba-4e58-80f8-6f5566b2063c req-e0d88e4e-a6b9-4eb5-9a71-1a40f3dc8824 service nova] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Received event network-vif-plugged-4c6c632a-142b-4cda-92c8-77026645af09 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:40:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-e68eb4bb-98ba-4e58-80f8-6f5566b2063c req-e0d88e4e-a6b9-4eb5-9a71-1a40f3dc8824 service nova] Acquiring lock "e019064c-955e-4f80-9b00-6b32b3835d58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:40:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-e68eb4bb-98ba-4e58-80f8-6f5566b2063c req-e0d88e4e-a6b9-4eb5-9a71-1a40f3dc8824 service nova] Lock "e019064c-955e-4f80-9b00-6b32b3835d58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:40:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-e68eb4bb-98ba-4e58-80f8-6f5566b2063c req-e0d88e4e-a6b9-4eb5-9a71-1a40f3dc8824 service nova] Lock "e019064c-955e-4f80-9b00-6b32b3835d58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:40:47 user nova-compute[72418]: DEBUG nova.compute.manager [req-e68eb4bb-98ba-4e58-80f8-6f5566b2063c req-e0d88e4e-a6b9-4eb5-9a71-1a40f3dc8824 service nova] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] No waiting events found dispatching network-vif-plugged-4c6c632a-142b-4cda-92c8-77026645af09 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:40:47 user nova-compute[72418]: WARNING nova.compute.manager [req-e68eb4bb-98ba-4e58-80f8-6f5566b2063c req-e0d88e4e-a6b9-4eb5-9a71-1a40f3dc8824 service nova] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Received unexpected event network-vif-plugged-4c6c632a-142b-4cda-92c8-77026645af09 for instance with vm_state active and task_state deleting.
Aug 09 18:40:47 user nova-compute[72418]: INFO nova.compute.manager [None req-646a8a0d-3048-4978-973f-ab8f165c8752 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Took 0.76 seconds to detach 1 volumes for instance.
Aug 09 18:40:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-646a8a0d-3048-4978-973f-ab8f165c8752 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:40:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-646a8a0d-3048-4978-973f-ab8f165c8752 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:40:48 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-646a8a0d-3048-4978-973f-ab8f165c8752 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:40:48 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-646a8a0d-3048-4978-973f-ab8f165c8752 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:40:48 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-646a8a0d-3048-4978-973f-ab8f165c8752 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.243s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:40:48 user nova-compute[72418]: INFO nova.scheduler.client.report [None req-646a8a0d-3048-4978-973f-ab8f165c8752 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Deleted allocations for instance e019064c-955e-4f80-9b00-6b32b3835d58
Aug 09 18:40:48 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-646a8a0d-3048-4978-973f-ab8f165c8752 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "e019064c-955e-4f80-9b00-6b32b3835d58" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.871s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:40:51 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:53 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:56 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:58 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:58 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:40:58 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:41:00 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:41:00 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:41:00 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:41:00 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72418) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 18:41:00 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:41:01 user nova-compute[72418]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691606446.26349, e019064c-955e-4f80-9b00-6b32b3835d58 => Stopped> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:41:01 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] VM Stopped (Lifecycle Event)
Aug 09 18:41:01 user nova-compute[72418]: DEBUG nova.compute.manager [None req-26b099f9-6fc5-4ff1-b629-f9de14d02eff None None] [instance: e019064c-955e-4f80-9b00-6b32b3835d58] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:41:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:41:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:41:01 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:41:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:41:03 user nova-compute[72418]: INFO nova.compute.manager [None req-5fdd76b8-96dd-4034-970d-5224b24884d8 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Get console output
Aug 09 18:41:03 user nova-compute[72418]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 09 18:41:03 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:41:03 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Starting heal instance info cache {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 18:41:04 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "refresh_cache-c46f2599-93f8-412e-9918-7ace8a9f19dd" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:41:04 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquired lock "refresh_cache-c46f2599-93f8-412e-9918-7ace8a9f19dd" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:41:04 user nova-compute[72418]: DEBUG nova.network.neutron [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Forcefully refreshing network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 18:41:04 user nova-compute[72418]: DEBUG nova.network.neutron [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Updating instance_info_cache with network_info: [{"id": "6c9676d3-6e5d-4a95-a24f-0df4a15e993d", "address": "fa:16:3e:80:17:d9", "network": {"id": "bd36ef30-e57d-473f-97bc-c51b5db08aa7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-425133239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78b6e36a5b61456092ce7de9212c3c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9676d3-6e", "ovs_interfaceid": "6c9676d3-6e5d-4a95-a24f-0df4a15e993d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:41:04 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Releasing lock "refresh_cache-c46f2599-93f8-412e-9918-7ace8a9f19dd" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:41:04 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Updated the network info_cache for instance {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 18:41:04 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:41:04 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:41:06 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:41:07 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:41:07 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:41:07 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:41:07 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:41:07 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Auditing locally available compute resources for user (node: user) {{(pid=72418) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 18:41:08 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:41:08 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:41:08 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:41:08 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:41:08 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:41:08 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:41:08 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:41:08 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:41:08 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:41:08 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:41:08 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/disk.rescue --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:41:08 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:41:08 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/disk.rescue --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:41:08 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:41:08 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:41:08 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:41:09 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:41:09 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:41:09 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:41:09 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8893bd80-5708-47a5-a9d0-cd0ed6d73e52/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:41:09 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8893bd80-5708-47a5-a9d0-cd0ed6d73e52/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:41:09 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8893bd80-5708-47a5-a9d0-cd0ed6d73e52/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:41:09 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8893bd80-5708-47a5-a9d0-cd0ed6d73e52/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:41:09 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:41:09 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:41:09 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:41:09 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:41:10 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:41:10 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:41:10 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Hypervisor/Node resource view: name=user free_ram=7949MB free_disk=25.334239959716797GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72418) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 18:41:10 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:41:10 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:41:10 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 8fe41968-a219-4a5a-afdb-32eb2082bb40 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:41:10 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance c46f2599-93f8-412e-9918-7ace8a9f19dd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:41:10 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 4e1a095f-a2e7-4ab6-bb7e-38cda890d567 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:41:10 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 0659fd5c-cb05-441e-94b6-9d05f7135893 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:41:10 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:41:10 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 8893bd80-5708-47a5-a9d0-cd0ed6d73e52 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:41:10 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 18:41:10 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 18:41:10 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:41:10 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:41:10 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Compute_service record updated for user:user {{(pid=72418) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 18:41:10 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.411s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:41:11 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:41:16 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:41:21 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:41:26 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:41:31 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:41:36 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-227cf834-3562-4f47-9061-63ff79a7f323 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquiring lock "8fe41968-a219-4a5a-afdb-32eb2082bb40" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:41:36 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-227cf834-3562-4f47-9061-63ff79a7f323 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "8fe41968-a219-4a5a-afdb-32eb2082bb40" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:41:36 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-227cf834-3562-4f47-9061-63ff79a7f323 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquiring lock "8fe41968-a219-4a5a-afdb-32eb2082bb40-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:41:36 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-227cf834-3562-4f47-9061-63ff79a7f323 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "8fe41968-a219-4a5a-afdb-32eb2082bb40-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:41:36 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-227cf834-3562-4f47-9061-63ff79a7f323 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "8fe41968-a219-4a5a-afdb-32eb2082bb40-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:41:36 user nova-compute[72418]: INFO nova.compute.manager [None req-227cf834-3562-4f47-9061-63ff79a7f323 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Terminating instance
Aug 09 18:41:36 user nova-compute[72418]: DEBUG nova.compute.manager [None req-227cf834-3562-4f47-9061-63ff79a7f323 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Start destroying the instance on the hypervisor. {{(pid=72418) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 18:41:36 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:41:36 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:41:36 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:41:36 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:41:36 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:41:36 user nova-compute[72418]: DEBUG nova.compute.manager [req-902a0a0f-5458-4661-a0a4-0d18c9b12f79 req-4c800244-02dd-430b-bfd7-f28bae85854f service nova] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Received event network-vif-unplugged-2e2b5832-b357-4012-8bfc-d26009aa91f8 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:41:36 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-902a0a0f-5458-4661-a0a4-0d18c9b12f79 req-4c800244-02dd-430b-bfd7-f28bae85854f service nova] Acquiring lock "8fe41968-a219-4a5a-afdb-32eb2082bb40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:41:36 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-902a0a0f-5458-4661-a0a4-0d18c9b12f79 req-4c800244-02dd-430b-bfd7-f28bae85854f service nova] Lock "8fe41968-a219-4a5a-afdb-32eb2082bb40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:41:36 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-902a0a0f-5458-4661-a0a4-0d18c9b12f79 req-4c800244-02dd-430b-bfd7-f28bae85854f service nova] Lock "8fe41968-a219-4a5a-afdb-32eb2082bb40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:41:36 user nova-compute[72418]: DEBUG nova.compute.manager [req-902a0a0f-5458-4661-a0a4-0d18c9b12f79 req-4c800244-02dd-430b-bfd7-f28bae85854f service nova] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] No waiting events found dispatching network-vif-unplugged-2e2b5832-b357-4012-8bfc-d26009aa91f8 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:41:36 user nova-compute[72418]: DEBUG nova.compute.manager [req-902a0a0f-5458-4661-a0a4-0d18c9b12f79 req-4c800244-02dd-430b-bfd7-f28bae85854f service nova] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Received event network-vif-unplugged-2e2b5832-b357-4012-8bfc-d26009aa91f8 for instance with task_state deleting. {{(pid=72418) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 18:41:36 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Instance destroyed successfully.
Aug 09 18:41:36 user nova-compute[72418]: DEBUG nova.objects.instance [None req-227cf834-3562-4f47-9061-63ff79a7f323 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lazy-loading 'resources' on Instance uuid 8fe41968-a219-4a5a-afdb-32eb2082bb40 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:41:36 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-227cf834-3562-4f47-9061-63ff79a7f323 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:21:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-127597739',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-127597739',id=2,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:22:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52e5863cda54487682a4edcc24202c91',ramdisk_id='',reservation_id='r-ng058tj6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1120385592',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:23:52Z,user_data=None,user_id='621fd2b971c543d197a354c38e0d1867',uuid=8fe41968-a219-4a5a-afdb-32eb2082bb40,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e2b5832-b357-4012-8bfc-d26009aa91f8", "address": "fa:16:3e:ee:f9:5d", "network": {"id": "beaefb5c-f5e4-47e7-ab68-60131f532ade", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e5863cda54487682a4edcc24202c91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2b5832-b3", "ovs_interfaceid": "2e2b5832-b357-4012-8bfc-d26009aa91f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 18:41:36 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-227cf834-3562-4f47-9061-63ff79a7f323 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Converting VIF {"id": "2e2b5832-b357-4012-8bfc-d26009aa91f8", "address": "fa:16:3e:ee:f9:5d", "network": {"id": "beaefb5c-f5e4-47e7-ab68-60131f532ade", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2010904680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52e5863cda54487682a4edcc24202c91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2b5832-b3", "ovs_interfaceid": "2e2b5832-b357-4012-8bfc-d26009aa91f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:41:36 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-227cf834-3562-4f47-9061-63ff79a7f323 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:f9:5d,bridge_name='br-int',has_traffic_filtering=True,id=2e2b5832-b357-4012-8bfc-d26009aa91f8,network=Network(beaefb5c-f5e4-47e7-ab68-60131f532ade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e2b5832-b3') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:41:36 user nova-compute[72418]: DEBUG os_vif [None req-227cf834-3562-4f47-9061-63ff79a7f323 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:f9:5d,bridge_name='br-int',has_traffic_filtering=True,id=2e2b5832-b357-4012-8bfc-d26009aa91f8,network=Network(beaefb5c-f5e4-47e7-ab68-60131f532ade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e2b5832-b3') {{(pid=72418) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 18:41:36 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:41:36 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e2b5832-b3, bridge=br-int, if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:41:36 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:41:36 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:41:36 user nova-compute[72418]: INFO os_vif [None req-227cf834-3562-4f47-9061-63ff79a7f323 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:f9:5d,bridge_name='br-int',has_traffic_filtering=True,id=2e2b5832-b357-4012-8bfc-d26009aa91f8,network=Network(beaefb5c-f5e4-47e7-ab68-60131f532ade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e2b5832-b3')
Aug 09 18:41:36 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-227cf834-3562-4f47-9061-63ff79a7f323 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Deleting instance files /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40_del
Aug 09 18:41:36 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-227cf834-3562-4f47-9061-63ff79a7f323 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Deletion of /opt/stack/data/nova/instances/8fe41968-a219-4a5a-afdb-32eb2082bb40_del complete
Aug 09 18:41:36 user nova-compute[72418]: INFO nova.compute.manager [None req-227cf834-3562-4f47-9061-63ff79a7f323 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Took 0.68 seconds to destroy the instance on the hypervisor.
Aug 09 18:41:36 user nova-compute[72418]: DEBUG oslo.service.loopingcall [None req-227cf834-3562-4f47-9061-63ff79a7f323 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72418) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 18:41:36 user nova-compute[72418]: DEBUG nova.compute.manager [-] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Deallocating network for instance {{(pid=72418) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 18:41:36 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] deallocate_for_instance() {{(pid=72418) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 18:41:37 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:41:37 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Took 0.55 seconds to deallocate network for instance.
Aug 09 18:41:37 user nova-compute[72418]: DEBUG nova.compute.manager [req-68d93eeb-488c-48da-b838-f5f49633ce72 req-b2591dca-2627-4d66-8058-c83575149d91 service nova] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Received event network-vif-deleted-2e2b5832-b357-4012-8bfc-d26009aa91f8 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:41:37 user nova-compute[72418]: INFO nova.compute.manager [req-68d93eeb-488c-48da-b838-f5f49633ce72 req-b2591dca-2627-4d66-8058-c83575149d91 service nova] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Neutron deleted interface 2e2b5832-b357-4012-8bfc-d26009aa91f8; detaching it from the instance and deleting it from the info cache
Aug 09 18:41:37 user nova-compute[72418]: DEBUG nova.network.neutron [req-68d93eeb-488c-48da-b838-f5f49633ce72 req-b2591dca-2627-4d66-8058-c83575149d91 service nova] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:41:37 user nova-compute[72418]: DEBUG nova.compute.manager [req-68d93eeb-488c-48da-b838-f5f49633ce72 req-b2591dca-2627-4d66-8058-c83575149d91 service nova] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Detach interface failed, port_id=2e2b5832-b357-4012-8bfc-d26009aa91f8, reason: Instance 8fe41968-a219-4a5a-afdb-32eb2082bb40 could not be found. {{(pid=72418) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 18:41:37 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-227cf834-3562-4f47-9061-63ff79a7f323 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:41:37 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-227cf834-3562-4f47-9061-63ff79a7f323 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:41:37 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-227cf834-3562-4f47-9061-63ff79a7f323 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:41:37 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-227cf834-3562-4f47-9061-63ff79a7f323 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:41:37 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-227cf834-3562-4f47-9061-63ff79a7f323 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.217s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:41:37 user nova-compute[72418]: INFO nova.scheduler.client.report [None req-227cf834-3562-4f47-9061-63ff79a7f323 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Deleted allocations for instance 8fe41968-a219-4a5a-afdb-32eb2082bb40
Aug 09 18:41:37 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-227cf834-3562-4f47-9061-63ff79a7f323 tempest-ServerBootFromVolumeStableRescueTest-1120385592 tempest-ServerBootFromVolumeStableRescueTest-1120385592-project-member] Lock "8fe41968-a219-4a5a-afdb-32eb2082bb40" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.624s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:41:38 user nova-compute[72418]: DEBUG nova.compute.manager [req-710b4c89-2522-43bb-ad88-c594b1e7bf00 req-1087bf70-85af-4d0f-84d5-003d6263797f service nova] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Received event network-vif-plugged-2e2b5832-b357-4012-8bfc-d26009aa91f8 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:41:38 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-710b4c89-2522-43bb-ad88-c594b1e7bf00 req-1087bf70-85af-4d0f-84d5-003d6263797f service nova] Acquiring lock "8fe41968-a219-4a5a-afdb-32eb2082bb40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:41:38 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-710b4c89-2522-43bb-ad88-c594b1e7bf00 req-1087bf70-85af-4d0f-84d5-003d6263797f service nova] Lock "8fe41968-a219-4a5a-afdb-32eb2082bb40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:41:38 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-710b4c89-2522-43bb-ad88-c594b1e7bf00 req-1087bf70-85af-4d0f-84d5-003d6263797f service nova] Lock "8fe41968-a219-4a5a-afdb-32eb2082bb40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:41:38 user nova-compute[72418]: DEBUG nova.compute.manager [req-710b4c89-2522-43bb-ad88-c594b1e7bf00 req-1087bf70-85af-4d0f-84d5-003d6263797f service nova] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] No waiting events found dispatching network-vif-plugged-2e2b5832-b357-4012-8bfc-d26009aa91f8 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:41:38 user nova-compute[72418]: WARNING nova.compute.manager [req-710b4c89-2522-43bb-ad88-c594b1e7bf00 req-1087bf70-85af-4d0f-84d5-003d6263797f service nova] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Received unexpected event network-vif-plugged-2e2b5832-b357-4012-8bfc-d26009aa91f8 for instance with vm_state deleted and task_state None.
Aug 09 18:41:41 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:41:46 user nova-compute[72418]: INFO nova.compute.manager [None req-9f373a1f-9e4f-4a6e-b7c4-f6375d8dcf8d tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Unrescuing
Aug 09 18:41:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-9f373a1f-9e4f-4a6e-b7c4-f6375d8dcf8d tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Acquiring lock "refresh_cache-4e1a095f-a2e7-4ab6-bb7e-38cda890d567" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:41:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-9f373a1f-9e4f-4a6e-b7c4-f6375d8dcf8d tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Acquired lock "refresh_cache-4e1a095f-a2e7-4ab6-bb7e-38cda890d567" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:41:46 user nova-compute[72418]: DEBUG nova.network.neutron [None req-9f373a1f-9e4f-4a6e-b7c4-f6375d8dcf8d tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:41:46 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:41:46 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:41:46 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72418) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 18:41:46 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72418) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 18:41:46 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72418) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 18:41:46 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:41:47 user nova-compute[72418]: DEBUG nova.network.neutron [None req-9f373a1f-9e4f-4a6e-b7c4-f6375d8dcf8d tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Updating instance_info_cache with network_info: [{"id": "e6df16f7-7151-450f-bbf8-dc3be066011e", "address": "fa:16:3e:42:1f:2f", "network": {"id": "aa563713-99b7-4830-bbc5-5390076a264d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1029161501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99d09208fba747f29a90f95c5bb5ee4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6df16f7-71", "ovs_interfaceid": "e6df16f7-7151-450f-bbf8-dc3be066011e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:41:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-9f373a1f-9e4f-4a6e-b7c4-f6375d8dcf8d tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Releasing lock "refresh_cache-4e1a095f-a2e7-4ab6-bb7e-38cda890d567" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:41:47 user nova-compute[72418]: DEBUG nova.objects.instance [None req-9f373a1f-9e4f-4a6e-b7c4-f6375d8dcf8d tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Lazy-loading 'flavor' on Instance uuid 4e1a095f-a2e7-4ab6-bb7e-38cda890d567 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:41:47 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:41:47 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:41:47 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:41:47 user nova-compute[72418]: DEBUG nova.compute.manager [req-ffb9248e-6f54-4b1c-8a87-7cfcaa9656ee req-80e4e49f-41c9-4b3f-8ed2-0792a610e5ee service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Received event network-changed-e6df16f7-7151-450f-bbf8-dc3be066011e {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:41:47 user nova-compute[72418]: DEBUG nova.compute.manager [req-ffb9248e-6f54-4b1c-8a87-7cfcaa9656ee req-80e4e49f-41c9-4b3f-8ed2-0792a610e5ee service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Refreshing instance network info cache due to event network-changed-e6df16f7-7151-450f-bbf8-dc3be066011e. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:41:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-ffb9248e-6f54-4b1c-8a87-7cfcaa9656ee req-80e4e49f-41c9-4b3f-8ed2-0792a610e5ee service nova] Acquiring lock "refresh_cache-4e1a095f-a2e7-4ab6-bb7e-38cda890d567" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:41:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-ffb9248e-6f54-4b1c-8a87-7cfcaa9656ee req-80e4e49f-41c9-4b3f-8ed2-0792a610e5ee service nova] Acquired lock "refresh_cache-4e1a095f-a2e7-4ab6-bb7e-38cda890d567" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:41:47 user nova-compute[72418]: DEBUG nova.network.neutron [req-ffb9248e-6f54-4b1c-8a87-7cfcaa9656ee req-80e4e49f-41c9-4b3f-8ed2-0792a610e5ee service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Refreshing network info cache for port e6df16f7-7151-450f-bbf8-dc3be066011e {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:41:47 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:41:47 user nova-compute[72418]: DEBUG nova.compute.manager [req-42f82a60-5596-4168-bd25-fb2bca73087c req-ff183f7c-507a-4dc3-8af9-f113b89058cc service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Received event network-vif-unplugged-e6df16f7-7151-450f-bbf8-dc3be066011e {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:41:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-42f82a60-5596-4168-bd25-fb2bca73087c req-ff183f7c-507a-4dc3-8af9-f113b89058cc service nova] Acquiring lock "4e1a095f-a2e7-4ab6-bb7e-38cda890d567-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:41:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-42f82a60-5596-4168-bd25-fb2bca73087c req-ff183f7c-507a-4dc3-8af9-f113b89058cc service nova] Lock "4e1a095f-a2e7-4ab6-bb7e-38cda890d567-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:41:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-42f82a60-5596-4168-bd25-fb2bca73087c req-ff183f7c-507a-4dc3-8af9-f113b89058cc service nova] Lock "4e1a095f-a2e7-4ab6-bb7e-38cda890d567-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:41:47 user nova-compute[72418]: DEBUG nova.compute.manager [req-42f82a60-5596-4168-bd25-fb2bca73087c req-ff183f7c-507a-4dc3-8af9-f113b89058cc service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] No waiting events found dispatching network-vif-unplugged-e6df16f7-7151-450f-bbf8-dc3be066011e {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:41:47 user nova-compute[72418]: WARNING nova.compute.manager [req-42f82a60-5596-4168-bd25-fb2bca73087c req-ff183f7c-507a-4dc3-8af9-f113b89058cc service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Received unexpected event network-vif-unplugged-e6df16f7-7151-450f-bbf8-dc3be066011e for instance with vm_state rescued and task_state unrescuing.
Aug 09 18:41:48 user nova-compute[72418]: DEBUG nova.network.neutron [req-ffb9248e-6f54-4b1c-8a87-7cfcaa9656ee req-80e4e49f-41c9-4b3f-8ed2-0792a610e5ee service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Updated VIF entry in instance network info cache for port e6df16f7-7151-450f-bbf8-dc3be066011e. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:41:48 user nova-compute[72418]: DEBUG nova.network.neutron [req-ffb9248e-6f54-4b1c-8a87-7cfcaa9656ee req-80e4e49f-41c9-4b3f-8ed2-0792a610e5ee service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Updating instance_info_cache with network_info: [{"id": "e6df16f7-7151-450f-bbf8-dc3be066011e", "address": "fa:16:3e:42:1f:2f", "network": {"id": "aa563713-99b7-4830-bbc5-5390076a264d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1029161501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99d09208fba747f29a90f95c5bb5ee4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6df16f7-71", "ovs_interfaceid": "e6df16f7-7151-450f-bbf8-dc3be066011e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:41:48 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-ffb9248e-6f54-4b1c-8a87-7cfcaa9656ee req-80e4e49f-41c9-4b3f-8ed2-0792a610e5ee service nova] Releasing lock "refresh_cache-4e1a095f-a2e7-4ab6-bb7e-38cda890d567" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:41:48 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:41:48 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Instance destroyed successfully.
Aug 09 18:41:48 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:41:49 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:41:49 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:41:49 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:41:49 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:41:49 user nova-compute[72418]: DEBUG nova.compute.manager [req-210d1565-1611-4132-8665-9b8df4801ec7 req-3b4848f4-60a9-4fab-82b8-7790435af0a8 service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Received event network-changed-e6df16f7-7151-450f-bbf8-dc3be066011e {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:41:49 user nova-compute[72418]: DEBUG nova.compute.manager [req-210d1565-1611-4132-8665-9b8df4801ec7 req-3b4848f4-60a9-4fab-82b8-7790435af0a8 service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Refreshing instance network info cache due to event network-changed-e6df16f7-7151-450f-bbf8-dc3be066011e. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:41:49 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-210d1565-1611-4132-8665-9b8df4801ec7 req-3b4848f4-60a9-4fab-82b8-7790435af0a8 service nova] Acquiring lock "refresh_cache-4e1a095f-a2e7-4ab6-bb7e-38cda890d567" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:41:49 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-210d1565-1611-4132-8665-9b8df4801ec7 req-3b4848f4-60a9-4fab-82b8-7790435af0a8 service nova] Acquired lock "refresh_cache-4e1a095f-a2e7-4ab6-bb7e-38cda890d567" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:41:49 user nova-compute[72418]: DEBUG nova.network.neutron [req-210d1565-1611-4132-8665-9b8df4801ec7 req-3b4848f4-60a9-4fab-82b8-7790435af0a8 service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Refreshing network info cache for port e6df16f7-7151-450f-bbf8-dc3be066011e {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:41:50 user nova-compute[72418]: DEBUG nova.compute.manager [req-7beac081-ead1-4456-91ca-282cbdd17715 req-d98349b6-4740-4dd2-bdf1-da6ca7f51fe4 service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Received event network-vif-plugged-e6df16f7-7151-450f-bbf8-dc3be066011e {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:41:50 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-7beac081-ead1-4456-91ca-282cbdd17715 req-d98349b6-4740-4dd2-bdf1-da6ca7f51fe4 service nova] Acquiring lock "4e1a095f-a2e7-4ab6-bb7e-38cda890d567-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:41:50 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-7beac081-ead1-4456-91ca-282cbdd17715 req-d98349b6-4740-4dd2-bdf1-da6ca7f51fe4 service nova] Lock "4e1a095f-a2e7-4ab6-bb7e-38cda890d567-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:41:50 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-7beac081-ead1-4456-91ca-282cbdd17715 req-d98349b6-4740-4dd2-bdf1-da6ca7f51fe4 service nova] Lock "4e1a095f-a2e7-4ab6-bb7e-38cda890d567-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:41:50 user nova-compute[72418]: DEBUG nova.compute.manager [req-7beac081-ead1-4456-91ca-282cbdd17715 req-d98349b6-4740-4dd2-bdf1-da6ca7f51fe4 service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] No waiting events found dispatching network-vif-plugged-e6df16f7-7151-450f-bbf8-dc3be066011e {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:41:50 user nova-compute[72418]: WARNING nova.compute.manager [req-7beac081-ead1-4456-91ca-282cbdd17715 req-d98349b6-4740-4dd2-bdf1-da6ca7f51fe4 service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Received unexpected event network-vif-plugged-e6df16f7-7151-450f-bbf8-dc3be066011e for instance with vm_state rescued and task_state unrescuing.
Aug 09 18:41:50 user nova-compute[72418]: DEBUG nova.compute.manager [req-7beac081-ead1-4456-91ca-282cbdd17715 req-d98349b6-4740-4dd2-bdf1-da6ca7f51fe4 service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Received event network-vif-plugged-e6df16f7-7151-450f-bbf8-dc3be066011e {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:41:50 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-7beac081-ead1-4456-91ca-282cbdd17715 req-d98349b6-4740-4dd2-bdf1-da6ca7f51fe4 service nova] Acquiring lock "4e1a095f-a2e7-4ab6-bb7e-38cda890d567-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:41:50 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-7beac081-ead1-4456-91ca-282cbdd17715 req-d98349b6-4740-4dd2-bdf1-da6ca7f51fe4 service nova] Lock "4e1a095f-a2e7-4ab6-bb7e-38cda890d567-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:41:50 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-7beac081-ead1-4456-91ca-282cbdd17715 req-d98349b6-4740-4dd2-bdf1-da6ca7f51fe4 service nova] Lock "4e1a095f-a2e7-4ab6-bb7e-38cda890d567-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:41:50 user nova-compute[72418]: DEBUG nova.compute.manager [req-7beac081-ead1-4456-91ca-282cbdd17715 req-d98349b6-4740-4dd2-bdf1-da6ca7f51fe4 service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] No waiting events found dispatching network-vif-plugged-e6df16f7-7151-450f-bbf8-dc3be066011e {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:41:50 user nova-compute[72418]: WARNING nova.compute.manager [req-7beac081-ead1-4456-91ca-282cbdd17715 req-d98349b6-4740-4dd2-bdf1-da6ca7f51fe4 service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Received unexpected event network-vif-plugged-e6df16f7-7151-450f-bbf8-dc3be066011e for instance with vm_state rescued and task_state unrescuing.
Aug 09 18:41:50 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:41:50 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:41:50 user nova-compute[72418]: DEBUG nova.network.neutron [req-210d1565-1611-4132-8665-9b8df4801ec7 req-3b4848f4-60a9-4fab-82b8-7790435af0a8 service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Updated VIF entry in instance network info cache for port e6df16f7-7151-450f-bbf8-dc3be066011e. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:41:50 user nova-compute[72418]: DEBUG nova.network.neutron [req-210d1565-1611-4132-8665-9b8df4801ec7 req-3b4848f4-60a9-4fab-82b8-7790435af0a8 service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Updating instance_info_cache with network_info: [{"id": "e6df16f7-7151-450f-bbf8-dc3be066011e", "address": "fa:16:3e:42:1f:2f", "network": {"id": "aa563713-99b7-4830-bbc5-5390076a264d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1029161501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99d09208fba747f29a90f95c5bb5ee4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6df16f7-71", "ovs_interfaceid": "e6df16f7-7151-450f-bbf8-dc3be066011e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:41:50 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-210d1565-1611-4132-8665-9b8df4801ec7 req-3b4848f4-60a9-4fab-82b8-7790435af0a8 service nova] Releasing lock "refresh_cache-4e1a095f-a2e7-4ab6-bb7e-38cda890d567" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:41:51 user nova-compute[72418]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691606496.7753522, 8fe41968-a219-4a5a-afdb-32eb2082bb40 => Stopped> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:41:51 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] VM Stopped (Lifecycle Event)
Aug 09 18:41:51 user nova-compute[72418]: DEBUG nova.compute.manager [None req-7b49e856-1032-48a5-a4f7-9dc31c37632f None None] [instance: 8fe41968-a219-4a5a-afdb-32eb2082bb40] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:41:51 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:41:51 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Removed pending event for 4e1a095f-a2e7-4ab6-bb7e-38cda890d567 due to event {{(pid=72418) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 18:41:51 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691606511.882166, 4e1a095f-a2e7-4ab6-bb7e-38cda890d567 => Resumed> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:41:51 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] VM Resumed (Lifecycle Event)
Aug 09 18:41:51 user nova-compute[72418]: DEBUG nova.compute.manager [None req-9f373a1f-9e4f-4a6e-b7c4-f6375d8dcf8d tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:41:51 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:41:51 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:41:51 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 09 18:41:51 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691606511.88567, 4e1a095f-a2e7-4ab6-bb7e-38cda890d567 => Started> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:41:51 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] VM Started (Lifecycle Event)
Aug 09 18:41:51 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:41:51 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:41:52 user nova-compute[72418]: DEBUG nova.compute.manager [req-a3c7522e-5284-48a1-892a-8ac88c6e9133 req-6e5d8e20-8621-4d4e-ada4-6b65edf7da67 service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Received event network-vif-plugged-e6df16f7-7151-450f-bbf8-dc3be066011e {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:41:52 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a3c7522e-5284-48a1-892a-8ac88c6e9133 req-6e5d8e20-8621-4d4e-ada4-6b65edf7da67 service nova] Acquiring lock "4e1a095f-a2e7-4ab6-bb7e-38cda890d567-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:41:52 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a3c7522e-5284-48a1-892a-8ac88c6e9133 req-6e5d8e20-8621-4d4e-ada4-6b65edf7da67 service nova] Lock "4e1a095f-a2e7-4ab6-bb7e-38cda890d567-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:41:52 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a3c7522e-5284-48a1-892a-8ac88c6e9133 req-6e5d8e20-8621-4d4e-ada4-6b65edf7da67 service nova] Lock "4e1a095f-a2e7-4ab6-bb7e-38cda890d567-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:41:52 user nova-compute[72418]: DEBUG nova.compute.manager [req-a3c7522e-5284-48a1-892a-8ac88c6e9133 req-6e5d8e20-8621-4d4e-ada4-6b65edf7da67 service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] No waiting events found dispatching network-vif-plugged-e6df16f7-7151-450f-bbf8-dc3be066011e {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:41:52 user nova-compute[72418]: WARNING nova.compute.manager [req-a3c7522e-5284-48a1-892a-8ac88c6e9133 req-6e5d8e20-8621-4d4e-ada4-6b65edf7da67 service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Received unexpected event network-vif-plugged-e6df16f7-7151-450f-bbf8-dc3be066011e for instance with vm_state active and task_state None.
Aug 09 18:41:53 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:41:56 user nova-compute[72418]: DEBUG nova.compute.manager [req-2abe89c3-b293-48f4-9aff-d86d6105fd3d req-da73df15-8c6e-46b4-9758-38e0823b5b46 service nova] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Received event network-changed-2caa8c0b-8aea-4f61-9e3a-0728beb92ff1 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:41:56 user nova-compute[72418]: DEBUG nova.compute.manager [req-2abe89c3-b293-48f4-9aff-d86d6105fd3d req-da73df15-8c6e-46b4-9758-38e0823b5b46 service nova] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Refreshing instance network info cache due to event network-changed-2caa8c0b-8aea-4f61-9e3a-0728beb92ff1. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:41:56 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-2abe89c3-b293-48f4-9aff-d86d6105fd3d req-da73df15-8c6e-46b4-9758-38e0823b5b46 service nova] Acquiring lock "refresh_cache-2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:41:56 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-2abe89c3-b293-48f4-9aff-d86d6105fd3d req-da73df15-8c6e-46b4-9758-38e0823b5b46 service nova] Acquired lock "refresh_cache-2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:41:56 user nova-compute[72418]: DEBUG nova.network.neutron [req-2abe89c3-b293-48f4-9aff-d86d6105fd3d req-da73df15-8c6e-46b4-9758-38e0823b5b46 service nova] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Refreshing network info cache for port 2caa8c0b-8aea-4f61-9e3a-0728beb92ff1 {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:41:56 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:41:57 user nova-compute[72418]: DEBUG nova.network.neutron [req-2abe89c3-b293-48f4-9aff-d86d6105fd3d req-da73df15-8c6e-46b4-9758-38e0823b5b46 service nova] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Updated VIF entry in instance network info cache for port 2caa8c0b-8aea-4f61-9e3a-0728beb92ff1. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:41:57 user nova-compute[72418]: DEBUG nova.network.neutron [req-2abe89c3-b293-48f4-9aff-d86d6105fd3d req-da73df15-8c6e-46b4-9758-38e0823b5b46 service nova] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Updating instance_info_cache with network_info: [{"id": "2caa8c0b-8aea-4f61-9e3a-0728beb92ff1", "address": "fa:16:3e:96:4c:20", "network": {"id": "ea44ae8b-622b-48d7-8a2b-52c482edf74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1686271510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9ba244a629475189a823dd40c4afb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2caa8c0b-8a", "ovs_interfaceid": "2caa8c0b-8aea-4f61-9e3a-0728beb92ff1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:41:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-2abe89c3-b293-48f4-9aff-d86d6105fd3d req-da73df15-8c6e-46b4-9758-38e0823b5b46 service nova] Releasing lock "refresh_cache-2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:41:58 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d041ee24-3435-447e-a161-86cf564ab09e tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Acquiring lock "2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:42:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d041ee24-3435-447e-a161-86cf564ab09e tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Lock "2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:42:01 user nova-compute[72418]: INFO nova.compute.manager [None req-d041ee24-3435-447e-a161-86cf564ab09e tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Shelving
Aug 09 18:42:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:01 user nova-compute[72418]: DEBUG nova.compute.manager [req-a57b7f98-8531-41f2-9f1b-4a1e06ef7b7e req-f51f9227-feb8-4522-83d8-4b7d3c8b4cde service nova] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Received event network-vif-unplugged-2caa8c0b-8aea-4f61-9e3a-0728beb92ff1 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:42:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a57b7f98-8531-41f2-9f1b-4a1e06ef7b7e req-f51f9227-feb8-4522-83d8-4b7d3c8b4cde service nova] Acquiring lock "2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:42:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a57b7f98-8531-41f2-9f1b-4a1e06ef7b7e req-f51f9227-feb8-4522-83d8-4b7d3c8b4cde service nova] Lock "2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:42:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-a57b7f98-8531-41f2-9f1b-4a1e06ef7b7e req-f51f9227-feb8-4522-83d8-4b7d3c8b4cde service nova] Lock "2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:42:01 user nova-compute[72418]: DEBUG nova.compute.manager [req-a57b7f98-8531-41f2-9f1b-4a1e06ef7b7e req-f51f9227-feb8-4522-83d8-4b7d3c8b4cde service nova] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] No waiting events found dispatching network-vif-unplugged-2caa8c0b-8aea-4f61-9e3a-0728beb92ff1 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:42:01 user nova-compute[72418]: WARNING nova.compute.manager [req-a57b7f98-8531-41f2-9f1b-4a1e06ef7b7e req-f51f9227-feb8-4522-83d8-4b7d3c8b4cde service nova] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Received unexpected event network-vif-unplugged-2caa8c0b-8aea-4f61-9e3a-0728beb92ff1 for instance with vm_state active and task_state shelving.
Aug 09 18:42:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:01 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Instance destroyed successfully.
Aug 09 18:42:01 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-d041ee24-3435-447e-a161-86cf564ab09e tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Beginning cold snapshot process
Aug 09 18:42:02 user nova-compute[72418]: DEBUG nova.privsep.utils [None req-d041ee24-3435-447e-a161-86cf564ab09e tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72418) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 18:42:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-d041ee24-3435-447e-a161-86cf564ab09e tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c/disk /opt/stack/data/nova/instances/snapshots/tmpw6z4lp3c/5beb7714aef9405c80cb5edd5c6221ef {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:42:02 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-d041ee24-3435-447e-a161-86cf564ab09e tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c/disk /opt/stack/data/nova/instances/snapshots/tmpw6z4lp3c/5beb7714aef9405c80cb5edd5c6221ef" returned: 0 in 0.381s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:42:02 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-d041ee24-3435-447e-a161-86cf564ab09e tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Snapshot extracted, beginning image upload
Aug 09 18:42:02 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:42:02 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:42:02 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:42:02 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:42:02 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:42:02 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:42:02 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72418) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 18:42:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:03 user nova-compute[72418]: DEBUG nova.compute.manager [req-59a2c270-0eef-4c03-84dd-8ed1bff817cf req-d089dea7-8e13-420b-a3e0-93afb9ce0a4b service nova] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Received event network-vif-plugged-2caa8c0b-8aea-4f61-9e3a-0728beb92ff1 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:42:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-59a2c270-0eef-4c03-84dd-8ed1bff817cf req-d089dea7-8e13-420b-a3e0-93afb9ce0a4b service nova] Acquiring lock "2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:42:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-59a2c270-0eef-4c03-84dd-8ed1bff817cf req-d089dea7-8e13-420b-a3e0-93afb9ce0a4b service nova] Lock "2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:42:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-59a2c270-0eef-4c03-84dd-8ed1bff817cf req-d089dea7-8e13-420b-a3e0-93afb9ce0a4b service nova] Lock "2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:42:03 user nova-compute[72418]: DEBUG nova.compute.manager [req-59a2c270-0eef-4c03-84dd-8ed1bff817cf req-d089dea7-8e13-420b-a3e0-93afb9ce0a4b service nova] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] No waiting events found dispatching network-vif-plugged-2caa8c0b-8aea-4f61-9e3a-0728beb92ff1 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:42:03 user nova-compute[72418]: WARNING nova.compute.manager [req-59a2c270-0eef-4c03-84dd-8ed1bff817cf req-d089dea7-8e13-420b-a3e0-93afb9ce0a4b service nova] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Received unexpected event network-vif-plugged-2caa8c0b-8aea-4f61-9e3a-0728beb92ff1 for instance with vm_state active and task_state shelving_image_uploading.
Aug 09 18:42:03 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:42:03 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Starting heal instance info cache {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 18:42:03 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Rebuilding the list of instances to heal {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 18:42:04 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "refresh_cache-c46f2599-93f8-412e-9918-7ace8a9f19dd" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:42:04 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquired lock "refresh_cache-c46f2599-93f8-412e-9918-7ace8a9f19dd" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:42:04 user nova-compute[72418]: DEBUG nova.network.neutron [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Forcefully refreshing network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 18:42:04 user nova-compute[72418]: DEBUG nova.objects.instance [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lazy-loading 'info_cache' on Instance uuid c46f2599-93f8-412e-9918-7ace8a9f19dd {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:42:04 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-a46173f7-a58f-41dc-a0b1-5b2a632247d7 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Acquiring lock "0659fd5c-cb05-441e-94b6-9d05f7135893" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:42:04 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-a46173f7-a58f-41dc-a0b1-5b2a632247d7 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "0659fd5c-cb05-441e-94b6-9d05f7135893" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:42:04 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-a46173f7-a58f-41dc-a0b1-5b2a632247d7 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Acquiring lock "0659fd5c-cb05-441e-94b6-9d05f7135893-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:42:04 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-a46173f7-a58f-41dc-a0b1-5b2a632247d7 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "0659fd5c-cb05-441e-94b6-9d05f7135893-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:42:04 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-a46173f7-a58f-41dc-a0b1-5b2a632247d7 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "0659fd5c-cb05-441e-94b6-9d05f7135893-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:42:04 user nova-compute[72418]: INFO nova.compute.manager [None req-a46173f7-a58f-41dc-a0b1-5b2a632247d7 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Terminating instance
Aug 09 18:42:04 user nova-compute[72418]: DEBUG nova.compute.manager [None req-a46173f7-a58f-41dc-a0b1-5b2a632247d7 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Start destroying the instance on the hypervisor. {{(pid=72418) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 18:42:04 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:04 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:04 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:04 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:04 user nova-compute[72418]: DEBUG nova.network.neutron [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Updating instance_info_cache with network_info: [{"id": "6c9676d3-6e5d-4a95-a24f-0df4a15e993d", "address": "fa:16:3e:80:17:d9", "network": {"id": "bd36ef30-e57d-473f-97bc-c51b5db08aa7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-425133239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78b6e36a5b61456092ce7de9212c3c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9676d3-6e", "ovs_interfaceid": "6c9676d3-6e5d-4a95-a24f-0df4a15e993d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:42:04 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Releasing lock "refresh_cache-c46f2599-93f8-412e-9918-7ace8a9f19dd" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:42:04 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Updated the network info_cache for instance {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 18:42:04 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:42:04 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Instance destroyed successfully.
Aug 09 18:42:04 user nova-compute[72418]: DEBUG nova.objects.instance [None req-a46173f7-a58f-41dc-a0b1-5b2a632247d7 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lazy-loading 'resources' on Instance uuid 0659fd5c-cb05-441e-94b6-9d05f7135893 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-a46173f7-a58f-41dc-a0b1-5b2a632247d7 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:35:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-935482357',display_name='tempest-ServerActionsTestOtherA-server-935482357',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-935482357',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZ8H8MvJhas/vPLXexc9KvUsV16Uhsl6uYTaDGrZC9aE3rBb3x7zoV+NqPR5zKzOIkCqtgn8ZVvU3tdtAtEAYrB/yDbEIXvY0hEVuVM8ww17BzMc60Vtn0IN61LmfWZ8Q==',key_name='tempest-keypair-882054128',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:37:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='78b6e36a5b61456092ce7de9212c3c82',ramdisk_id='',reservation_id='r-kxlskkmt',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1039384122',owner_user_name='tempest-ServerActionsTestOtherA-1039384122-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:39:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='edc9ed6980274b978caf0666a9b31379',uuid=0659fd5c-cb05-441e-94b6-9d05f7135893,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0cd6232b-ea64-4978-bc0e-0e84995fd9a4", "address": "fa:16:3e:65:a1:d2", "network": {"id": "bd36ef30-e57d-473f-97bc-c51b5db08aa7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-425133239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78b6e36a5b61456092ce7de9212c3c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd6232b-ea", "ovs_interfaceid": "0cd6232b-ea64-4978-bc0e-0e84995fd9a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-a46173f7-a58f-41dc-a0b1-5b2a632247d7 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Converting VIF {"id": "0cd6232b-ea64-4978-bc0e-0e84995fd9a4", "address": "fa:16:3e:65:a1:d2", "network": {"id": "bd36ef30-e57d-473f-97bc-c51b5db08aa7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-425133239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78b6e36a5b61456092ce7de9212c3c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd6232b-ea", "ovs_interfaceid": "0cd6232b-ea64-4978-bc0e-0e84995fd9a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-a46173f7-a58f-41dc-a0b1-5b2a632247d7 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:a1:d2,bridge_name='br-int',has_traffic_filtering=True,id=0cd6232b-ea64-4978-bc0e-0e84995fd9a4,network=Network(bd36ef30-e57d-473f-97bc-c51b5db08aa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cd6232b-ea') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG os_vif [None req-a46173f7-a58f-41dc-a0b1-5b2a632247d7 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:a1:d2,bridge_name='br-int',has_traffic_filtering=True,id=0cd6232b-ea64-4978-bc0e-0e84995fd9a4,network=Network(bd36ef30-e57d-473f-97bc-c51b5db08aa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cd6232b-ea') {{(pid=72418) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0cd6232b-ea, bridge=br-int, if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:05 user nova-compute[72418]: INFO os_vif [None req-a46173f7-a58f-41dc-a0b1-5b2a632247d7 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:a1:d2,bridge_name='br-int',has_traffic_filtering=True,id=0cd6232b-ea64-4978-bc0e-0e84995fd9a4,network=Network(bd36ef30-e57d-473f-97bc-c51b5db08aa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cd6232b-ea')
Aug 09 18:42:05 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a46173f7-a58f-41dc-a0b1-5b2a632247d7 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] calling os-brick to detach iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-a46173f7-a58f-41dc-a0b1-5b2a632247d7 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, {'target_iqns': ['iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jgrEVDUS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:42:05 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-a46173f7-a58f-41dc-a0b1-5b2a632247d7 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:42:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-a46173f7-a58f-41dc-a0b1-5b2a632247d7 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-a46173f7-a58f-41dc-a0b1-5b2a632247d7 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-a46173f7-a58f-41dc-a0b1-5b2a632247d7 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b', 0)] {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[d195c515-23df-4ae3-951c-ea070e577385]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d97afa5-52e3-4f2c-8053-0d3a94e0b0c1]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-a46173f7-a58f-41dc-a0b1-5b2a632247d7 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)
Aug 09 18:42:05 user nova-compute[72418]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c (non-flash)
Aug 09 18:42:05 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-a46173f7-a58f-41dc-a0b1-5b2a632247d7 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b (non-flash)
Aug 09 18:42:05 user nova-compute[72418]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c (non-flash)
Aug 09 18:42:05 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-a46173f7-a58f-41dc-a0b1-5b2a632247d7 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f42f811bbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b'): ({'sdc'}, set())}) {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-a46173f7-a58f-41dc-a0b1-5b2a632247d7 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Removing single pathed devices sdc {{(pid=72418) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[90911075-700a-40ea-989d-67d58d174d4d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a32919f-492e-47c1-900c-cb6e36893cbc]: (4, ('ok\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-a46173f7-a58f-41dc-a0b1-5b2a632247d7 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Flushing IO for device /dev/sdc {{(pid=72418) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b22aa27-4d7c-41b1-97ec-52e4177b302f]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-a46173f7-a58f-41dc-a0b1-5b2a632247d7 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72418) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.067s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[3adb5001-899f-414a-a15b-1b49728cd1bc]: (4, ('1', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-a46173f7-a58f-41dc-a0b1-5b2a632247d7 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-a46173f7-a58f-41dc-a0b1-5b2a632247d7 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] SCSI volumes sdc have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_d539398', '/dev/disk/by-id/scsi-26164306633663066', '/dev/disk/by-id/scsi-1SCST_BIOd539398-ad0f3f0fce83781f') {{(pid=83046) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe86eb13-c0b3-45b8-be1f-ea59bdff0cc7]: (4, None) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-a46173f7-a58f-41dc-a0b1-5b2a632247d7 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b')] {{(pid=72418) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af9507b-6cf9-4ac1-b144-c63ba32bd140]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-a46173f7-a58f-41dc-a0b1-5b2a632247d7 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b -p 172.16.0.220:3260 --logout {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[41889f11-65cf-41b8-8724-deeee3ee21a0]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-a46173f7-a58f-41dc-a0b1-5b2a632247d7 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b, portal: 172.16.0.220,3260]
Aug 09 18:42:05 user nova-compute[72418]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b, portal: 172.16.0.220,3260] successful.
Aug 09 18:42:05 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b -p 172.16.0.220:3260 --op delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52e5369-5c8f-4793-a8fc-9df310f4572b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec03a14f-b66b-4f74-807b-28ef8579caa1]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-a46173f7-a58f-41dc-a0b1-5b2a632247d7 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-a46173f7-a58f-41dc-a0b1-5b2a632247d7 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-a46173f7-a58f-41dc-a0b1-5b2a632247d7 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] <== disconnect_volume: return (339ms) None {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a46173f7-a58f-41dc-a0b1-5b2a632247d7 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Disconnected iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 18:42:05 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-a46173f7-a58f-41dc-a0b1-5b2a632247d7 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Deleting instance files /opt/stack/data/nova/instances/0659fd5c-cb05-441e-94b6-9d05f7135893_del
Aug 09 18:42:05 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-a46173f7-a58f-41dc-a0b1-5b2a632247d7 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Deletion of /opt/stack/data/nova/instances/0659fd5c-cb05-441e-94b6-9d05f7135893_del complete
Aug 09 18:42:05 user nova-compute[72418]: INFO nova.compute.manager [None req-a46173f7-a58f-41dc-a0b1-5b2a632247d7 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Took 1.22 seconds to destroy the instance on the hypervisor.
Aug 09 18:42:05 user nova-compute[72418]: DEBUG oslo.service.loopingcall [None req-a46173f7-a58f-41dc-a0b1-5b2a632247d7 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72418) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG nova.compute.manager [-] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Deallocating network for instance {{(pid=72418) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] deallocate_for_instance() {{(pid=72418) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG nova.compute.manager [req-577fde96-95f2-41c1-8d9f-87ee5cee0d4c req-372a2661-6778-4d70-95d9-699dec616f27 service nova] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Received event network-vif-unplugged-0cd6232b-ea64-4978-bc0e-0e84995fd9a4 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-577fde96-95f2-41c1-8d9f-87ee5cee0d4c req-372a2661-6778-4d70-95d9-699dec616f27 service nova] Acquiring lock "0659fd5c-cb05-441e-94b6-9d05f7135893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-577fde96-95f2-41c1-8d9f-87ee5cee0d4c req-372a2661-6778-4d70-95d9-699dec616f27 service nova] Lock "0659fd5c-cb05-441e-94b6-9d05f7135893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-577fde96-95f2-41c1-8d9f-87ee5cee0d4c req-372a2661-6778-4d70-95d9-699dec616f27 service nova] Lock "0659fd5c-cb05-441e-94b6-9d05f7135893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG nova.compute.manager [req-577fde96-95f2-41c1-8d9f-87ee5cee0d4c req-372a2661-6778-4d70-95d9-699dec616f27 service nova] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] No waiting events found dispatching network-vif-unplugged-0cd6232b-ea64-4978-bc0e-0e84995fd9a4 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG nova.compute.manager [req-577fde96-95f2-41c1-8d9f-87ee5cee0d4c req-372a2661-6778-4d70-95d9-699dec616f27 service nova] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Received event network-vif-unplugged-0cd6232b-ea64-4978-bc0e-0e84995fd9a4 for instance with task_state deleting. {{(pid=72418) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG nova.compute.manager [req-577fde96-95f2-41c1-8d9f-87ee5cee0d4c req-372a2661-6778-4d70-95d9-699dec616f27 service nova] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Received event network-vif-plugged-0cd6232b-ea64-4978-bc0e-0e84995fd9a4 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-577fde96-95f2-41c1-8d9f-87ee5cee0d4c req-372a2661-6778-4d70-95d9-699dec616f27 service nova] Acquiring lock "0659fd5c-cb05-441e-94b6-9d05f7135893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-577fde96-95f2-41c1-8d9f-87ee5cee0d4c req-372a2661-6778-4d70-95d9-699dec616f27 service nova] Lock "0659fd5c-cb05-441e-94b6-9d05f7135893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-577fde96-95f2-41c1-8d9f-87ee5cee0d4c req-372a2661-6778-4d70-95d9-699dec616f27 service nova] Lock "0659fd5c-cb05-441e-94b6-9d05f7135893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG nova.compute.manager [req-577fde96-95f2-41c1-8d9f-87ee5cee0d4c req-372a2661-6778-4d70-95d9-699dec616f27 service nova] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] No waiting events found dispatching network-vif-plugged-0cd6232b-ea64-4978-bc0e-0e84995fd9a4 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:42:05 user nova-compute[72418]: WARNING nova.compute.manager [req-577fde96-95f2-41c1-8d9f-87ee5cee0d4c req-372a2661-6778-4d70-95d9-699dec616f27 service nova] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Received unexpected event network-vif-plugged-0cd6232b-ea64-4978-bc0e-0e84995fd9a4 for instance with vm_state active and task_state deleting.
Aug 09 18:42:05 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-d041ee24-3435-447e-a161-86cf564ab09e tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Snapshot image upload complete
Aug 09 18:42:05 user nova-compute[72418]: DEBUG nova.compute.manager [None req-d041ee24-3435-447e-a161-86cf564ab09e tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:42:05 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:42:05 user nova-compute[72418]: INFO nova.compute.manager [None req-d041ee24-3435-447e-a161-86cf564ab09e tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Shelve offloading
Aug 09 18:42:05 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Instance destroyed successfully.
Aug 09 18:42:05 user nova-compute[72418]: DEBUG nova.compute.manager [None req-d041ee24-3435-447e-a161-86cf564ab09e tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:42:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d041ee24-3435-447e-a161-86cf564ab09e tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Acquiring lock "refresh_cache-2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:42:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d041ee24-3435-447e-a161-86cf564ab09e tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Acquired lock "refresh_cache-2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:42:06 user nova-compute[72418]: DEBUG nova.network.neutron [None req-d041ee24-3435-447e-a161-86cf564ab09e tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:42:06 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:42:06 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Took 1.18 seconds to deallocate network for instance.
Aug 09 18:42:06 user nova-compute[72418]: DEBUG nova.compute.manager [req-8d30c487-7eba-4549-a997-418909d5224f req-933188f6-2b81-4e7e-b5e1-cd9df04ed28a service nova] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Received event network-vif-deleted-0cd6232b-ea64-4978-bc0e-0e84995fd9a4 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:42:06 user nova-compute[72418]: INFO nova.compute.manager [req-8d30c487-7eba-4549-a997-418909d5224f req-933188f6-2b81-4e7e-b5e1-cd9df04ed28a service nova] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Neutron deleted interface 0cd6232b-ea64-4978-bc0e-0e84995fd9a4; detaching it from the instance and deleting it from the info cache
Aug 09 18:42:06 user nova-compute[72418]: DEBUG nova.network.neutron [req-8d30c487-7eba-4549-a997-418909d5224f req-933188f6-2b81-4e7e-b5e1-cd9df04ed28a service nova] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:42:06 user nova-compute[72418]: DEBUG nova.compute.manager [req-8d30c487-7eba-4549-a997-418909d5224f req-933188f6-2b81-4e7e-b5e1-cd9df04ed28a service nova] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Detach interface failed, port_id=0cd6232b-ea64-4978-bc0e-0e84995fd9a4, reason: Instance 0659fd5c-cb05-441e-94b6-9d05f7135893 could not be found. {{(pid=72418) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 18:42:06 user nova-compute[72418]: DEBUG nova.network.neutron [None req-d041ee24-3435-447e-a161-86cf564ab09e tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Updating instance_info_cache with network_info: [{"id": "2caa8c0b-8aea-4f61-9e3a-0728beb92ff1", "address": "fa:16:3e:96:4c:20", "network": {"id": "ea44ae8b-622b-48d7-8a2b-52c482edf74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1686271510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9ba244a629475189a823dd40c4afb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2caa8c0b-8a", "ovs_interfaceid": "2caa8c0b-8aea-4f61-9e3a-0728beb92ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:42:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d041ee24-3435-447e-a161-86cf564ab09e tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Releasing lock "refresh_cache-2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:42:07 user nova-compute[72418]: INFO nova.compute.manager [None req-a46173f7-a58f-41dc-a0b1-5b2a632247d7 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Took 0.79 seconds to detach 1 volumes for instance.
Aug 09 18:42:07 user nova-compute[72418]: DEBUG nova.compute.manager [None req-a46173f7-a58f-41dc-a0b1-5b2a632247d7 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Deleting volume: e52e5369-5c8f-4793-a8fc-9df310f4572b {{(pid=72418) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 09 18:42:07 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Instance destroyed successfully.
Aug 09 18:42:07 user nova-compute[72418]: DEBUG nova.objects.instance [None req-d041ee24-3435-447e-a161-86cf564ab09e tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Lazy-loading 'resources' on Instance uuid 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:42:07 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-d041ee24-3435-447e-a161-86cf564ab09e tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:40:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1804567865',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1804567865',id=33,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXPX4meYC5q9Csb94cFY2/ntXnwmXU606njw4i1PD9gqISyDPNlWH5uWkogo9cTLkS/m6+tiFXzn5yykKRVbH+S12MVrbYY9aSknuunPeXthY5ETNGFNDIRXye5758pQA==',key_name='tempest-keypair-885533390',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:40:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2d9ba244a629475189a823dd40c4afb9',ramdisk_id='',reservation_id='r-hlq30p7b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-531665400',owner_user_name='tempest-AttachVolumeShelveTestJSON-531665400-project-member',shelved_at='2023-08-09T18:42:05.882937',shelved_host='user',shelved_image_id='e8cbb842-e8e3-4b72-9fca-5bae10945d60'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:42:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8908bf793844843a5f5953d5d5569c9',uuid=2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "2caa8c0b-8aea-4f61-9e3a-0728beb92ff1", "address": "fa:16:3e:96:4c:20", "network": {"id": "ea44ae8b-622b-48d7-8a2b-52c482edf74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1686271510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9ba244a629475189a823dd40c4afb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2caa8c0b-8a", "ovs_interfaceid": "2caa8c0b-8aea-4f61-9e3a-0728beb92ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 18:42:07 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-d041ee24-3435-447e-a161-86cf564ab09e tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Converting VIF {"id": "2caa8c0b-8aea-4f61-9e3a-0728beb92ff1", "address": "fa:16:3e:96:4c:20", "network": {"id": "ea44ae8b-622b-48d7-8a2b-52c482edf74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1686271510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9ba244a629475189a823dd40c4afb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2caa8c0b-8a", "ovs_interfaceid": "2caa8c0b-8aea-4f61-9e3a-0728beb92ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:42:07 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-d041ee24-3435-447e-a161-86cf564ab09e tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:4c:20,bridge_name='br-int',has_traffic_filtering=True,id=2caa8c0b-8aea-4f61-9e3a-0728beb92ff1,network=Network(ea44ae8b-622b-48d7-8a2b-52c482edf74a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2caa8c0b-8a') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:42:07 user nova-compute[72418]: DEBUG os_vif [None req-d041ee24-3435-447e-a161-86cf564ab09e tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:4c:20,bridge_name='br-int',has_traffic_filtering=True,id=2caa8c0b-8aea-4f61-9e3a-0728beb92ff1,network=Network(ea44ae8b-622b-48d7-8a2b-52c482edf74a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2caa8c0b-8a') {{(pid=72418) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 18:42:07 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:07 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2caa8c0b-8a, bridge=br-int, if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:42:07 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:07 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:42:07 user nova-compute[72418]: INFO os_vif [None req-d041ee24-3435-447e-a161-86cf564ab09e tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:4c:20,bridge_name='br-int',has_traffic_filtering=True,id=2caa8c0b-8aea-4f61-9e3a-0728beb92ff1,network=Network(ea44ae8b-622b-48d7-8a2b-52c482edf74a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2caa8c0b-8a')
Aug 09 18:42:07 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-d041ee24-3435-447e-a161-86cf564ab09e tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Deleting instance files /opt/stack/data/nova/instances/2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c_del
Aug 09 18:42:07 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-d041ee24-3435-447e-a161-86cf564ab09e tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Deletion of /opt/stack/data/nova/instances/2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c_del complete
Aug 09 18:42:07 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-a46173f7-a58f-41dc-a0b1-5b2a632247d7 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:42:07 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-a46173f7-a58f-41dc-a0b1-5b2a632247d7 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:42:07 user nova-compute[72418]: INFO nova.scheduler.client.report [None req-d041ee24-3435-447e-a161-86cf564ab09e tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Deleted allocations for instance 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c
Aug 09 18:42:07 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d041ee24-3435-447e-a161-86cf564ab09e tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:42:07 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-a46173f7-a58f-41dc-a0b1-5b2a632247d7 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:42:07 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-a46173f7-a58f-41dc-a0b1-5b2a632247d7 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:42:07 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-a46173f7-a58f-41dc-a0b1-5b2a632247d7 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.190s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:42:07 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d041ee24-3435-447e-a161-86cf564ab09e tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.101s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:42:07 user nova-compute[72418]: DEBUG nova.objects.instance [None req-d041ee24-3435-447e-a161-86cf564ab09e tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Lazy-loading 'numa_topology' on Instance uuid 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:42:07 user nova-compute[72418]: INFO nova.scheduler.client.report [None req-a46173f7-a58f-41dc-a0b1-5b2a632247d7 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Deleted allocations for instance 0659fd5c-cb05-441e-94b6-9d05f7135893
Aug 09 18:42:07 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-a46173f7-a58f-41dc-a0b1-5b2a632247d7 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "0659fd5c-cb05-441e-94b6-9d05f7135893" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.680s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:42:07 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-d041ee24-3435-447e-a161-86cf564ab09e tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:42:07 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-d041ee24-3435-447e-a161-86cf564ab09e tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:42:07 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d041ee24-3435-447e-a161-86cf564ab09e tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.189s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:42:08 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d041ee24-3435-447e-a161-86cf564ab09e tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Lock "2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.796s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:42:08 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:09 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:42:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:42:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:42:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:42:09 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Auditing locally available compute resources for user (node: user) {{(pid=72418) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 18:42:10 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8893bd80-5708-47a5-a9d0-cd0ed6d73e52/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:42:10 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8893bd80-5708-47a5-a9d0-cd0ed6d73e52/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:42:10 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8893bd80-5708-47a5-a9d0-cd0ed6d73e52/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:42:10 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8893bd80-5708-47a5-a9d0-cd0ed6d73e52/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:42:10 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:42:10 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:42:10 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:42:10 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:42:10 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:42:10 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:42:10 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:42:10 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:42:10 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:42:11 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:42:11 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:42:11 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Hypervisor/Node resource view: name=user free_ram=8286MB free_disk=25.428695678710938GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72418) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 18:42:11 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:42:11 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:42:11 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance c46f2599-93f8-412e-9918-7ace8a9f19dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:42:11 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 4e1a095f-a2e7-4ab6-bb7e-38cda890d567 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:42:11 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 8893bd80-5708-47a5-a9d0-cd0ed6d73e52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:42:11 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 18:42:11 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 18:42:11 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:42:11 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:42:11 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Compute_service record updated for user:user {{(pid=72418) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 18:42:11 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.276s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:42:12 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:13 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:16 user nova-compute[72418]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691606521.8346446, 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c => Stopped> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:42:16 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] VM Stopped (Lifecycle Event)
Aug 09 18:42:16 user nova-compute[72418]: DEBUG nova.compute.manager [None req-30600e4d-7922-4fb4-93dc-fd90b79bb91c None None] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:42:17 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:18 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:19 user nova-compute[72418]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691606524.9806986, 0659fd5c-cb05-441e-94b6-9d05f7135893 => Stopped> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:42:19 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] VM Stopped (Lifecycle Event)
Aug 09 18:42:20 user nova-compute[72418]: DEBUG nova.compute.manager [None req-5c14ea24-bc66-4f95-aec6-39771c8fc6f8 None None] [instance: 0659fd5c-cb05-441e-94b6-9d05f7135893] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:42:20 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-0cb2624b-b24c-4a13-ad63-384df7896997 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Acquiring lock "4e1a095f-a2e7-4ab6-bb7e-38cda890d567" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:42:20 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-0cb2624b-b24c-4a13-ad63-384df7896997 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Lock "4e1a095f-a2e7-4ab6-bb7e-38cda890d567" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:42:20 user nova-compute[72418]: INFO nova.compute.manager [None req-0cb2624b-b24c-4a13-ad63-384df7896997 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Detaching volume ba4c6fab-b988-4b6a-904a-2434e61b294c
Aug 09 18:42:20 user nova-compute[72418]: INFO nova.virt.block_device [None req-0cb2624b-b24c-4a13-ad63-384df7896997 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Attempting to driver detach volume ba4c6fab-b988-4b6a-904a-2434e61b294c from mountpoint /dev/vdb
Aug 09 18:42:20 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-0cb2624b-b24c-4a13-ad63-384df7896997 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Attempting to detach device vdb from instance 4e1a095f-a2e7-4ab6-bb7e-38cda890d567 from the persistent domain config. {{(pid=72418) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 18:42:20 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-0cb2624b-b24c-4a13-ad63-384df7896997 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 18:42:20 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:42:20 user nova-compute[72418]:   <source dev="/dev/sdd"/>
Aug 09 18:42:20 user nova-compute[72418]:   <target dev="vdb" bus="virtio"/>
Aug 09 18:42:20 user nova-compute[72418]:   <serial>ba4c6fab-b988-4b6a-904a-2434e61b294c</serial>
Aug 09 18:42:20 user nova-compute[72418]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 18:42:20 user nova-compute[72418]: </disk>
Aug 09 18:42:20 user nova-compute[72418]:  {{(pid=72418) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 18:42:20 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-0cb2624b-b24c-4a13-ad63-384df7896997 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Successfully detached device vdb from instance 4e1a095f-a2e7-4ab6-bb7e-38cda890d567 from the persistent domain config.
Aug 09 18:42:20 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-0cb2624b-b24c-4a13-ad63-384df7896997 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4e1a095f-a2e7-4ab6-bb7e-38cda890d567 from the live domain config. {{(pid=72418) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 18:42:20 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-0cb2624b-b24c-4a13-ad63-384df7896997 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 18:42:20 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:42:20 user nova-compute[72418]:   <source dev="/dev/sdd"/>
Aug 09 18:42:20 user nova-compute[72418]:   <target dev="vdb" bus="virtio"/>
Aug 09 18:42:20 user nova-compute[72418]:   <serial>ba4c6fab-b988-4b6a-904a-2434e61b294c</serial>
Aug 09 18:42:20 user nova-compute[72418]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 18:42:20 user nova-compute[72418]: </disk>
Aug 09 18:42:20 user nova-compute[72418]:  {{(pid=72418) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 18:42:20 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Received event <DeviceRemovedEvent: 1691606540.6681964, 4e1a095f-a2e7-4ab6-bb7e-38cda890d567 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72418) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 18:42:20 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-0cb2624b-b24c-4a13-ad63-384df7896997 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4e1a095f-a2e7-4ab6-bb7e-38cda890d567 {{(pid=72418) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 18:42:20 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-0cb2624b-b24c-4a13-ad63-384df7896997 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Successfully detached device vdb from instance 4e1a095f-a2e7-4ab6-bb7e-38cda890d567 from the live domain config.
Aug 09 18:42:20 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cb2624b-b24c-4a13-ad63-384df7896997 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] calling os-brick to detach iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 18:42:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb2624b-b24c-4a13-ad63-384df7896997 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, {'target_iqns': ['iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PCJXLeFp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:42:20 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-0cb2624b-b24c-4a13-ad63-384df7896997 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:42:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-0cb2624b-b24c-4a13-ad63-384df7896997 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:42:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-0cb2624b-b24c-4a13-ad63-384df7896997 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:42:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb2624b-b24c-4a13-ad63-384df7896997 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c', 0)] {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 18:42:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:42:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:42:20 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[166ab278-624a-4e96-be07-a0955928ef58]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:42:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:42:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:42:20 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[4677da8c-b1d6-49f2-8a0e-79c0cca50bf1]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:42:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb2624b-b24c-4a13-ad63-384df7896997 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c (non-flash)
Aug 09 18:42:20 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:42:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb2624b-b24c-4a13-ad63-384df7896997 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c (non-flash)
Aug 09 18:42:20 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:42:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb2624b-b24c-4a13-ad63-384df7896997 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f43002dcd30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c'): ({'sdd'}, set())}) {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 18:42:20 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-0cb2624b-b24c-4a13-ad63-384df7896997 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Removing single pathed devices sdd {{(pid=72418) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 18:42:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:42:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:42:20 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f15438f-13ae-4a45-a70e-9bebc8abc990]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:42:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:42:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:42:20 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf418bb-5954-4cc5-b5d1-afc6180540c8]: (4, ('ok\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:42:20 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-0cb2624b-b24c-4a13-ad63-384df7896997 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Flushing IO for device /dev/sdd {{(pid=72418) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 18:42:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:42:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:42:20 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60a2c27-63b9-4c71-bcdd-58c8f5f5f69d]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:42:20 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-0cb2624b-b24c-4a13-ad63-384df7896997 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72418) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 18:42:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:42:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:42:20 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[b576f009-233e-414c-8048-81986b62ce78]: (4, ('1', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:42:20 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-0cb2624b-b24c-4a13-ad63-384df7896997 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 18:42:20 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-0cb2624b-b24c-4a13-ad63-384df7896997 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] SCSI volumes sdd have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 18:42:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb2624b-b24c-4a13-ad63-384df7896997 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c')] {{(pid=72418) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 18:42:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:42:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:42:20 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae765973-617b-4bc0-8825-dcd45bf6924c]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:42:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb2624b-b24c-4a13-ad63-384df7896997 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:42:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c -p 172.16.0.220:3260 --logout {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:42:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:42:20 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c260bd85-5580-4456-a433-0d5b3e7e4bcd]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:42:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb2624b-b24c-4a13-ad63-384df7896997 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c, portal: 172.16.0.220,3260]
Aug 09 18:42:20 user nova-compute[72418]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c, portal: 172.16.0.220,3260] successful.
Aug 09 18:42:20 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:42:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c -p 172.16.0.220:3260 --op delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:42:20 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba4c6fab-b988-4b6a-904a-2434e61b294c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:42:20 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[506108a3-5e7d-42be-9ca2-da5f9b2af0e9]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:42:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb2624b-b24c-4a13-ad63-384df7896997 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:42:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-0cb2624b-b24c-4a13-ad63-384df7896997 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:42:20 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb2624b-b24c-4a13-ad63-384df7896997 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] <== disconnect_volume: return (282ms) None {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:42:20 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cb2624b-b24c-4a13-ad63-384df7896997 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Disconnected iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 18:42:21 user nova-compute[72418]: DEBUG nova.objects.instance [None req-0cb2624b-b24c-4a13-ad63-384df7896997 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Lazy-loading 'flavor' on Instance uuid 4e1a095f-a2e7-4ab6-bb7e-38cda890d567 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:42:21 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-0cb2624b-b24c-4a13-ad63-384df7896997 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Lock "4e1a095f-a2e7-4ab6-bb7e-38cda890d567" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.633s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:42:22 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:23 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:27 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:28 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:30 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:30 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-aa442a10-70c3-43eb-984f-26c675f629e4 tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Acquiring lock "8893bd80-5708-47a5-a9d0-cd0ed6d73e52" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:42:30 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-aa442a10-70c3-43eb-984f-26c675f629e4 tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Lock "8893bd80-5708-47a5-a9d0-cd0ed6d73e52" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:42:30 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-aa442a10-70c3-43eb-984f-26c675f629e4 tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Acquiring lock "8893bd80-5708-47a5-a9d0-cd0ed6d73e52-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:42:30 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-aa442a10-70c3-43eb-984f-26c675f629e4 tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Lock "8893bd80-5708-47a5-a9d0-cd0ed6d73e52-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:42:30 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-aa442a10-70c3-43eb-984f-26c675f629e4 tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Lock "8893bd80-5708-47a5-a9d0-cd0ed6d73e52-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:42:30 user nova-compute[72418]: INFO nova.compute.manager [None req-aa442a10-70c3-43eb-984f-26c675f629e4 tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Terminating instance
Aug 09 18:42:30 user nova-compute[72418]: DEBUG nova.compute.manager [None req-aa442a10-70c3-43eb-984f-26c675f629e4 tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Start destroying the instance on the hypervisor. {{(pid=72418) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 18:42:31 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:31 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:31 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:31 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:31 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:31 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:31 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:31 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:31 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Instance destroyed successfully.
Aug 09 18:42:31 user nova-compute[72418]: DEBUG nova.objects.instance [None req-aa442a10-70c3-43eb-984f-26c675f629e4 tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Lazy-loading 'resources' on Instance uuid 8893bd80-5708-47a5-a9d0-cd0ed6d73e52 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:42:31 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-aa442a10-70c3-43eb-984f-26c675f629e4 tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:40:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1416142219',display_name='tempest-VolumesActionsTest-instance-1416142219',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1416142219',id=34,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:40:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d3a06fd12204e28b42e073812d67248',ramdisk_id='',reservation_id='r-pvb56h4p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1233815310',owner_user_name='tempest-VolumesActionsTest-1233815310-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:40:36Z,user_data=None,user_id='6ca9b88eef594d3d9fe150c21b3113fc',uuid=8893bd80-5708-47a5-a9d0-cd0ed6d73e52,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "00b2459b-f98c-46c5-8e73-07894ab10384", "address": "fa:16:3e:0c:6e:ea", "network": {"id": "5052c479-912b-48b4-b29a-770428231240", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1712606204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d3a06fd12204e28b42e073812d67248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00b2459b-f9", "ovs_interfaceid": "00b2459b-f98c-46c5-8e73-07894ab10384", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 18:42:31 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-aa442a10-70c3-43eb-984f-26c675f629e4 tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Converting VIF {"id": "00b2459b-f98c-46c5-8e73-07894ab10384", "address": "fa:16:3e:0c:6e:ea", "network": {"id": "5052c479-912b-48b4-b29a-770428231240", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1712606204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d3a06fd12204e28b42e073812d67248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00b2459b-f9", "ovs_interfaceid": "00b2459b-f98c-46c5-8e73-07894ab10384", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:42:31 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-aa442a10-70c3-43eb-984f-26c675f629e4 tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:6e:ea,bridge_name='br-int',has_traffic_filtering=True,id=00b2459b-f98c-46c5-8e73-07894ab10384,network=Network(5052c479-912b-48b4-b29a-770428231240),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00b2459b-f9') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:42:31 user nova-compute[72418]: DEBUG os_vif [None req-aa442a10-70c3-43eb-984f-26c675f629e4 tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:6e:ea,bridge_name='br-int',has_traffic_filtering=True,id=00b2459b-f98c-46c5-8e73-07894ab10384,network=Network(5052c479-912b-48b4-b29a-770428231240),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00b2459b-f9') {{(pid=72418) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 18:42:31 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:31 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap00b2459b-f9, bridge=br-int, if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:42:31 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:31 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:42:31 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:31 user nova-compute[72418]: INFO os_vif [None req-aa442a10-70c3-43eb-984f-26c675f629e4 tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:6e:ea,bridge_name='br-int',has_traffic_filtering=True,id=00b2459b-f98c-46c5-8e73-07894ab10384,network=Network(5052c479-912b-48b4-b29a-770428231240),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00b2459b-f9')
Aug 09 18:42:31 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-aa442a10-70c3-43eb-984f-26c675f629e4 tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Deleting instance files /opt/stack/data/nova/instances/8893bd80-5708-47a5-a9d0-cd0ed6d73e52_del
Aug 09 18:42:31 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-aa442a10-70c3-43eb-984f-26c675f629e4 tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Deletion of /opt/stack/data/nova/instances/8893bd80-5708-47a5-a9d0-cd0ed6d73e52_del complete
Aug 09 18:42:31 user nova-compute[72418]: INFO nova.compute.manager [None req-aa442a10-70c3-43eb-984f-26c675f629e4 tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Took 0.70 seconds to destroy the instance on the hypervisor.
Aug 09 18:42:31 user nova-compute[72418]: DEBUG oslo.service.loopingcall [None req-aa442a10-70c3-43eb-984f-26c675f629e4 tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72418) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 18:42:31 user nova-compute[72418]: DEBUG nova.compute.manager [-] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Deallocating network for instance {{(pid=72418) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 18:42:31 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] deallocate_for_instance() {{(pid=72418) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 18:42:31 user nova-compute[72418]: DEBUG nova.compute.manager [req-9142a09d-6321-40eb-85b8-e8a6b1a15f40 req-2c47282d-9fc8-4f7c-a189-664f42715435 service nova] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Received event network-vif-unplugged-00b2459b-f98c-46c5-8e73-07894ab10384 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:42:31 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-9142a09d-6321-40eb-85b8-e8a6b1a15f40 req-2c47282d-9fc8-4f7c-a189-664f42715435 service nova] Acquiring lock "8893bd80-5708-47a5-a9d0-cd0ed6d73e52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:42:31 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-9142a09d-6321-40eb-85b8-e8a6b1a15f40 req-2c47282d-9fc8-4f7c-a189-664f42715435 service nova] Lock "8893bd80-5708-47a5-a9d0-cd0ed6d73e52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:42:31 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-9142a09d-6321-40eb-85b8-e8a6b1a15f40 req-2c47282d-9fc8-4f7c-a189-664f42715435 service nova] Lock "8893bd80-5708-47a5-a9d0-cd0ed6d73e52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:42:31 user nova-compute[72418]: DEBUG nova.compute.manager [req-9142a09d-6321-40eb-85b8-e8a6b1a15f40 req-2c47282d-9fc8-4f7c-a189-664f42715435 service nova] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] No waiting events found dispatching network-vif-unplugged-00b2459b-f98c-46c5-8e73-07894ab10384 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:42:31 user nova-compute[72418]: DEBUG nova.compute.manager [req-9142a09d-6321-40eb-85b8-e8a6b1a15f40 req-2c47282d-9fc8-4f7c-a189-664f42715435 service nova] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Received event network-vif-unplugged-00b2459b-f98c-46c5-8e73-07894ab10384 for instance with task_state deleting. {{(pid=72418) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 18:42:32 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:32 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:32 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:32 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:32 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:33 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:42:33 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Took 2.25 seconds to deallocate network for instance.
Aug 09 18:42:33 user nova-compute[72418]: DEBUG nova.compute.manager [req-7275bb3a-ec8a-4150-9215-fdc9c428fb4f req-5dd500da-2b4d-41b1-a02d-d05b666af12c service nova] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Received event network-vif-plugged-00b2459b-f98c-46c5-8e73-07894ab10384 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:42:33 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-7275bb3a-ec8a-4150-9215-fdc9c428fb4f req-5dd500da-2b4d-41b1-a02d-d05b666af12c service nova] Acquiring lock "8893bd80-5708-47a5-a9d0-cd0ed6d73e52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:42:33 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-7275bb3a-ec8a-4150-9215-fdc9c428fb4f req-5dd500da-2b4d-41b1-a02d-d05b666af12c service nova] Lock "8893bd80-5708-47a5-a9d0-cd0ed6d73e52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:42:33 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-7275bb3a-ec8a-4150-9215-fdc9c428fb4f req-5dd500da-2b4d-41b1-a02d-d05b666af12c service nova] Lock "8893bd80-5708-47a5-a9d0-cd0ed6d73e52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:42:33 user nova-compute[72418]: DEBUG nova.compute.manager [req-7275bb3a-ec8a-4150-9215-fdc9c428fb4f req-5dd500da-2b4d-41b1-a02d-d05b666af12c service nova] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] No waiting events found dispatching network-vif-plugged-00b2459b-f98c-46c5-8e73-07894ab10384 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:42:33 user nova-compute[72418]: WARNING nova.compute.manager [req-7275bb3a-ec8a-4150-9215-fdc9c428fb4f req-5dd500da-2b4d-41b1-a02d-d05b666af12c service nova] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Received unexpected event network-vif-plugged-00b2459b-f98c-46c5-8e73-07894ab10384 for instance with vm_state active and task_state deleting.
Aug 09 18:42:33 user nova-compute[72418]: DEBUG nova.compute.manager [req-7275bb3a-ec8a-4150-9215-fdc9c428fb4f req-5dd500da-2b4d-41b1-a02d-d05b666af12c service nova] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Received event network-vif-deleted-00b2459b-f98c-46c5-8e73-07894ab10384 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:42:33 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-aa442a10-70c3-43eb-984f-26c675f629e4 tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:42:33 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-aa442a10-70c3-43eb-984f-26c675f629e4 tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:42:34 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-aa442a10-70c3-43eb-984f-26c675f629e4 tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:42:34 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-aa442a10-70c3-43eb-984f-26c675f629e4 tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:42:34 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-aa442a10-70c3-43eb-984f-26c675f629e4 tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.192s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:42:34 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:34 user nova-compute[72418]: INFO nova.scheduler.client.report [None req-aa442a10-70c3-43eb-984f-26c675f629e4 tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Deleted allocations for instance 8893bd80-5708-47a5-a9d0-cd0ed6d73e52
Aug 09 18:42:34 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-aa442a10-70c3-43eb-984f-26c675f629e4 tempest-VolumesActionsTest-1233815310 tempest-VolumesActionsTest-1233815310-project-member] Lock "8893bd80-5708-47a5-a9d0-cd0ed6d73e52" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.473s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:42:36 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:37 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:38 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:38 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:41 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:41 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:42 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:43 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:44 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:45 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Acquiring lock "0f917dfe-409a-474f-9dbb-edbf0eea7871" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:42:45 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Lock "0f917dfe-409a-474f-9dbb-edbf0eea7871" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:42:45 user nova-compute[72418]: DEBUG nova.compute.manager [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] Starting instance... {{(pid=72418) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 18:42:45 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:42:45 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:42:45 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72418) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 18:42:45 user nova-compute[72418]: INFO nova.compute.claims [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] Claim successful on node user
Aug 09 18:42:46 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:42:46 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:42:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.276s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:42:46 user nova-compute[72418]: DEBUG nova.compute.manager [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] Start building networks asynchronously for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 18:42:46 user nova-compute[72418]: DEBUG nova.compute.manager [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] Allocating IP information in the background. {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 18:42:46 user nova-compute[72418]: DEBUG nova.network.neutron [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] allocate_for_instance() {{(pid=72418) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 18:42:46 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 18:42:46 user nova-compute[72418]: DEBUG nova.compute.manager [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] Start building block device mappings for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 18:42:46 user nova-compute[72418]: DEBUG nova.policy [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f6691a938b024ac9abbf81f417065f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8456a86110d1420c9107c38dd3fad34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72418) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 18:42:46 user nova-compute[72418]: DEBUG nova.compute.manager [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] Start spawning the instance on the hypervisor. {{(pid=72418) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 18:42:46 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] Creating instance directory {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 18:42:46 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] Creating image(s)
Aug 09 18:42:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Acquiring lock "/opt/stack/data/nova/instances/0f917dfe-409a-474f-9dbb-edbf0eea7871/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:42:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Lock "/opt/stack/data/nova/instances/0f917dfe-409a-474f-9dbb-edbf0eea7871/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:42:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Lock "/opt/stack/data/nova/instances/0f917dfe-409a-474f-9dbb-edbf0eea7871/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:42:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:42:46 user nova-compute[72418]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691606551.5385606, 8893bd80-5708-47a5-a9d0-cd0ed6d73e52 => Stopped> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:42:46 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] VM Stopped (Lifecycle Event)
Aug 09 18:42:46 user nova-compute[72418]: DEBUG nova.compute.manager [None req-b5feb604-ce7e-41c2-9bb0-b89202a7b483 None None] [instance: 8893bd80-5708-47a5-a9d0-cd0ed6d73e52] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:42:46 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.174s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:42:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Acquiring lock "458773cfa7230b717e41c60277832e9f83806d71" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:42:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:42:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:42:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.157s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:42:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/0f917dfe-409a-474f-9dbb-edbf0eea7871/disk 1073741824 {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:42:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/0f917dfe-409a-474f-9dbb-edbf0eea7871/disk 1073741824" returned: 0 in 0.051s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:42:46 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.218s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:42:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:42:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.165s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:42:46 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0f917dfe-409a-474f-9dbb-edbf0eea7871/disk. size=1073741824 {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 18:42:46 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f917dfe-409a-474f-9dbb-edbf0eea7871/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:42:47 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f917dfe-409a-474f-9dbb-edbf0eea7871/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:42:47 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Cannot resize image /opt/stack/data/nova/instances/0f917dfe-409a-474f-9dbb-edbf0eea7871/disk to a smaller size. {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 18:42:47 user nova-compute[72418]: DEBUG nova.objects.instance [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Lazy-loading 'migration_context' on Instance uuid 0f917dfe-409a-474f-9dbb-edbf0eea7871 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:42:47 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] Created local disks {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 18:42:47 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] Ensure instance console log exists: /opt/stack/data/nova/instances/0f917dfe-409a-474f-9dbb-edbf0eea7871/console.log {{(pid=72418) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 18:42:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:42:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:42:47 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:42:47 user nova-compute[72418]: DEBUG nova.network.neutron [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] Successfully created port: 388535bb-a59e-45d2-96a1-faa742a03ebc {{(pid=72418) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 18:42:48 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Acquiring lock "a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:42:48 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Lock "a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:42:48 user nova-compute[72418]: DEBUG nova.compute.manager [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Starting instance... {{(pid=72418) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 18:42:48 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:42:48 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:42:48 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72418) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 18:42:48 user nova-compute[72418]: INFO nova.compute.claims [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Claim successful on node user
Aug 09 18:42:48 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:48 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:42:48 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:42:48 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.257s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:42:48 user nova-compute[72418]: DEBUG nova.compute.manager [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Start building networks asynchronously for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 18:42:48 user nova-compute[72418]: DEBUG nova.compute.manager [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Allocating IP information in the background. {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 18:42:48 user nova-compute[72418]: DEBUG nova.network.neutron [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] allocate_for_instance() {{(pid=72418) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 18:42:48 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 18:42:48 user nova-compute[72418]: DEBUG nova.compute.manager [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Start building block device mappings for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 18:42:48 user nova-compute[72418]: DEBUG nova.compute.manager [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Start spawning the instance on the hypervisor. {{(pid=72418) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 18:42:48 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Creating instance directory {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 18:42:48 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Creating image(s)
Aug 09 18:42:48 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Acquiring lock "/opt/stack/data/nova/instances/a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:42:48 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Lock "/opt/stack/data/nova/instances/a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:42:48 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Lock "/opt/stack/data/nova/instances/a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:42:48 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:42:48 user nova-compute[72418]: DEBUG nova.policy [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '46e0767876304440b07b078e02bf4a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877d9f19910d444b8d45c61f9c39bfbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72418) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.133s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Acquiring lock "458773cfa7230b717e41c60277832e9f83806d71" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG nova.network.neutron [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] Successfully updated port: 388535bb-a59e-45d2-96a1-faa742a03ebc {{(pid=72418) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Acquiring lock "refresh_cache-0f917dfe-409a-474f-9dbb-edbf0eea7871" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Acquired lock "refresh_cache-0f917dfe-409a-474f-9dbb-edbf0eea7871" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG nova.network.neutron [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG nova.compute.manager [req-64880911-b4b6-4b8f-b93a-242af60c4c21 req-d2e8b456-24ab-46b9-9d30-4f7789011642 service nova] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] Received event network-changed-388535bb-a59e-45d2-96a1-faa742a03ebc {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG nova.compute.manager [req-64880911-b4b6-4b8f-b93a-242af60c4c21 req-d2e8b456-24ab-46b9-9d30-4f7789011642 service nova] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] Refreshing instance network info cache due to event network-changed-388535bb-a59e-45d2-96a1-faa742a03ebc. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-64880911-b4b6-4b8f-b93a-242af60c4c21 req-d2e8b456-24ab-46b9-9d30-4f7789011642 service nova] Acquiring lock "refresh_cache-0f917dfe-409a-474f-9dbb-edbf0eea7871" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.137s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507/disk 1073741824 {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG nova.network.neutron [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] Instance cache missing network info. {{(pid=72418) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507/disk 1073741824" returned: 0 in 0.062s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.170s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507/disk. size=1073741824 {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Cannot resize image /opt/stack/data/nova/instances/a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507/disk to a smaller size. {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG nova.objects.instance [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Lazy-loading 'migration_context' on Instance uuid a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Created local disks {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Ensure instance console log exists: /opt/stack/data/nova/instances/a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507/console.log {{(pid=72418) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG nova.network.neutron [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] Updating instance_info_cache with network_info: [{"id": "388535bb-a59e-45d2-96a1-faa742a03ebc", "address": "fa:16:3e:d9:05:d0", "network": {"id": "c525572b-cf59-4359-88c8-cef227847c3c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2043600619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8456a86110d1420c9107c38dd3fad34f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388535bb-a5", "ovs_interfaceid": "388535bb-a59e-45d2-96a1-faa742a03ebc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Releasing lock "refresh_cache-0f917dfe-409a-474f-9dbb-edbf0eea7871" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG nova.compute.manager [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] Instance network_info: |[{"id": "388535bb-a59e-45d2-96a1-faa742a03ebc", "address": "fa:16:3e:d9:05:d0", "network": {"id": "c525572b-cf59-4359-88c8-cef227847c3c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2043600619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8456a86110d1420c9107c38dd3fad34f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388535bb-a5", "ovs_interfaceid": "388535bb-a59e-45d2-96a1-faa742a03ebc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-64880911-b4b6-4b8f-b93a-242af60c4c21 req-d2e8b456-24ab-46b9-9d30-4f7789011642 service nova] Acquired lock "refresh_cache-0f917dfe-409a-474f-9dbb-edbf0eea7871" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG nova.network.neutron [req-64880911-b4b6-4b8f-b93a-242af60c4c21 req-d2e8b456-24ab-46b9-9d30-4f7789011642 service nova] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] Refreshing network info cache for port 388535bb-a59e-45d2-96a1-faa742a03ebc {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] Start _get_guest_xml network_info=[{"id": "388535bb-a59e-45d2-96a1-faa742a03ebc", "address": "fa:16:3e:d9:05:d0", "network": {"id": "c525572b-cf59-4359-88c8-cef227847c3c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2043600619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8456a86110d1420c9107c38dd3fad34f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388535bb-a5", "ovs_interfaceid": "388535bb-a59e-45d2-96a1-faa742a03ebc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 18:42:49 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:42:49 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:42:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] CPU controller missing on host. {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] CPU controller found on host. {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72418) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T18:17:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Flavor limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Image limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Flavor pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Image pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Got 1 possible topologies {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:42:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1205084567',display_name='tempest-AttachVolumeNegativeTest-server-1205084567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1205084567',id=35,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLSXjHJ8W6dE+TQvFTrCxf1z5HwXceOUgk6bVVSp6mt7T7EX8Ub4Q0zB8/joFIcJv/tzU3Yyw5cJ5Rk7iTlun/SLiAPBVa7xhN35H/k7iW4euV/jDVgLq9wOFGj9Ef/5DQ==',key_name='tempest-keypair-320248311',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8456a86110d1420c9107c38dd3fad34f',ramdisk_id='',reservation_id='r-3gbz2wfw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-892551734',owner_user_name='tempest-AttachVolumeNegativeTest-892551734-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:42:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6691a938b024ac9abbf81f417065f1b',uuid=0f917dfe-409a-474f-9dbb-edbf0eea7871,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "388535bb-a59e-45d2-96a1-faa742a03ebc", "address": "fa:16:3e:d9:05:d0", "network": {"id": "c525572b-cf59-4359-88c8-cef227847c3c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2043600619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8456a86110d1420c9107c38dd3fad34f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388535bb-a5", "ovs_interfaceid": "388535bb-a59e-45d2-96a1-faa742a03ebc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Converting VIF {"id": "388535bb-a59e-45d2-96a1-faa742a03ebc", "address": "fa:16:3e:d9:05:d0", "network": {"id": "c525572b-cf59-4359-88c8-cef227847c3c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2043600619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8456a86110d1420c9107c38dd3fad34f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388535bb-a5", "ovs_interfaceid": "388535bb-a59e-45d2-96a1-faa742a03ebc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:05:d0,bridge_name='br-int',has_traffic_filtering=True,id=388535bb-a59e-45d2-96a1-faa742a03ebc,network=Network(c525572b-cf59-4359-88c8-cef227847c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap388535bb-a5') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG nova.objects.instance [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Lazy-loading 'pci_devices' on Instance uuid 0f917dfe-409a-474f-9dbb-edbf0eea7871 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] End _get_guest_xml xml=<domain type="kvm">
Aug 09 18:42:49 user nova-compute[72418]:   <uuid>0f917dfe-409a-474f-9dbb-edbf0eea7871</uuid>
Aug 09 18:42:49 user nova-compute[72418]:   <name>instance-00000023</name>
Aug 09 18:42:49 user nova-compute[72418]:   <memory>524288</memory>
Aug 09 18:42:49 user nova-compute[72418]:   <vcpu>1</vcpu>
Aug 09 18:42:49 user nova-compute[72418]:   <metadata>
Aug 09 18:42:49 user nova-compute[72418]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:42:49 user nova-compute[72418]:       <nova:package version="0.0.0"/>
Aug 09 18:42:49 user nova-compute[72418]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1205084567</nova:name>
Aug 09 18:42:49 user nova-compute[72418]:       <nova:creationTime>2023-08-09 18:42:49</nova:creationTime>
Aug 09 18:42:49 user nova-compute[72418]:       <nova:flavor name="m1.tiny">
Aug 09 18:42:49 user nova-compute[72418]:         <nova:memory>512</nova:memory>
Aug 09 18:42:49 user nova-compute[72418]:         <nova:disk>1</nova:disk>
Aug 09 18:42:49 user nova-compute[72418]:         <nova:swap>0</nova:swap>
Aug 09 18:42:49 user nova-compute[72418]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:42:49 user nova-compute[72418]:         <nova:vcpus>1</nova:vcpus>
Aug 09 18:42:49 user nova-compute[72418]:       </nova:flavor>
Aug 09 18:42:49 user nova-compute[72418]:       <nova:owner>
Aug 09 18:42:49 user nova-compute[72418]:         <nova:user uuid="f6691a938b024ac9abbf81f417065f1b">tempest-AttachVolumeNegativeTest-892551734-project-member</nova:user>
Aug 09 18:42:49 user nova-compute[72418]:         <nova:project uuid="8456a86110d1420c9107c38dd3fad34f">tempest-AttachVolumeNegativeTest-892551734</nova:project>
Aug 09 18:42:49 user nova-compute[72418]:       </nova:owner>
Aug 09 18:42:49 user nova-compute[72418]:       <nova:root type="image" uuid="8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e"/>
Aug 09 18:42:49 user nova-compute[72418]:       <nova:ports>
Aug 09 18:42:49 user nova-compute[72418]:         <nova:port uuid="388535bb-a59e-45d2-96a1-faa742a03ebc">
Aug 09 18:42:49 user nova-compute[72418]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 18:42:49 user nova-compute[72418]:         </nova:port>
Aug 09 18:42:49 user nova-compute[72418]:       </nova:ports>
Aug 09 18:42:49 user nova-compute[72418]:     </nova:instance>
Aug 09 18:42:49 user nova-compute[72418]:   </metadata>
Aug 09 18:42:49 user nova-compute[72418]:   <sysinfo type="smbios">
Aug 09 18:42:49 user nova-compute[72418]:     <system>
Aug 09 18:42:49 user nova-compute[72418]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 18:42:49 user nova-compute[72418]:       <entry name="product">OpenStack Nova</entry>
Aug 09 18:42:49 user nova-compute[72418]:       <entry name="version">0.0.0</entry>
Aug 09 18:42:49 user nova-compute[72418]:       <entry name="serial">0f917dfe-409a-474f-9dbb-edbf0eea7871</entry>
Aug 09 18:42:49 user nova-compute[72418]:       <entry name="uuid">0f917dfe-409a-474f-9dbb-edbf0eea7871</entry>
Aug 09 18:42:49 user nova-compute[72418]:       <entry name="family">Virtual Machine</entry>
Aug 09 18:42:49 user nova-compute[72418]:     </system>
Aug 09 18:42:49 user nova-compute[72418]:   </sysinfo>
Aug 09 18:42:49 user nova-compute[72418]:   <os>
Aug 09 18:42:49 user nova-compute[72418]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 18:42:49 user nova-compute[72418]:     <boot dev="hd"/>
Aug 09 18:42:49 user nova-compute[72418]:     <smbios mode="sysinfo"/>
Aug 09 18:42:49 user nova-compute[72418]:   </os>
Aug 09 18:42:49 user nova-compute[72418]:   <features>
Aug 09 18:42:49 user nova-compute[72418]:     <acpi/>
Aug 09 18:42:49 user nova-compute[72418]:     <apic/>
Aug 09 18:42:49 user nova-compute[72418]:     <vmcoreinfo/>
Aug 09 18:42:49 user nova-compute[72418]:   </features>
Aug 09 18:42:49 user nova-compute[72418]:   <clock offset="utc">
Aug 09 18:42:49 user nova-compute[72418]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 18:42:49 user nova-compute[72418]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 18:42:49 user nova-compute[72418]:     <timer name="hpet" present="no"/>
Aug 09 18:42:49 user nova-compute[72418]:   </clock>
Aug 09 18:42:49 user nova-compute[72418]:   <cpu mode="custom" match="exact">
Aug 09 18:42:49 user nova-compute[72418]:     <model>Nehalem</model>
Aug 09 18:42:49 user nova-compute[72418]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 18:42:49 user nova-compute[72418]:   </cpu>
Aug 09 18:42:49 user nova-compute[72418]:   <devices>
Aug 09 18:42:49 user nova-compute[72418]:     <disk type="file" device="disk">
Aug 09 18:42:49 user nova-compute[72418]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 18:42:49 user nova-compute[72418]:       <source file="/opt/stack/data/nova/instances/0f917dfe-409a-474f-9dbb-edbf0eea7871/disk"/>
Aug 09 18:42:49 user nova-compute[72418]:       <target dev="vda" bus="virtio"/>
Aug 09 18:42:49 user nova-compute[72418]:     </disk>
Aug 09 18:42:49 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:42:49 user nova-compute[72418]:       <mac address="fa:16:3e:d9:05:d0"/>
Aug 09 18:42:49 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:42:49 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:42:49 user nova-compute[72418]:       <target dev="tap388535bb-a5"/>
Aug 09 18:42:49 user nova-compute[72418]:     </interface>
Aug 09 18:42:49 user nova-compute[72418]:     <serial type="pty">
Aug 09 18:42:49 user nova-compute[72418]:       <log file="/opt/stack/data/nova/instances/0f917dfe-409a-474f-9dbb-edbf0eea7871/console.log" append="off"/>
Aug 09 18:42:49 user nova-compute[72418]:     </serial>
Aug 09 18:42:49 user nova-compute[72418]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 18:42:49 user nova-compute[72418]:     <video>
Aug 09 18:42:49 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:42:49 user nova-compute[72418]:     </video>
Aug 09 18:42:49 user nova-compute[72418]:     <rng model="virtio">
Aug 09 18:42:49 user nova-compute[72418]:       <backend model="random">/dev/urandom</backend>
Aug 09 18:42:49 user nova-compute[72418]:     </rng>
Aug 09 18:42:49 user nova-compute[72418]:     <controller type="usb" index="0" model="none"/>
Aug 09 18:42:49 user nova-compute[72418]:     <memballoon model="virtio">
Aug 09 18:42:49 user nova-compute[72418]:       <stats period="10"/>
Aug 09 18:42:49 user nova-compute[72418]:     </memballoon>
Aug 09 18:42:49 user nova-compute[72418]:   </devices>
Aug 09 18:42:49 user nova-compute[72418]: </domain>
Aug 09 18:42:49 user nova-compute[72418]:  {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:42:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1205084567',display_name='tempest-AttachVolumeNegativeTest-server-1205084567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1205084567',id=35,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLSXjHJ8W6dE+TQvFTrCxf1z5HwXceOUgk6bVVSp6mt7T7EX8Ub4Q0zB8/joFIcJv/tzU3Yyw5cJ5Rk7iTlun/SLiAPBVa7xhN35H/k7iW4euV/jDVgLq9wOFGj9Ef/5DQ==',key_name='tempest-keypair-320248311',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8456a86110d1420c9107c38dd3fad34f',ramdisk_id='',reservation_id='r-3gbz2wfw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-892551734',owner_user_name='tempest-AttachVolumeNegativeTest-892551734-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:42:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6691a938b024ac9abbf81f417065f1b',uuid=0f917dfe-409a-474f-9dbb-edbf0eea7871,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "388535bb-a59e-45d2-96a1-faa742a03ebc", "address": "fa:16:3e:d9:05:d0", "network": {"id": "c525572b-cf59-4359-88c8-cef227847c3c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2043600619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8456a86110d1420c9107c38dd3fad34f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388535bb-a5", "ovs_interfaceid": "388535bb-a59e-45d2-96a1-faa742a03ebc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Converting VIF {"id": "388535bb-a59e-45d2-96a1-faa742a03ebc", "address": "fa:16:3e:d9:05:d0", "network": {"id": "c525572b-cf59-4359-88c8-cef227847c3c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2043600619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8456a86110d1420c9107c38dd3fad34f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388535bb-a5", "ovs_interfaceid": "388535bb-a59e-45d2-96a1-faa742a03ebc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:05:d0,bridge_name='br-int',has_traffic_filtering=True,id=388535bb-a59e-45d2-96a1-faa742a03ebc,network=Network(c525572b-cf59-4359-88c8-cef227847c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap388535bb-a5') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG os_vif [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:05:d0,bridge_name='br-int',has_traffic_filtering=True,id=388535bb-a59e-45d2-96a1-faa742a03ebc,network=Network(c525572b-cf59-4359-88c8-cef227847c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap388535bb-a5') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap388535bb-a5, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap388535bb-a5, col_values=(('external_ids', {'iface-id': '388535bb-a59e-45d2-96a1-faa742a03ebc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:05:d0', 'vm-uuid': '0f917dfe-409a-474f-9dbb-edbf0eea7871'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:49 user nova-compute[72418]: INFO os_vif [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:05:d0,bridge_name='br-int',has_traffic_filtering=True,id=388535bb-a59e-45d2-96a1-faa742a03ebc,network=Network(c525572b-cf59-4359-88c8-cef227847c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap388535bb-a5')
Aug 09 18:42:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:42:49 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] No VIF found with MAC fa:16:3e:d9:05:d0, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:42:50 user nova-compute[72418]: DEBUG nova.network.neutron [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Successfully created port: 7b985408-5155-4fef-963e-34a7ce4561ad {{(pid=72418) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 18:42:50 user nova-compute[72418]: DEBUG nova.network.neutron [req-64880911-b4b6-4b8f-b93a-242af60c4c21 req-d2e8b456-24ab-46b9-9d30-4f7789011642 service nova] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] Updated VIF entry in instance network info cache for port 388535bb-a59e-45d2-96a1-faa742a03ebc. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:42:50 user nova-compute[72418]: DEBUG nova.network.neutron [req-64880911-b4b6-4b8f-b93a-242af60c4c21 req-d2e8b456-24ab-46b9-9d30-4f7789011642 service nova] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] Updating instance_info_cache with network_info: [{"id": "388535bb-a59e-45d2-96a1-faa742a03ebc", "address": "fa:16:3e:d9:05:d0", "network": {"id": "c525572b-cf59-4359-88c8-cef227847c3c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2043600619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8456a86110d1420c9107c38dd3fad34f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388535bb-a5", "ovs_interfaceid": "388535bb-a59e-45d2-96a1-faa742a03ebc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:42:50 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-64880911-b4b6-4b8f-b93a-242af60c4c21 req-d2e8b456-24ab-46b9-9d30-4f7789011642 service nova] Releasing lock "refresh_cache-0f917dfe-409a-474f-9dbb-edbf0eea7871" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:42:50 user nova-compute[72418]: DEBUG nova.network.neutron [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Successfully updated port: 7b985408-5155-4fef-963e-34a7ce4561ad {{(pid=72418) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Acquiring lock "refresh_cache-a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Acquired lock "refresh_cache-a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG nova.network.neutron [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG nova.network.neutron [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Instance cache missing network info. {{(pid=72418) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG nova.compute.manager [req-de158c2d-1dab-4170-99cd-bc5092892e39 req-e0bf658f-ed27-4598-972c-35073e698cd6 service nova] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Received event network-changed-7b985408-5155-4fef-963e-34a7ce4561ad {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG nova.compute.manager [req-de158c2d-1dab-4170-99cd-bc5092892e39 req-e0bf658f-ed27-4598-972c-35073e698cd6 service nova] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Refreshing instance network info cache due to event network-changed-7b985408-5155-4fef-963e-34a7ce4561ad. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-de158c2d-1dab-4170-99cd-bc5092892e39 req-e0bf658f-ed27-4598-972c-35073e698cd6 service nova] Acquiring lock "refresh_cache-a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG nova.network.neutron [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Updating instance_info_cache with network_info: [{"id": "7b985408-5155-4fef-963e-34a7ce4561ad", "address": "fa:16:3e:ae:d6:b4", "network": {"id": "dc901a3f-b5ca-47ad-9f8b-7f3aa30f24b2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-907587267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "877d9f19910d444b8d45c61f9c39bfbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b985408-51", "ovs_interfaceid": "7b985408-5155-4fef-963e-34a7ce4561ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Releasing lock "refresh_cache-a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG nova.compute.manager [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Instance network_info: |[{"id": "7b985408-5155-4fef-963e-34a7ce4561ad", "address": "fa:16:3e:ae:d6:b4", "network": {"id": "dc901a3f-b5ca-47ad-9f8b-7f3aa30f24b2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-907587267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "877d9f19910d444b8d45c61f9c39bfbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b985408-51", "ovs_interfaceid": "7b985408-5155-4fef-963e-34a7ce4561ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-de158c2d-1dab-4170-99cd-bc5092892e39 req-e0bf658f-ed27-4598-972c-35073e698cd6 service nova] Acquired lock "refresh_cache-a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG nova.network.neutron [req-de158c2d-1dab-4170-99cd-bc5092892e39 req-e0bf658f-ed27-4598-972c-35073e698cd6 service nova] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Refreshing network info cache for port 7b985408-5155-4fef-963e-34a7ce4561ad {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Start _get_guest_xml network_info=[{"id": "7b985408-5155-4fef-963e-34a7ce4561ad", "address": "fa:16:3e:ae:d6:b4", "network": {"id": "dc901a3f-b5ca-47ad-9f8b-7f3aa30f24b2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-907587267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "877d9f19910d444b8d45c61f9c39bfbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b985408-51", "ovs_interfaceid": "7b985408-5155-4fef-963e-34a7ce4561ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 18:42:51 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:42:51 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:42:51 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] CPU controller missing on host. {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] CPU controller found on host. {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72418) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T18:17:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Flavor limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Image limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Flavor pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Image pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Got 1 possible topologies {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:42:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-147420616',display_name='tempest-TestServerVolumeAttachmentScenario-server-147420616',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-147420616',id=36,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsUnb8+Km9M48sPUW/Pu88UVrrle6B1w+aKY9IYPdRsDbIIObcxkx9RwDLQcQOGG9BMV3P7WUBW2R9NYEqua8co9QgGavouoBKSxa8HsddmbMSfv24fcvp4t1wGy5v9LQ==',key_name='tempest-keypair-306593175',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='877d9f19910d444b8d45c61f9c39bfbb',ramdisk_id='',reservation_id='r-1nrzd1in',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1757618506',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1757618506-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:42:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46e0767876304440b07b078e02bf4a91',uuid=a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b985408-5155-4fef-963e-34a7ce4561ad", "address": "fa:16:3e:ae:d6:b4", "network": {"id": "dc901a3f-b5ca-47ad-9f8b-7f3aa30f24b2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-907587267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "877d9f19910d444b8d45c61f9c39bfbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b985408-51", "ovs_interfaceid": "7b985408-5155-4fef-963e-34a7ce4561ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Converting VIF {"id": "7b985408-5155-4fef-963e-34a7ce4561ad", "address": "fa:16:3e:ae:d6:b4", "network": {"id": "dc901a3f-b5ca-47ad-9f8b-7f3aa30f24b2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-907587267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "877d9f19910d444b8d45c61f9c39bfbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b985408-51", "ovs_interfaceid": "7b985408-5155-4fef-963e-34a7ce4561ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:d6:b4,bridge_name='br-int',has_traffic_filtering=True,id=7b985408-5155-4fef-963e-34a7ce4561ad,network=Network(dc901a3f-b5ca-47ad-9f8b-7f3aa30f24b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b985408-51') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG nova.objects.instance [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Lazy-loading 'pci_devices' on Instance uuid a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG nova.compute.manager [req-045d4ff2-a95d-4fa0-a1ed-ff90a5b2bfab req-4211a4a3-d68e-48f0-aa28-9ed3f951a913 service nova] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] Received event network-vif-plugged-388535bb-a59e-45d2-96a1-faa742a03ebc {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-045d4ff2-a95d-4fa0-a1ed-ff90a5b2bfab req-4211a4a3-d68e-48f0-aa28-9ed3f951a913 service nova] Acquiring lock "0f917dfe-409a-474f-9dbb-edbf0eea7871-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-045d4ff2-a95d-4fa0-a1ed-ff90a5b2bfab req-4211a4a3-d68e-48f0-aa28-9ed3f951a913 service nova] Lock "0f917dfe-409a-474f-9dbb-edbf0eea7871-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-045d4ff2-a95d-4fa0-a1ed-ff90a5b2bfab req-4211a4a3-d68e-48f0-aa28-9ed3f951a913 service nova] Lock "0f917dfe-409a-474f-9dbb-edbf0eea7871-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG nova.compute.manager [req-045d4ff2-a95d-4fa0-a1ed-ff90a5b2bfab req-4211a4a3-d68e-48f0-aa28-9ed3f951a913 service nova] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] No waiting events found dispatching network-vif-plugged-388535bb-a59e-45d2-96a1-faa742a03ebc {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:42:51 user nova-compute[72418]: WARNING nova.compute.manager [req-045d4ff2-a95d-4fa0-a1ed-ff90a5b2bfab req-4211a4a3-d68e-48f0-aa28-9ed3f951a913 service nova] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] Received unexpected event network-vif-plugged-388535bb-a59e-45d2-96a1-faa742a03ebc for instance with vm_state building and task_state spawning.
Aug 09 18:42:51 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] End _get_guest_xml xml=<domain type="kvm">
Aug 09 18:42:51 user nova-compute[72418]:   <uuid>a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507</uuid>
Aug 09 18:42:51 user nova-compute[72418]:   <name>instance-00000024</name>
Aug 09 18:42:51 user nova-compute[72418]:   <memory>524288</memory>
Aug 09 18:42:51 user nova-compute[72418]:   <vcpu>1</vcpu>
Aug 09 18:42:51 user nova-compute[72418]:   <metadata>
Aug 09 18:42:51 user nova-compute[72418]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:42:51 user nova-compute[72418]:       <nova:package version="0.0.0"/>
Aug 09 18:42:51 user nova-compute[72418]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-147420616</nova:name>
Aug 09 18:42:51 user nova-compute[72418]:       <nova:creationTime>2023-08-09 18:42:51</nova:creationTime>
Aug 09 18:42:51 user nova-compute[72418]:       <nova:flavor name="m1.tiny">
Aug 09 18:42:51 user nova-compute[72418]:         <nova:memory>512</nova:memory>
Aug 09 18:42:51 user nova-compute[72418]:         <nova:disk>1</nova:disk>
Aug 09 18:42:51 user nova-compute[72418]:         <nova:swap>0</nova:swap>
Aug 09 18:42:51 user nova-compute[72418]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:42:51 user nova-compute[72418]:         <nova:vcpus>1</nova:vcpus>
Aug 09 18:42:51 user nova-compute[72418]:       </nova:flavor>
Aug 09 18:42:51 user nova-compute[72418]:       <nova:owner>
Aug 09 18:42:51 user nova-compute[72418]:         <nova:user uuid="46e0767876304440b07b078e02bf4a91">tempest-TestServerVolumeAttachmentScenario-1757618506-project-member</nova:user>
Aug 09 18:42:51 user nova-compute[72418]:         <nova:project uuid="877d9f19910d444b8d45c61f9c39bfbb">tempest-TestServerVolumeAttachmentScenario-1757618506</nova:project>
Aug 09 18:42:51 user nova-compute[72418]:       </nova:owner>
Aug 09 18:42:51 user nova-compute[72418]:       <nova:root type="image" uuid="8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e"/>
Aug 09 18:42:51 user nova-compute[72418]:       <nova:ports>
Aug 09 18:42:51 user nova-compute[72418]:         <nova:port uuid="7b985408-5155-4fef-963e-34a7ce4561ad">
Aug 09 18:42:51 user nova-compute[72418]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 18:42:51 user nova-compute[72418]:         </nova:port>
Aug 09 18:42:51 user nova-compute[72418]:       </nova:ports>
Aug 09 18:42:51 user nova-compute[72418]:     </nova:instance>
Aug 09 18:42:51 user nova-compute[72418]:   </metadata>
Aug 09 18:42:51 user nova-compute[72418]:   <sysinfo type="smbios">
Aug 09 18:42:51 user nova-compute[72418]:     <system>
Aug 09 18:42:51 user nova-compute[72418]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 18:42:51 user nova-compute[72418]:       <entry name="product">OpenStack Nova</entry>
Aug 09 18:42:51 user nova-compute[72418]:       <entry name="version">0.0.0</entry>
Aug 09 18:42:51 user nova-compute[72418]:       <entry name="serial">a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507</entry>
Aug 09 18:42:51 user nova-compute[72418]:       <entry name="uuid">a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507</entry>
Aug 09 18:42:51 user nova-compute[72418]:       <entry name="family">Virtual Machine</entry>
Aug 09 18:42:51 user nova-compute[72418]:     </system>
Aug 09 18:42:51 user nova-compute[72418]:   </sysinfo>
Aug 09 18:42:51 user nova-compute[72418]:   <os>
Aug 09 18:42:51 user nova-compute[72418]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 18:42:51 user nova-compute[72418]:     <boot dev="hd"/>
Aug 09 18:42:51 user nova-compute[72418]:     <smbios mode="sysinfo"/>
Aug 09 18:42:51 user nova-compute[72418]:   </os>
Aug 09 18:42:51 user nova-compute[72418]:   <features>
Aug 09 18:42:51 user nova-compute[72418]:     <acpi/>
Aug 09 18:42:51 user nova-compute[72418]:     <apic/>
Aug 09 18:42:51 user nova-compute[72418]:     <vmcoreinfo/>
Aug 09 18:42:51 user nova-compute[72418]:   </features>
Aug 09 18:42:51 user nova-compute[72418]:   <clock offset="utc">
Aug 09 18:42:51 user nova-compute[72418]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 18:42:51 user nova-compute[72418]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 18:42:51 user nova-compute[72418]:     <timer name="hpet" present="no"/>
Aug 09 18:42:51 user nova-compute[72418]:   </clock>
Aug 09 18:42:51 user nova-compute[72418]:   <cpu mode="custom" match="exact">
Aug 09 18:42:51 user nova-compute[72418]:     <model>Nehalem</model>
Aug 09 18:42:51 user nova-compute[72418]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 18:42:51 user nova-compute[72418]:   </cpu>
Aug 09 18:42:51 user nova-compute[72418]:   <devices>
Aug 09 18:42:51 user nova-compute[72418]:     <disk type="file" device="disk">
Aug 09 18:42:51 user nova-compute[72418]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 18:42:51 user nova-compute[72418]:       <source file="/opt/stack/data/nova/instances/a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507/disk"/>
Aug 09 18:42:51 user nova-compute[72418]:       <target dev="vda" bus="virtio"/>
Aug 09 18:42:51 user nova-compute[72418]:     </disk>
Aug 09 18:42:51 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:42:51 user nova-compute[72418]:       <mac address="fa:16:3e:ae:d6:b4"/>
Aug 09 18:42:51 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:42:51 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:42:51 user nova-compute[72418]:       <target dev="tap7b985408-51"/>
Aug 09 18:42:51 user nova-compute[72418]:     </interface>
Aug 09 18:42:51 user nova-compute[72418]:     <serial type="pty">
Aug 09 18:42:51 user nova-compute[72418]:       <log file="/opt/stack/data/nova/instances/a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507/console.log" append="off"/>
Aug 09 18:42:51 user nova-compute[72418]:     </serial>
Aug 09 18:42:51 user nova-compute[72418]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 18:42:51 user nova-compute[72418]:     <video>
Aug 09 18:42:51 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:42:51 user nova-compute[72418]:     </video>
Aug 09 18:42:51 user nova-compute[72418]:     <rng model="virtio">
Aug 09 18:42:51 user nova-compute[72418]:       <backend model="random">/dev/urandom</backend>
Aug 09 18:42:51 user nova-compute[72418]:     </rng>
Aug 09 18:42:51 user nova-compute[72418]:     <controller type="usb" index="0" model="none"/>
Aug 09 18:42:51 user nova-compute[72418]:     <memballoon model="virtio">
Aug 09 18:42:51 user nova-compute[72418]:       <stats period="10"/>
Aug 09 18:42:51 user nova-compute[72418]:     </memballoon>
Aug 09 18:42:51 user nova-compute[72418]:   </devices>
Aug 09 18:42:51 user nova-compute[72418]: </domain>
Aug 09 18:42:51 user nova-compute[72418]:  {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:42:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-147420616',display_name='tempest-TestServerVolumeAttachmentScenario-server-147420616',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-147420616',id=36,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsUnb8+Km9M48sPUW/Pu88UVrrle6B1w+aKY9IYPdRsDbIIObcxkx9RwDLQcQOGG9BMV3P7WUBW2R9NYEqua8co9QgGavouoBKSxa8HsddmbMSfv24fcvp4t1wGy5v9LQ==',key_name='tempest-keypair-306593175',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='877d9f19910d444b8d45c61f9c39bfbb',ramdisk_id='',reservation_id='r-1nrzd1in',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1757618506',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1757618506-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:42:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46e0767876304440b07b078e02bf4a91',uuid=a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b985408-5155-4fef-963e-34a7ce4561ad", "address": "fa:16:3e:ae:d6:b4", "network": {"id": "dc901a3f-b5ca-47ad-9f8b-7f3aa30f24b2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-907587267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "877d9f19910d444b8d45c61f9c39bfbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b985408-51", "ovs_interfaceid": "7b985408-5155-4fef-963e-34a7ce4561ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Converting VIF {"id": "7b985408-5155-4fef-963e-34a7ce4561ad", "address": "fa:16:3e:ae:d6:b4", "network": {"id": "dc901a3f-b5ca-47ad-9f8b-7f3aa30f24b2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-907587267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "877d9f19910d444b8d45c61f9c39bfbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b985408-51", "ovs_interfaceid": "7b985408-5155-4fef-963e-34a7ce4561ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:d6:b4,bridge_name='br-int',has_traffic_filtering=True,id=7b985408-5155-4fef-963e-34a7ce4561ad,network=Network(dc901a3f-b5ca-47ad-9f8b-7f3aa30f24b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b985408-51') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG os_vif [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:d6:b4,bridge_name='br-int',has_traffic_filtering=True,id=7b985408-5155-4fef-963e-34a7ce4561ad,network=Network(dc901a3f-b5ca-47ad-9f8b-7f3aa30f24b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b985408-51') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7b985408-51, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7b985408-51, col_values=(('external_ids', {'iface-id': '7b985408-5155-4fef-963e-34a7ce4561ad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:d6:b4', 'vm-uuid': 'a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:51 user nova-compute[72418]: INFO os_vif [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:d6:b4,bridge_name='br-int',has_traffic_filtering=True,id=7b985408-5155-4fef-963e-34a7ce4561ad,network=Network(dc901a3f-b5ca-47ad-9f8b-7f3aa30f24b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b985408-51')
Aug 09 18:42:51 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] No VIF found with MAC fa:16:3e:ae:d6:b4, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG nova.network.neutron [req-de158c2d-1dab-4170-99cd-bc5092892e39 req-e0bf658f-ed27-4598-972c-35073e698cd6 service nova] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Updated VIF entry in instance network info cache for port 7b985408-5155-4fef-963e-34a7ce4561ad. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG nova.network.neutron [req-de158c2d-1dab-4170-99cd-bc5092892e39 req-e0bf658f-ed27-4598-972c-35073e698cd6 service nova] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Updating instance_info_cache with network_info: [{"id": "7b985408-5155-4fef-963e-34a7ce4561ad", "address": "fa:16:3e:ae:d6:b4", "network": {"id": "dc901a3f-b5ca-47ad-9f8b-7f3aa30f24b2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-907587267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "877d9f19910d444b8d45c61f9c39bfbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b985408-51", "ovs_interfaceid": "7b985408-5155-4fef-963e-34a7ce4561ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:51 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-de158c2d-1dab-4170-99cd-bc5092892e39 req-e0bf658f-ed27-4598-972c-35073e698cd6 service nova] Releasing lock "refresh_cache-a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:42:52 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:52 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:52 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:53 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:53 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:53 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:53 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:53 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:53 user nova-compute[72418]: DEBUG nova.compute.manager [req-5c69e5e2-5c55-4377-b9e6-c324ff7bfe48 req-8e619d37-7fed-4729-be19-46f976f4bb13 service nova] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] Received event network-vif-plugged-388535bb-a59e-45d2-96a1-faa742a03ebc {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:42:53 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-5c69e5e2-5c55-4377-b9e6-c324ff7bfe48 req-8e619d37-7fed-4729-be19-46f976f4bb13 service nova] Acquiring lock "0f917dfe-409a-474f-9dbb-edbf0eea7871-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:42:53 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-5c69e5e2-5c55-4377-b9e6-c324ff7bfe48 req-8e619d37-7fed-4729-be19-46f976f4bb13 service nova] Lock "0f917dfe-409a-474f-9dbb-edbf0eea7871-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:42:53 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-5c69e5e2-5c55-4377-b9e6-c324ff7bfe48 req-8e619d37-7fed-4729-be19-46f976f4bb13 service nova] Lock "0f917dfe-409a-474f-9dbb-edbf0eea7871-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:42:53 user nova-compute[72418]: DEBUG nova.compute.manager [req-5c69e5e2-5c55-4377-b9e6-c324ff7bfe48 req-8e619d37-7fed-4729-be19-46f976f4bb13 service nova] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] No waiting events found dispatching network-vif-plugged-388535bb-a59e-45d2-96a1-faa742a03ebc {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:42:53 user nova-compute[72418]: WARNING nova.compute.manager [req-5c69e5e2-5c55-4377-b9e6-c324ff7bfe48 req-8e619d37-7fed-4729-be19-46f976f4bb13 service nova] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] Received unexpected event network-vif-plugged-388535bb-a59e-45d2-96a1-faa742a03ebc for instance with vm_state building and task_state spawning.
Aug 09 18:42:53 user nova-compute[72418]: DEBUG nova.compute.manager [req-5c69e5e2-5c55-4377-b9e6-c324ff7bfe48 req-8e619d37-7fed-4729-be19-46f976f4bb13 service nova] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Received event network-vif-plugged-7b985408-5155-4fef-963e-34a7ce4561ad {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:42:53 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-5c69e5e2-5c55-4377-b9e6-c324ff7bfe48 req-8e619d37-7fed-4729-be19-46f976f4bb13 service nova] Acquiring lock "a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:42:53 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-5c69e5e2-5c55-4377-b9e6-c324ff7bfe48 req-8e619d37-7fed-4729-be19-46f976f4bb13 service nova] Lock "a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:42:53 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-5c69e5e2-5c55-4377-b9e6-c324ff7bfe48 req-8e619d37-7fed-4729-be19-46f976f4bb13 service nova] Lock "a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:42:53 user nova-compute[72418]: DEBUG nova.compute.manager [req-5c69e5e2-5c55-4377-b9e6-c324ff7bfe48 req-8e619d37-7fed-4729-be19-46f976f4bb13 service nova] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] No waiting events found dispatching network-vif-plugged-7b985408-5155-4fef-963e-34a7ce4561ad {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:42:53 user nova-compute[72418]: WARNING nova.compute.manager [req-5c69e5e2-5c55-4377-b9e6-c324ff7bfe48 req-8e619d37-7fed-4729-be19-46f976f4bb13 service nova] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Received unexpected event network-vif-plugged-7b985408-5155-4fef-963e-34a7ce4561ad for instance with vm_state building and task_state spawning.
Aug 09 18:42:53 user nova-compute[72418]: DEBUG nova.compute.manager [req-5c69e5e2-5c55-4377-b9e6-c324ff7bfe48 req-8e619d37-7fed-4729-be19-46f976f4bb13 service nova] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Received event network-vif-plugged-7b985408-5155-4fef-963e-34a7ce4561ad {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:42:53 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-5c69e5e2-5c55-4377-b9e6-c324ff7bfe48 req-8e619d37-7fed-4729-be19-46f976f4bb13 service nova] Acquiring lock "a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:42:53 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-5c69e5e2-5c55-4377-b9e6-c324ff7bfe48 req-8e619d37-7fed-4729-be19-46f976f4bb13 service nova] Lock "a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:42:53 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-5c69e5e2-5c55-4377-b9e6-c324ff7bfe48 req-8e619d37-7fed-4729-be19-46f976f4bb13 service nova] Lock "a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:42:53 user nova-compute[72418]: DEBUG nova.compute.manager [req-5c69e5e2-5c55-4377-b9e6-c324ff7bfe48 req-8e619d37-7fed-4729-be19-46f976f4bb13 service nova] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] No waiting events found dispatching network-vif-plugged-7b985408-5155-4fef-963e-34a7ce4561ad {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:42:53 user nova-compute[72418]: WARNING nova.compute.manager [req-5c69e5e2-5c55-4377-b9e6-c324ff7bfe48 req-8e619d37-7fed-4729-be19-46f976f4bb13 service nova] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Received unexpected event network-vif-plugged-7b985408-5155-4fef-963e-34a7ce4561ad for instance with vm_state building and task_state spawning.
Aug 09 18:42:54 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691606574.1630034, 0f917dfe-409a-474f-9dbb-edbf0eea7871 => Resumed> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:42:54 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] VM Resumed (Lifecycle Event)
Aug 09 18:42:54 user nova-compute[72418]: DEBUG nova.compute.manager [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] Instance event wait completed in 0 seconds for  {{(pid=72418) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 18:42:54 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] Guest created on hypervisor {{(pid=72418) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 18:42:54 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] Instance spawned successfully.
Aug 09 18:42:54 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 18:42:54 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:42:54 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:42:54 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] Found default for hw_cdrom_bus of ide {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:42:54 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] Found default for hw_disk_bus of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:42:54 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] Found default for hw_input_bus of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:42:54 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] Found default for hw_pointer_model of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:42:54 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] Found default for hw_video_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:42:54 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] Found default for hw_vif_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:42:54 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:42:54 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691606574.165996, 0f917dfe-409a-474f-9dbb-edbf0eea7871 => Started> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:42:54 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] VM Started (Lifecycle Event)
Aug 09 18:42:54 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:42:54 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:42:54 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:42:54 user nova-compute[72418]: INFO nova.compute.manager [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] Took 7.89 seconds to spawn the instance on the hypervisor.
Aug 09 18:42:54 user nova-compute[72418]: DEBUG nova.compute.manager [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:42:54 user nova-compute[72418]: INFO nova.compute.manager [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] Took 8.53 seconds to build instance.
Aug 09 18:42:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-dfbe557a-f5fe-496c-a37e-70136f5780ed tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Lock "0f917dfe-409a-474f-9dbb-edbf0eea7871" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.630s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:42:55 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691606575.0945492, a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507 => Resumed> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:42:55 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] VM Resumed (Lifecycle Event)
Aug 09 18:42:55 user nova-compute[72418]: DEBUG nova.compute.manager [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Instance event wait completed in 0 seconds for  {{(pid=72418) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 18:42:55 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Guest created on hypervisor {{(pid=72418) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 18:42:55 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Instance spawned successfully.
Aug 09 18:42:55 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 18:42:55 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:42:55 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:42:55 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Found default for hw_cdrom_bus of ide {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:42:55 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Found default for hw_disk_bus of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:42:55 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Found default for hw_input_bus of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:42:55 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Found default for hw_pointer_model of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:42:55 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Found default for hw_video_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:42:55 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Found default for hw_vif_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:42:55 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:42:55 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691606575.098406, a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507 => Started> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:42:55 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] VM Started (Lifecycle Event)
Aug 09 18:42:55 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:42:55 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:42:55 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:42:55 user nova-compute[72418]: INFO nova.compute.manager [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Took 6.37 seconds to spawn the instance on the hypervisor.
Aug 09 18:42:55 user nova-compute[72418]: DEBUG nova.compute.manager [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:42:55 user nova-compute[72418]: INFO nova.compute.manager [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Took 6.95 seconds to build instance.
Aug 09 18:42:55 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-289b0356-c7e0-40ba-bdd7-c5a334f81f73 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Lock "a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.065s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:42:56 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:58 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:42:58 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:42:59 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:42:59 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72418) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 18:43:00 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:43:00 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:43:00 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72418) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 18:43:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-35e8cbf2-0089-42aa-9318-ebdb244ea8d2 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Acquiring lock "c46f2599-93f8-412e-9918-7ace8a9f19dd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:43:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-35e8cbf2-0089-42aa-9318-ebdb244ea8d2 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "c46f2599-93f8-412e-9918-7ace8a9f19dd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:43:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-35e8cbf2-0089-42aa-9318-ebdb244ea8d2 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Acquiring lock "c46f2599-93f8-412e-9918-7ace8a9f19dd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:43:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-35e8cbf2-0089-42aa-9318-ebdb244ea8d2 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "c46f2599-93f8-412e-9918-7ace8a9f19dd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:43:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-35e8cbf2-0089-42aa-9318-ebdb244ea8d2 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "c46f2599-93f8-412e-9918-7ace8a9f19dd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:43:01 user nova-compute[72418]: INFO nova.compute.manager [None req-35e8cbf2-0089-42aa-9318-ebdb244ea8d2 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Terminating instance
Aug 09 18:43:01 user nova-compute[72418]: DEBUG nova.compute.manager [None req-35e8cbf2-0089-42aa-9318-ebdb244ea8d2 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Start destroying the instance on the hypervisor. {{(pid=72418) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 18:43:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:43:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:43:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:43:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:43:01 user nova-compute[72418]: DEBUG nova.compute.manager [req-78ac6ac6-7454-4474-8e0d-5aba87a5c66a req-c4202eca-6ae7-4c13-b3b3-b8651c3fbf01 service nova] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Received event network-vif-unplugged-6c9676d3-6e5d-4a95-a24f-0df4a15e993d {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:43:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-78ac6ac6-7454-4474-8e0d-5aba87a5c66a req-c4202eca-6ae7-4c13-b3b3-b8651c3fbf01 service nova] Acquiring lock "c46f2599-93f8-412e-9918-7ace8a9f19dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:43:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-78ac6ac6-7454-4474-8e0d-5aba87a5c66a req-c4202eca-6ae7-4c13-b3b3-b8651c3fbf01 service nova] Lock "c46f2599-93f8-412e-9918-7ace8a9f19dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:43:01 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-78ac6ac6-7454-4474-8e0d-5aba87a5c66a req-c4202eca-6ae7-4c13-b3b3-b8651c3fbf01 service nova] Lock "c46f2599-93f8-412e-9918-7ace8a9f19dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:43:01 user nova-compute[72418]: DEBUG nova.compute.manager [req-78ac6ac6-7454-4474-8e0d-5aba87a5c66a req-c4202eca-6ae7-4c13-b3b3-b8651c3fbf01 service nova] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] No waiting events found dispatching network-vif-unplugged-6c9676d3-6e5d-4a95-a24f-0df4a15e993d {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:43:01 user nova-compute[72418]: DEBUG nova.compute.manager [req-78ac6ac6-7454-4474-8e0d-5aba87a5c66a req-c4202eca-6ae7-4c13-b3b3-b8651c3fbf01 service nova] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Received event network-vif-unplugged-6c9676d3-6e5d-4a95-a24f-0df4a15e993d for instance with task_state deleting. {{(pid=72418) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 18:43:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:43:01 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Instance destroyed successfully.
Aug 09 18:43:01 user nova-compute[72418]: DEBUG nova.objects.instance [None req-35e8cbf2-0089-42aa-9318-ebdb244ea8d2 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lazy-loading 'resources' on Instance uuid c46f2599-93f8-412e-9918-7ace8a9f19dd {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:43:01 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-35e8cbf2-0089-42aa-9318-ebdb244ea8d2 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T18:26:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1080698985',display_name='tempest-ServerActionsTestOtherA-server-837028949',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1080698985',id=17,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZ8H8MvJhas/vPLXexc9KvUsV16Uhsl6uYTaDGrZC9aE3rBb3x7zoV+NqPR5zKzOIkCqtgn8ZVvU3tdtAtEAYrB/yDbEIXvY0hEVuVM8ww17BzMc60Vtn0IN61LmfWZ8Q==',key_name='tempest-keypair-882054128',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:31:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='78b6e36a5b61456092ce7de9212c3c82',ramdisk_id='',reservation_id='r-g13uz4wm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1039384122',owner_user_name='tempest-ServerActionsTestOtherA-1039384122-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:31:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='edc9ed6980274b978caf0666a9b31379',uuid=c46f2599-93f8-412e-9918-7ace8a9f19dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6c9676d3-6e5d-4a95-a24f-0df4a15e993d", "address": "fa:16:3e:80:17:d9", "network": {"id": "bd36ef30-e57d-473f-97bc-c51b5db08aa7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-425133239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78b6e36a5b61456092ce7de9212c3c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9676d3-6e", "ovs_interfaceid": "6c9676d3-6e5d-4a95-a24f-0df4a15e993d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 18:43:01 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-35e8cbf2-0089-42aa-9318-ebdb244ea8d2 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Converting VIF {"id": "6c9676d3-6e5d-4a95-a24f-0df4a15e993d", "address": "fa:16:3e:80:17:d9", "network": {"id": "bd36ef30-e57d-473f-97bc-c51b5db08aa7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-425133239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78b6e36a5b61456092ce7de9212c3c82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9676d3-6e", "ovs_interfaceid": "6c9676d3-6e5d-4a95-a24f-0df4a15e993d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:43:01 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-35e8cbf2-0089-42aa-9318-ebdb244ea8d2 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:17:d9,bridge_name='br-int',has_traffic_filtering=True,id=6c9676d3-6e5d-4a95-a24f-0df4a15e993d,network=Network(bd36ef30-e57d-473f-97bc-c51b5db08aa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9676d3-6e') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:43:01 user nova-compute[72418]: DEBUG os_vif [None req-35e8cbf2-0089-42aa-9318-ebdb244ea8d2 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:17:d9,bridge_name='br-int',has_traffic_filtering=True,id=6c9676d3-6e5d-4a95-a24f-0df4a15e993d,network=Network(bd36ef30-e57d-473f-97bc-c51b5db08aa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9676d3-6e') {{(pid=72418) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 18:43:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:43:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6c9676d3-6e, bridge=br-int, if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:43:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:43:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:43:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:43:01 user nova-compute[72418]: INFO os_vif [None req-35e8cbf2-0089-42aa-9318-ebdb244ea8d2 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:17:d9,bridge_name='br-int',has_traffic_filtering=True,id=6c9676d3-6e5d-4a95-a24f-0df4a15e993d,network=Network(bd36ef30-e57d-473f-97bc-c51b5db08aa7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9676d3-6e')
Aug 09 18:43:01 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-35e8cbf2-0089-42aa-9318-ebdb244ea8d2 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Deleting instance files /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd_del
Aug 09 18:43:01 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-35e8cbf2-0089-42aa-9318-ebdb244ea8d2 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Deletion of /opt/stack/data/nova/instances/c46f2599-93f8-412e-9918-7ace8a9f19dd_del complete
Aug 09 18:43:01 user nova-compute[72418]: INFO nova.compute.manager [None req-35e8cbf2-0089-42aa-9318-ebdb244ea8d2 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 09 18:43:01 user nova-compute[72418]: DEBUG oslo.service.loopingcall [None req-35e8cbf2-0089-42aa-9318-ebdb244ea8d2 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72418) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 18:43:01 user nova-compute[72418]: DEBUG nova.compute.manager [-] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Deallocating network for instance {{(pid=72418) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 18:43:01 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] deallocate_for_instance() {{(pid=72418) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 18:43:01 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:43:02 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:43:02 user nova-compute[72418]: DEBUG nova.compute.manager [req-9d1ded9d-d85c-4ac2-a7e7-d90813972be7 req-bca813e3-9f85-4eb1-873f-5ed514b049df service nova] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Received event network-vif-deleted-6c9676d3-6e5d-4a95-a24f-0df4a15e993d {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:43:02 user nova-compute[72418]: INFO nova.compute.manager [req-9d1ded9d-d85c-4ac2-a7e7-d90813972be7 req-bca813e3-9f85-4eb1-873f-5ed514b049df service nova] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Neutron deleted interface 6c9676d3-6e5d-4a95-a24f-0df4a15e993d; detaching it from the instance and deleting it from the info cache
Aug 09 18:43:02 user nova-compute[72418]: DEBUG nova.network.neutron [req-9d1ded9d-d85c-4ac2-a7e7-d90813972be7 req-bca813e3-9f85-4eb1-873f-5ed514b049df service nova] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:43:02 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Took 0.67 seconds to deallocate network for instance.
Aug 09 18:43:02 user nova-compute[72418]: DEBUG nova.compute.manager [req-9d1ded9d-d85c-4ac2-a7e7-d90813972be7 req-bca813e3-9f85-4eb1-873f-5ed514b049df service nova] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Detach interface failed, port_id=6c9676d3-6e5d-4a95-a24f-0df4a15e993d, reason: Instance c46f2599-93f8-412e-9918-7ace8a9f19dd could not be found. {{(pid=72418) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 18:43:02 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-35e8cbf2-0089-42aa-9318-ebdb244ea8d2 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:43:02 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-35e8cbf2-0089-42aa-9318-ebdb244ea8d2 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:43:02 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-35e8cbf2-0089-42aa-9318-ebdb244ea8d2 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:43:02 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-35e8cbf2-0089-42aa-9318-ebdb244ea8d2 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:43:02 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-35e8cbf2-0089-42aa-9318-ebdb244ea8d2 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.204s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:43:02 user nova-compute[72418]: INFO nova.scheduler.client.report [None req-35e8cbf2-0089-42aa-9318-ebdb244ea8d2 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Deleted allocations for instance c46f2599-93f8-412e-9918-7ace8a9f19dd
Aug 09 18:43:02 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-35e8cbf2-0089-42aa-9318-ebdb244ea8d2 tempest-ServerActionsTestOtherA-1039384122 tempest-ServerActionsTestOtherA-1039384122-project-member] Lock "c46f2599-93f8-412e-9918-7ace8a9f19dd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.941s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:43:03 user nova-compute[72418]: DEBUG nova.compute.manager [req-1eb30f63-27df-4d18-96b3-e36527ad59b9 req-018a9c96-3697-4f15-b06d-29e5e7ea8dc8 service nova] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Received event network-vif-plugged-6c9676d3-6e5d-4a95-a24f-0df4a15e993d {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:43:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-1eb30f63-27df-4d18-96b3-e36527ad59b9 req-018a9c96-3697-4f15-b06d-29e5e7ea8dc8 service nova] Acquiring lock "c46f2599-93f8-412e-9918-7ace8a9f19dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:43:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-1eb30f63-27df-4d18-96b3-e36527ad59b9 req-018a9c96-3697-4f15-b06d-29e5e7ea8dc8 service nova] Lock "c46f2599-93f8-412e-9918-7ace8a9f19dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:43:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-1eb30f63-27df-4d18-96b3-e36527ad59b9 req-018a9c96-3697-4f15-b06d-29e5e7ea8dc8 service nova] Lock "c46f2599-93f8-412e-9918-7ace8a9f19dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:43:03 user nova-compute[72418]: DEBUG nova.compute.manager [req-1eb30f63-27df-4d18-96b3-e36527ad59b9 req-018a9c96-3697-4f15-b06d-29e5e7ea8dc8 service nova] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] No waiting events found dispatching network-vif-plugged-6c9676d3-6e5d-4a95-a24f-0df4a15e993d {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:43:03 user nova-compute[72418]: WARNING nova.compute.manager [req-1eb30f63-27df-4d18-96b3-e36527ad59b9 req-018a9c96-3697-4f15-b06d-29e5e7ea8dc8 service nova] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Received unexpected event network-vif-plugged-6c9676d3-6e5d-4a95-a24f-0df4a15e993d for instance with vm_state deleted and task_state None.
Aug 09 18:43:03 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:43:03 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:43:04 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:43:04 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Starting heal instance info cache {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 18:43:05 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "refresh_cache-4e1a095f-a2e7-4ab6-bb7e-38cda890d567" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:43:05 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquired lock "refresh_cache-4e1a095f-a2e7-4ab6-bb7e-38cda890d567" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:43:05 user nova-compute[72418]: DEBUG nova.network.neutron [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Forcefully refreshing network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 18:43:05 user nova-compute[72418]: DEBUG nova.network.neutron [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Updating instance_info_cache with network_info: [{"id": "e6df16f7-7151-450f-bbf8-dc3be066011e", "address": "fa:16:3e:42:1f:2f", "network": {"id": "aa563713-99b7-4830-bbc5-5390076a264d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1029161501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99d09208fba747f29a90f95c5bb5ee4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6df16f7-71", "ovs_interfaceid": "e6df16f7-7151-450f-bbf8-dc3be066011e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:43:05 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Releasing lock "refresh_cache-4e1a095f-a2e7-4ab6-bb7e-38cda890d567" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:43:05 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Updated the network info_cache for instance {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 18:43:05 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:43:06 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:43:07 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:43:08 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:43:09 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:43:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:43:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:43:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:43:09 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Auditing locally available compute resources for user (node: user) {{(pid=72418) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 18:43:10 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:43:10 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:43:10 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:43:10 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:43:10 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:43:10 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:43:10 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:43:10 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:43:10 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f917dfe-409a-474f-9dbb-edbf0eea7871/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:43:10 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-07fd61d8-e98b-465d-8060-c87d534c9e74 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Acquiring lock "4e1a095f-a2e7-4ab6-bb7e-38cda890d567" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:43:10 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-07fd61d8-e98b-465d-8060-c87d534c9e74 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Lock "4e1a095f-a2e7-4ab6-bb7e-38cda890d567" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:43:10 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-07fd61d8-e98b-465d-8060-c87d534c9e74 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Acquiring lock "4e1a095f-a2e7-4ab6-bb7e-38cda890d567-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:43:10 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-07fd61d8-e98b-465d-8060-c87d534c9e74 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Lock "4e1a095f-a2e7-4ab6-bb7e-38cda890d567-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:43:10 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-07fd61d8-e98b-465d-8060-c87d534c9e74 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Lock "4e1a095f-a2e7-4ab6-bb7e-38cda890d567-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:43:10 user nova-compute[72418]: INFO nova.compute.manager [None req-07fd61d8-e98b-465d-8060-c87d534c9e74 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Terminating instance
Aug 09 18:43:10 user nova-compute[72418]: DEBUG nova.compute.manager [None req-07fd61d8-e98b-465d-8060-c87d534c9e74 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Start destroying the instance on the hypervisor. {{(pid=72418) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 18:43:10 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f917dfe-409a-474f-9dbb-edbf0eea7871/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:43:10 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f917dfe-409a-474f-9dbb-edbf0eea7871/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:43:10 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:43:10 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:43:10 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:43:10 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f917dfe-409a-474f-9dbb-edbf0eea7871/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:43:11 user nova-compute[72418]: DEBUG nova.compute.manager [req-fedfeec1-2dcd-47c4-9e3a-27c121b8e7a6 req-78bac2fc-46af-4956-b71f-967522aa02e9 service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Received event network-vif-unplugged-e6df16f7-7151-450f-bbf8-dc3be066011e {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:43:11 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-fedfeec1-2dcd-47c4-9e3a-27c121b8e7a6 req-78bac2fc-46af-4956-b71f-967522aa02e9 service nova] Acquiring lock "4e1a095f-a2e7-4ab6-bb7e-38cda890d567-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:43:11 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-fedfeec1-2dcd-47c4-9e3a-27c121b8e7a6 req-78bac2fc-46af-4956-b71f-967522aa02e9 service nova] Lock "4e1a095f-a2e7-4ab6-bb7e-38cda890d567-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:43:11 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-fedfeec1-2dcd-47c4-9e3a-27c121b8e7a6 req-78bac2fc-46af-4956-b71f-967522aa02e9 service nova] Lock "4e1a095f-a2e7-4ab6-bb7e-38cda890d567-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:43:11 user nova-compute[72418]: DEBUG nova.compute.manager [req-fedfeec1-2dcd-47c4-9e3a-27c121b8e7a6 req-78bac2fc-46af-4956-b71f-967522aa02e9 service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] No waiting events found dispatching network-vif-unplugged-e6df16f7-7151-450f-bbf8-dc3be066011e {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:43:11 user nova-compute[72418]: DEBUG nova.compute.manager [req-fedfeec1-2dcd-47c4-9e3a-27c121b8e7a6 req-78bac2fc-46af-4956-b71f-967522aa02e9 service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Received event network-vif-unplugged-e6df16f7-7151-450f-bbf8-dc3be066011e for instance with task_state deleting. {{(pid=72418) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 18:43:11 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:43:11 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:43:11 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Hypervisor/Node resource view: name=user free_ram=8255MB free_disk=25.418621063232422GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72418) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 18:43:11 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:43:11 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:43:11 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Instance destroyed successfully.
Aug 09 18:43:11 user nova-compute[72418]: DEBUG nova.objects.instance [None req-07fd61d8-e98b-465d-8060-c87d534c9e74 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Lazy-loading 'resources' on Instance uuid 4e1a095f-a2e7-4ab6-bb7e-38cda890d567 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:43:11 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-07fd61d8-e98b-465d-8060-c87d534c9e74 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:35:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-282255292',display_name='tempest-ServerStableDeviceRescueTest-server-282255292',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-282255292',id=32,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgi7F7Tiv948MGw/JMyBSz5f1UT2yZOhFMKoN0Kxyc1NKE7bns5u1xaa+LItbZrpXzqSR4y26XuN7XvDcLQtVjZPLJIQgwHu1xdN7N2Gz0+VfLK4SeEyvDU0D1TyNj8Uw==',key_name='tempest-keypair-376055827',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:40:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='99d09208fba747f29a90f95c5bb5ee4b',ramdisk_id='',reservation_id='r-10tk9714',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-307010011',owner_user_name='tempest-ServerStableDeviceRescueTest-307010011-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T18:41:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ec7129a7bf6444ab241ca8dc20211fd',uuid=4e1a095f-a2e7-4ab6-bb7e-38cda890d567,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6df16f7-7151-450f-bbf8-dc3be066011e", "address": "fa:16:3e:42:1f:2f", "network": {"id": "aa563713-99b7-4830-bbc5-5390076a264d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1029161501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99d09208fba747f29a90f95c5bb5ee4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6df16f7-71", "ovs_interfaceid": "e6df16f7-7151-450f-bbf8-dc3be066011e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 18:43:11 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-07fd61d8-e98b-465d-8060-c87d534c9e74 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Converting VIF {"id": "e6df16f7-7151-450f-bbf8-dc3be066011e", "address": "fa:16:3e:42:1f:2f", "network": {"id": "aa563713-99b7-4830-bbc5-5390076a264d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1029161501-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99d09208fba747f29a90f95c5bb5ee4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6df16f7-71", "ovs_interfaceid": "e6df16f7-7151-450f-bbf8-dc3be066011e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:43:11 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-07fd61d8-e98b-465d-8060-c87d534c9e74 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:1f:2f,bridge_name='br-int',has_traffic_filtering=True,id=e6df16f7-7151-450f-bbf8-dc3be066011e,network=Network(aa563713-99b7-4830-bbc5-5390076a264d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6df16f7-71') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:43:11 user nova-compute[72418]: DEBUG os_vif [None req-07fd61d8-e98b-465d-8060-c87d534c9e74 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:1f:2f,bridge_name='br-int',has_traffic_filtering=True,id=e6df16f7-7151-450f-bbf8-dc3be066011e,network=Network(aa563713-99b7-4830-bbc5-5390076a264d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6df16f7-71') {{(pid=72418) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 18:43:11 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:43:11 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape6df16f7-71, bridge=br-int, if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:43:11 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:43:11 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:43:11 user nova-compute[72418]: INFO os_vif [None req-07fd61d8-e98b-465d-8060-c87d534c9e74 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:1f:2f,bridge_name='br-int',has_traffic_filtering=True,id=e6df16f7-7151-450f-bbf8-dc3be066011e,network=Network(aa563713-99b7-4830-bbc5-5390076a264d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6df16f7-71')
Aug 09 18:43:11 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-07fd61d8-e98b-465d-8060-c87d534c9e74 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Deleting instance files /opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567_del
Aug 09 18:43:11 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-07fd61d8-e98b-465d-8060-c87d534c9e74 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Deletion of /opt/stack/data/nova/instances/4e1a095f-a2e7-4ab6-bb7e-38cda890d567_del complete
Aug 09 18:43:11 user nova-compute[72418]: INFO nova.compute.manager [None req-07fd61d8-e98b-465d-8060-c87d534c9e74 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Took 1.04 seconds to destroy the instance on the hypervisor.
Aug 09 18:43:11 user nova-compute[72418]: DEBUG oslo.service.loopingcall [None req-07fd61d8-e98b-465d-8060-c87d534c9e74 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72418) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 18:43:11 user nova-compute[72418]: DEBUG nova.compute.manager [-] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Deallocating network for instance {{(pid=72418) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 18:43:11 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] deallocate_for_instance() {{(pid=72418) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 18:43:11 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 4e1a095f-a2e7-4ab6-bb7e-38cda890d567 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:43:11 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 0f917dfe-409a-474f-9dbb-edbf0eea7871 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:43:11 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:43:11 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 18:43:11 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 18:43:11 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Refreshing inventories for resource provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 18:43:11 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Updating ProviderTree inventory for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 18:43:11 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Updating inventory in ProviderTree for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 18:43:11 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Refreshing aggregate associations for resource provider 50628e48-0a01-4c3f-9ff5-2a66453cd194, aggregates: None {{(pid=72418) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 18:43:11 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Refreshing trait associations for resource provider 50628e48-0a01-4c3f-9ff5-2a66453cd194, traits: HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=72418) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 18:43:12 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:43:12 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:43:12 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Compute_service record updated for user:user {{(pid=72418) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 18:43:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.486s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:43:12 user nova-compute[72418]: DEBUG nova.network.neutron [-] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:43:12 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Took 0.90 seconds to deallocate network for instance.
Aug 09 18:43:12 user nova-compute[72418]: DEBUG nova.compute.manager [req-c1c07e48-55e0-441d-a7b1-48ffb4f7fa88 req-89061151-bd5f-4ed2-911e-feb2b90feeac service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Received event network-vif-deleted-e6df16f7-7151-450f-bbf8-dc3be066011e {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:43:12 user nova-compute[72418]: INFO nova.compute.manager [req-c1c07e48-55e0-441d-a7b1-48ffb4f7fa88 req-89061151-bd5f-4ed2-911e-feb2b90feeac service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Neutron deleted interface e6df16f7-7151-450f-bbf8-dc3be066011e; detaching it from the instance and deleting it from the info cache
Aug 09 18:43:12 user nova-compute[72418]: DEBUG nova.network.neutron [req-c1c07e48-55e0-441d-a7b1-48ffb4f7fa88 req-89061151-bd5f-4ed2-911e-feb2b90feeac service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Updating instance_info_cache with network_info: [] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:43:12 user nova-compute[72418]: DEBUG nova.compute.manager [req-c1c07e48-55e0-441d-a7b1-48ffb4f7fa88 req-89061151-bd5f-4ed2-911e-feb2b90feeac service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Detach interface failed, port_id=e6df16f7-7151-450f-bbf8-dc3be066011e, reason: Instance 4e1a095f-a2e7-4ab6-bb7e-38cda890d567 could not be found. {{(pid=72418) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 18:43:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-07fd61d8-e98b-465d-8060-c87d534c9e74 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:43:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-07fd61d8-e98b-465d-8060-c87d534c9e74 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:43:12 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-07fd61d8-e98b-465d-8060-c87d534c9e74 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:43:12 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-07fd61d8-e98b-465d-8060-c87d534c9e74 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:43:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-07fd61d8-e98b-465d-8060-c87d534c9e74 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.154s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:43:12 user nova-compute[72418]: INFO nova.scheduler.client.report [None req-07fd61d8-e98b-465d-8060-c87d534c9e74 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Deleted allocations for instance 4e1a095f-a2e7-4ab6-bb7e-38cda890d567
Aug 09 18:43:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-07fd61d8-e98b-465d-8060-c87d534c9e74 tempest-ServerStableDeviceRescueTest-307010011 tempest-ServerStableDeviceRescueTest-307010011-project-member] Lock "4e1a095f-a2e7-4ab6-bb7e-38cda890d567" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.278s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:43:13 user nova-compute[72418]: DEBUG nova.compute.manager [req-53ace9d0-bfa0-45e4-bf04-41a023a1bac3 req-36207766-23da-458a-ab63-5f85a9956b51 service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Received event network-vif-plugged-e6df16f7-7151-450f-bbf8-dc3be066011e {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:43:13 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-53ace9d0-bfa0-45e4-bf04-41a023a1bac3 req-36207766-23da-458a-ab63-5f85a9956b51 service nova] Acquiring lock "4e1a095f-a2e7-4ab6-bb7e-38cda890d567-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:43:13 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-53ace9d0-bfa0-45e4-bf04-41a023a1bac3 req-36207766-23da-458a-ab63-5f85a9956b51 service nova] Lock "4e1a095f-a2e7-4ab6-bb7e-38cda890d567-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:43:13 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-53ace9d0-bfa0-45e4-bf04-41a023a1bac3 req-36207766-23da-458a-ab63-5f85a9956b51 service nova] Lock "4e1a095f-a2e7-4ab6-bb7e-38cda890d567-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:43:13 user nova-compute[72418]: DEBUG nova.compute.manager [req-53ace9d0-bfa0-45e4-bf04-41a023a1bac3 req-36207766-23da-458a-ab63-5f85a9956b51 service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] No waiting events found dispatching network-vif-plugged-e6df16f7-7151-450f-bbf8-dc3be066011e {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:43:13 user nova-compute[72418]: WARNING nova.compute.manager [req-53ace9d0-bfa0-45e4-bf04-41a023a1bac3 req-36207766-23da-458a-ab63-5f85a9956b51 service nova] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Received unexpected event network-vif-plugged-e6df16f7-7151-450f-bbf8-dc3be066011e for instance with vm_state deleted and task_state None.
Aug 09 18:43:13 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:43:15 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:43:15 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Cleaning up deleted instances {{(pid=72418) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 18:43:15 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] There are 0 instances to clean {{(pid=72418) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 18:43:16 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:43:16 user nova-compute[72418]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691606581.7611306, c46f2599-93f8-412e-9918-7ace8a9f19dd => Stopped> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:43:16 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] VM Stopped (Lifecycle Event)
Aug 09 18:43:16 user nova-compute[72418]: DEBUG nova.compute.manager [None req-605d86b1-8c8b-458d-9665-4166df57a75d None None] [instance: c46f2599-93f8-412e-9918-7ace8a9f19dd] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:43:18 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:43:21 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:43:23 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:43:26 user nova-compute[72418]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691606591.4705987, 4e1a095f-a2e7-4ab6-bb7e-38cda890d567 => Stopped> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:43:26 user nova-compute[72418]: INFO nova.compute.manager [-] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] VM Stopped (Lifecycle Event)
Aug 09 18:43:26 user nova-compute[72418]: DEBUG nova.compute.manager [None req-22b72716-b718-4591-8c4f-d373cda1dbf2 None None] [instance: 4e1a095f-a2e7-4ab6-bb7e-38cda890d567] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:43:26 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:43:31 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:43:36 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:43:41 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:43:46 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:43:51 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:43:51 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:43:53 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Acquiring lock "2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:43:53 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Lock "2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:43:53 user nova-compute[72418]: INFO nova.compute.manager [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Unshelving
Aug 09 18:43:53 user nova-compute[72418]: INFO nova.virt.block_device [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Booting with volume a9bc0826-cec0-488c-867c-a19085b5cb4d at /dev/vdc
Aug 09 18:43:53 user nova-compute[72418]: DEBUG os_brick.utils [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:43:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:43:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:43:53 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4078be9-68f9-4c48-9933-3f568e7c19fa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ad56b243ad71\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:43:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:43:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:43:53 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[e119e25a-dcfa-4b8b-889c-67e6f06a7438]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:43:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:43:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:43:53 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[521b7776-5b28-4d93-98aa-4196a042ca37]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:43:53 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[704d3dbc-9d39-44be-b014-da0e31ff1308]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:43:53 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Running cmd (subprocess): nvme version {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:43:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] 'nvme version' failed. Not Retrying. {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:43:54 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] nvme not present on system {{(pid=72418) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 18:43:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:43:54 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:43:54 user nova-compute[72418]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 18:43:54 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c07299-6325-4d3d-8894-c8cc73556f67]: (4, '') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:43:54 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72418) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 18:43:54 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 18:43:54 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] LIGHTOS: no hostnqn found. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 18:43:54 user nova-compute[72418]: DEBUG os_brick.utils [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ad56b243ad71', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:43:54 user nova-compute[72418]: DEBUG nova.virt.block_device [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Updating existing volume attachment record: 9d88ea38-b8ea-455e-aef8-6bd71c499045 {{(pid=72418) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 18:43:55 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:43:56 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:44:01 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:44:01 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:44:01 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:44:01 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:44:01 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72418) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 18:44:02 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:44:02 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:44:02 user nova-compute[72418]: DEBUG nova.objects.instance [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Lazy-loading 'pci_requests' on Instance uuid 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:44:02 user nova-compute[72418]: DEBUG nova.objects.instance [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Lazy-loading 'numa_topology' on Instance uuid 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:44:02 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72418) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 18:44:02 user nova-compute[72418]: INFO nova.compute.claims [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Claim successful on node user
Aug 09 18:44:02 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:44:02 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:44:02 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.270s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:44:02 user nova-compute[72418]: INFO nova.network.neutron [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Updating port 2caa8c0b-8aea-4f61-9e3a-0728beb92ff1 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 09 18:44:03 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:44:03 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:44:04 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Acquiring lock "refresh_cache-2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:44:04 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Acquired lock "refresh_cache-2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:44:04 user nova-compute[72418]: DEBUG nova.network.neutron [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:44:04 user nova-compute[72418]: DEBUG nova.compute.manager [req-4a323fd0-80fa-4ea0-b072-6d7ca0f4c409 req-33736e1a-9e5f-4c05-81c0-175a46b28184 service nova] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Received event network-changed-2caa8c0b-8aea-4f61-9e3a-0728beb92ff1 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:44:04 user nova-compute[72418]: DEBUG nova.compute.manager [req-4a323fd0-80fa-4ea0-b072-6d7ca0f4c409 req-33736e1a-9e5f-4c05-81c0-175a46b28184 service nova] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Refreshing instance network info cache due to event network-changed-2caa8c0b-8aea-4f61-9e3a-0728beb92ff1. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:44:04 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-4a323fd0-80fa-4ea0-b072-6d7ca0f4c409 req-33736e1a-9e5f-4c05-81c0-175a46b28184 service nova] Acquiring lock "refresh_cache-2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:44:04 user nova-compute[72418]: DEBUG nova.network.neutron [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Updating instance_info_cache with network_info: [{"id": "2caa8c0b-8aea-4f61-9e3a-0728beb92ff1", "address": "fa:16:3e:96:4c:20", "network": {"id": "ea44ae8b-622b-48d7-8a2b-52c482edf74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1686271510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9ba244a629475189a823dd40c4afb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2caa8c0b-8a", "ovs_interfaceid": "2caa8c0b-8aea-4f61-9e3a-0728beb92ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:44:04 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Releasing lock "refresh_cache-2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:44:04 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Creating instance directory {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 18:44:04 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Creating image(s)
Aug 09 18:44:04 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Acquiring lock "/opt/stack/data/nova/instances/2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:44:04 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Lock "/opt/stack/data/nova/instances/2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:44:04 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Lock "/opt/stack/data/nova/instances/2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:44:04 user nova-compute[72418]: DEBUG nova.objects.instance [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:44:04 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-4a323fd0-80fa-4ea0-b072-6d7ca0f4c409 req-33736e1a-9e5f-4c05-81c0-175a46b28184 service nova] Acquired lock "refresh_cache-2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:44:04 user nova-compute[72418]: DEBUG nova.network.neutron [req-4a323fd0-80fa-4ea0-b072-6d7ca0f4c409 req-33736e1a-9e5f-4c05-81c0-175a46b28184 service nova] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Refreshing network info cache for port 2caa8c0b-8aea-4f61-9e3a-0728beb92ff1 {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:44:04 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Acquiring lock "bc6663bcaf344e2388147e50952830e88d10e2d3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:44:04 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Lock "bc6663bcaf344e2388147e50952830e88d10e2d3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:44:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc6663bcaf344e2388147e50952830e88d10e2d3.part --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:06 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:44:06 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:44:06 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Starting heal instance info cache {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 18:44:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "refresh_cache-2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:44:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc6663bcaf344e2388147e50952830e88d10e2d3.part --force-share --output=json" returned: 0 in 0.147s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:06 user nova-compute[72418]: DEBUG nova.virt.images [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] e8cbb842-e8e3-4b72-9fca-5bae10945d60 was qcow2, converting to raw {{(pid=72418) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 18:44:06 user nova-compute[72418]: DEBUG nova.privsep.utils [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72418) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 18:44:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bc6663bcaf344e2388147e50952830e88d10e2d3.part /opt/stack/data/nova/instances/_base/bc6663bcaf344e2388147e50952830e88d10e2d3.converted {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:06 user nova-compute[72418]: DEBUG nova.network.neutron [req-4a323fd0-80fa-4ea0-b072-6d7ca0f4c409 req-33736e1a-9e5f-4c05-81c0-175a46b28184 service nova] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Updated VIF entry in instance network info cache for port 2caa8c0b-8aea-4f61-9e3a-0728beb92ff1. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:44:06 user nova-compute[72418]: DEBUG nova.network.neutron [req-4a323fd0-80fa-4ea0-b072-6d7ca0f4c409 req-33736e1a-9e5f-4c05-81c0-175a46b28184 service nova] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Updating instance_info_cache with network_info: [{"id": "2caa8c0b-8aea-4f61-9e3a-0728beb92ff1", "address": "fa:16:3e:96:4c:20", "network": {"id": "ea44ae8b-622b-48d7-8a2b-52c482edf74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1686271510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9ba244a629475189a823dd40c4afb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2caa8c0b-8a", "ovs_interfaceid": "2caa8c0b-8aea-4f61-9e3a-0728beb92ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:44:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-4a323fd0-80fa-4ea0-b072-6d7ca0f4c409 req-33736e1a-9e5f-4c05-81c0-175a46b28184 service nova] Releasing lock "refresh_cache-2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:44:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquired lock "refresh_cache-2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:44:06 user nova-compute[72418]: DEBUG nova.network.neutron [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Forcefully refreshing network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 18:44:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bc6663bcaf344e2388147e50952830e88d10e2d3.part /opt/stack/data/nova/instances/_base/bc6663bcaf344e2388147e50952830e88d10e2d3.converted" returned: 0 in 0.427s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc6663bcaf344e2388147e50952830e88d10e2d3.converted --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:06 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:44:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc6663bcaf344e2388147e50952830e88d10e2d3.converted --force-share --output=json" returned: 0 in 0.141s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Lock "bc6663bcaf344e2388147e50952830e88d10e2d3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.003s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:44:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc6663bcaf344e2388147e50952830e88d10e2d3 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc6663bcaf344e2388147e50952830e88d10e2d3 --force-share --output=json" returned: 0 in 0.137s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Acquiring lock "bc6663bcaf344e2388147e50952830e88d10e2d3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:44:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Lock "bc6663bcaf344e2388147e50952830e88d10e2d3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:44:06 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc6663bcaf344e2388147e50952830e88d10e2d3 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc6663bcaf344e2388147e50952830e88d10e2d3 --force-share --output=json" returned: 0 in 0.141s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bc6663bcaf344e2388147e50952830e88d10e2d3,backing_fmt=raw /opt/stack/data/nova/instances/2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c/disk 1073741824 {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bc6663bcaf344e2388147e50952830e88d10e2d3,backing_fmt=raw /opt/stack/data/nova/instances/2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c/disk 1073741824" returned: 0 in 0.055s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:07 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Lock "bc6663bcaf344e2388147e50952830e88d10e2d3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:44:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc6663bcaf344e2388147e50952830e88d10e2d3 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:07 user nova-compute[72418]: DEBUG nova.network.neutron [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Updating instance_info_cache with network_info: [{"id": "2caa8c0b-8aea-4f61-9e3a-0728beb92ff1", "address": "fa:16:3e:96:4c:20", "network": {"id": "ea44ae8b-622b-48d7-8a2b-52c482edf74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1686271510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9ba244a629475189a823dd40c4afb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2caa8c0b-8a", "ovs_interfaceid": "2caa8c0b-8aea-4f61-9e3a-0728beb92ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:44:07 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Releasing lock "refresh_cache-2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:44:07 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Updated the network info_cache for instance {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 18:44:07 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:44:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc6663bcaf344e2388147e50952830e88d10e2d3 --force-share --output=json" returned: 0 in 0.169s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:07 user nova-compute[72418]: DEBUG nova.objects.instance [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Lazy-loading 'migration_context' on Instance uuid 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:44:07 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Rebasing disk image.
Aug 09 18:44:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.140s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 -F raw /opt/stack/data/nova/instances/2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c/disk {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:07 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:44:09 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 -F raw /opt/stack/data/nova/instances/2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c/disk" returned: 0 in 2.278s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:09 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Created local disks {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 18:44:09 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Ensure instance console log exists: /opt/stack/data/nova/instances/2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c/console.log {{(pid=72418) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 18:44:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:44:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:44:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:44:09 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Start _get_guest_xml network_info=[{"id": "2caa8c0b-8aea-4f61-9e3a-0728beb92ff1", "address": "fa:16:3e:96:4c:20", "network": {"id": "ea44ae8b-622b-48d7-8a2b-52c482edf74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1686271510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9ba244a629475189a823dd40c4afb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2caa8c0b-8a", "ovs_interfaceid": "2caa8c0b-8aea-4f61-9e3a-0728beb92ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='58723a9db9bb63f9966afc82f12d1d01',container_format='bare',created_at=2023-08-09T18:42:01Z,direct_url=<?>,disk_format='qcow2',id=e8cbb842-e8e3-4b72-9fca-5bae10945d60,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1804567865-shelved',owner='2d9ba244a629475189a823dd40c4afb9',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-09T18:42:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdc', 'attachment_id': '9d88ea38-b8ea-455e-aef8-6bd71c499045', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SCAjxtsi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c', 'attached_at': '', 'detached_at': '', 'volume_id': 'a9bc0826-cec0-488c-867c-a19085b5cb4d', 'serial': 'a9bc0826-cec0-488c-867c-a19085b5cb4d'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'volume_type': None} {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 18:44:09 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:44:09 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:44:09 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 18:44:09 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] CPU controller missing on host. {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 18:44:09 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 18:44:09 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] CPU controller found on host. {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 18:44:09 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72418) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 18:44:09 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T18:17:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='58723a9db9bb63f9966afc82f12d1d01',container_format='bare',created_at=2023-08-09T18:42:01Z,direct_url=<?>,disk_format='qcow2',id=e8cbb842-e8e3-4b72-9fca-5bae10945d60,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1804567865-shelved',owner='2d9ba244a629475189a823dd40c4afb9',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-09T18:42:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 18:44:09 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Flavor limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 18:44:09 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Image limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 18:44:09 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Flavor pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 18:44:09 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Image pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 18:44:09 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 18:44:09 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 18:44:09 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 18:44:09 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Got 1 possible topologies {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 18:44:09 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 18:44:09 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 18:44:09 user nova-compute[72418]: DEBUG nova.objects.instance [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:44:09 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Calling os-brick to attach iSCSI Volume {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 18:44:09 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SCAjxtsi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:44:09 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:44:09 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:44:09 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:44:09 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:44:09 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:44:09 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:44:09 user nova-compute[72418]: INFO os_brick.initiator.connectors.iscsi [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 18:44:09 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d -p 172.16.0.220:3260 {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:09 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:09 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[746fc4b3-c117-4f78-8429-909788376c25]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:44:09 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 18:44:09 user nova-compute[72418]:  {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:44:09 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d -p 172.16.0.220:3260 --interface default --op new {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:09 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:09 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[b186b2f0-5f79-461a-ae24-fec13d61fc82]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d] added\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:44:09 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d] added
Aug 09 18:44:09 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:44:09 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:09 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:09 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a095fd-9e4f-4ec7-8184-63b3274eb9af]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:44:09 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:44:09 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:09 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:09 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[008c51b7-9213-4d14-8e78-7a8d00fdcd25]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:44:09 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:44:09 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SCAjxtsi {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:10 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SCAjxtsi" returned: 0 in 0.029s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:10 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8346a0-41c5-4d25-ba29-a7d1e551ad25]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:44:10 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SCAjxtsi'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:44:10 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:10 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:10 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21010c1-8200-4233-a4cb-bfe94e9afe0f]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:44:10 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:44:10 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:10 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:44:10 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.029s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:10 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[7699d7e4-f4d9-49c7-92e3-44132e89a1a0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:44:10 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 18:44:10 user nova-compute[72418]:  {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:44:10 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 18:44:10 user nova-compute[72418]:  {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:44:10 user nova-compute[72418]: WARNING os_brick.initiator.connectors.iscsi [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 18:44:10 user nova-compute[72418]: 
Aug 09 18:44:10 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d -p 172.16.0.220:3260 --login {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:10 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:10 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3dbeda-ea5c-4b79-b893-68ea1a62bd39]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:44:10 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d, portal: 172.16.0.220,3260]
Aug 09 18:44:10 user nova-compute[72418]: Login to [iface: default, target: iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d, portal: 172.16.0.220,3260] successful.
Aug 09 18:44:10 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:44:10 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:10 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:10 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[2253e659-f613-4ea1-bf37-ba97d3aa8ecc]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:44:10 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:44:10 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:10 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:10 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9815c3-b9be-43af-9e95-ddb1121cb4e8]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:44:10 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d (non-flash)
Aug 09 18:44:10 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:44:10 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d (non-flash)
Aug 09 18:44:10 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:44:10 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.356s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:44:10 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Connected to 172.16.0.220:3260 {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 18:44:10 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] HCTL ('33', '-', '-', 0) found on session 40 with lun 0 {{(pid=72418) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 18:44:10 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72418) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 18:44:10 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:10 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.033s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:10 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[0251ead9-8373-40f2-b8c4-2d34ed6a2b13]: (4, ('- - 0', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:44:10 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72418) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 18:44:10 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SCAjxtsi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 18:44:11 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.438s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:44:11 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] <== connect_volume: return (1439ms) {'type': 'block', 'scsi_wwn': '23339343665626564', 'path': '/dev/sdb'} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:44:11 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23339343665626564', 'path': '/dev/sdb'} {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 18:44:11 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T18:40:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1804567865',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1804567865',id=33,image_ref='e8cbb842-e8e3-4b72-9fca-5bae10945d60',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-885533390',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:40:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2d9ba244a629475189a823dd40c4afb9',ramdisk_id='',reservation_id='r-hlq30p7b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-531665400',owner_user_name='tempest-AttachVolumeShelveTestJSON-531665400-project-member',shelved_at='2023-08-09T18:42:05.882937',shelved_host='user',shelved_image_id='e8cbb842-e8e3-4b72-9fca-5bae10945d60'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:43:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8908bf793844843a5f5953d5d5569c9',uuid=2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "2caa8c0b-8aea-4f61-9e3a-0728beb92ff1", "address": "fa:16:3e:96:4c:20", "network": {"id": "ea44ae8b-622b-48d7-8a2b-52c482edf74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1686271510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9ba244a629475189a823dd40c4afb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2caa8c0b-8a", "ovs_interfaceid": "2caa8c0b-8aea-4f61-9e3a-0728beb92ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:44:11 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Converting VIF {"id": "2caa8c0b-8aea-4f61-9e3a-0728beb92ff1", "address": "fa:16:3e:96:4c:20", "network": {"id": "ea44ae8b-622b-48d7-8a2b-52c482edf74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1686271510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9ba244a629475189a823dd40c4afb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2caa8c0b-8a", "ovs_interfaceid": "2caa8c0b-8aea-4f61-9e3a-0728beb92ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:44:11 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:4c:20,bridge_name='br-int',has_traffic_filtering=True,id=2caa8c0b-8aea-4f61-9e3a-0728beb92ff1,network=Network(ea44ae8b-622b-48d7-8a2b-52c482edf74a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2caa8c0b-8a') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:44:11 user nova-compute[72418]: DEBUG nova.objects.instance [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Lazy-loading 'pci_devices' on Instance uuid 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:44:11 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] End _get_guest_xml xml=<domain type="kvm">
Aug 09 18:44:11 user nova-compute[72418]:   <uuid>2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c</uuid>
Aug 09 18:44:11 user nova-compute[72418]:   <name>instance-00000021</name>
Aug 09 18:44:11 user nova-compute[72418]:   <memory>524288</memory>
Aug 09 18:44:11 user nova-compute[72418]:   <vcpu>1</vcpu>
Aug 09 18:44:11 user nova-compute[72418]:   <metadata>
Aug 09 18:44:11 user nova-compute[72418]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:44:11 user nova-compute[72418]:       <nova:package version="0.0.0"/>
Aug 09 18:44:11 user nova-compute[72418]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1804567865</nova:name>
Aug 09 18:44:11 user nova-compute[72418]:       <nova:creationTime>2023-08-09 18:44:09</nova:creationTime>
Aug 09 18:44:11 user nova-compute[72418]:       <nova:flavor name="m1.tiny">
Aug 09 18:44:11 user nova-compute[72418]:         <nova:memory>512</nova:memory>
Aug 09 18:44:11 user nova-compute[72418]:         <nova:disk>1</nova:disk>
Aug 09 18:44:11 user nova-compute[72418]:         <nova:swap>0</nova:swap>
Aug 09 18:44:11 user nova-compute[72418]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:44:11 user nova-compute[72418]:         <nova:vcpus>1</nova:vcpus>
Aug 09 18:44:11 user nova-compute[72418]:       </nova:flavor>
Aug 09 18:44:11 user nova-compute[72418]:       <nova:owner>
Aug 09 18:44:11 user nova-compute[72418]:         <nova:user uuid="f8908bf793844843a5f5953d5d5569c9">tempest-AttachVolumeShelveTestJSON-531665400-project-member</nova:user>
Aug 09 18:44:11 user nova-compute[72418]:         <nova:project uuid="2d9ba244a629475189a823dd40c4afb9">tempest-AttachVolumeShelveTestJSON-531665400</nova:project>
Aug 09 18:44:11 user nova-compute[72418]:       </nova:owner>
Aug 09 18:44:11 user nova-compute[72418]:       <nova:root type="image" uuid="e8cbb842-e8e3-4b72-9fca-5bae10945d60"/>
Aug 09 18:44:11 user nova-compute[72418]:       <nova:ports>
Aug 09 18:44:11 user nova-compute[72418]:         <nova:port uuid="2caa8c0b-8aea-4f61-9e3a-0728beb92ff1">
Aug 09 18:44:11 user nova-compute[72418]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 09 18:44:11 user nova-compute[72418]:         </nova:port>
Aug 09 18:44:11 user nova-compute[72418]:       </nova:ports>
Aug 09 18:44:11 user nova-compute[72418]:     </nova:instance>
Aug 09 18:44:11 user nova-compute[72418]:   </metadata>
Aug 09 18:44:11 user nova-compute[72418]:   <sysinfo type="smbios">
Aug 09 18:44:11 user nova-compute[72418]:     <system>
Aug 09 18:44:11 user nova-compute[72418]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 18:44:11 user nova-compute[72418]:       <entry name="product">OpenStack Nova</entry>
Aug 09 18:44:11 user nova-compute[72418]:       <entry name="version">0.0.0</entry>
Aug 09 18:44:11 user nova-compute[72418]:       <entry name="serial">2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c</entry>
Aug 09 18:44:11 user nova-compute[72418]:       <entry name="uuid">2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c</entry>
Aug 09 18:44:11 user nova-compute[72418]:       <entry name="family">Virtual Machine</entry>
Aug 09 18:44:11 user nova-compute[72418]:     </system>
Aug 09 18:44:11 user nova-compute[72418]:   </sysinfo>
Aug 09 18:44:11 user nova-compute[72418]:   <os>
Aug 09 18:44:11 user nova-compute[72418]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 18:44:11 user nova-compute[72418]:     <boot dev="hd"/>
Aug 09 18:44:11 user nova-compute[72418]:     <smbios mode="sysinfo"/>
Aug 09 18:44:11 user nova-compute[72418]:   </os>
Aug 09 18:44:11 user nova-compute[72418]:   <features>
Aug 09 18:44:11 user nova-compute[72418]:     <acpi/>
Aug 09 18:44:11 user nova-compute[72418]:     <apic/>
Aug 09 18:44:11 user nova-compute[72418]:     <vmcoreinfo/>
Aug 09 18:44:11 user nova-compute[72418]:   </features>
Aug 09 18:44:11 user nova-compute[72418]:   <clock offset="utc">
Aug 09 18:44:11 user nova-compute[72418]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 18:44:11 user nova-compute[72418]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 18:44:11 user nova-compute[72418]:     <timer name="hpet" present="no"/>
Aug 09 18:44:11 user nova-compute[72418]:   </clock>
Aug 09 18:44:11 user nova-compute[72418]:   <cpu mode="custom" match="exact">
Aug 09 18:44:11 user nova-compute[72418]:     <model>Nehalem</model>
Aug 09 18:44:11 user nova-compute[72418]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 18:44:11 user nova-compute[72418]:   </cpu>
Aug 09 18:44:11 user nova-compute[72418]:   <devices>
Aug 09 18:44:11 user nova-compute[72418]:     <disk type="file" device="disk">
Aug 09 18:44:11 user nova-compute[72418]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 18:44:11 user nova-compute[72418]:       <source file="/opt/stack/data/nova/instances/2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c/disk"/>
Aug 09 18:44:11 user nova-compute[72418]:       <target dev="vda" bus="virtio"/>
Aug 09 18:44:11 user nova-compute[72418]:     </disk>
Aug 09 18:44:11 user nova-compute[72418]:     <disk type="block" device="disk">
Aug 09 18:44:11 user nova-compute[72418]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:44:11 user nova-compute[72418]:       <source dev="/dev/sdb"/>
Aug 09 18:44:11 user nova-compute[72418]:       <target dev="vdc" bus="virtio"/>
Aug 09 18:44:11 user nova-compute[72418]:       <serial>a9bc0826-cec0-488c-867c-a19085b5cb4d</serial>
Aug 09 18:44:11 user nova-compute[72418]:     </disk>
Aug 09 18:44:11 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:44:11 user nova-compute[72418]:       <mac address="fa:16:3e:96:4c:20"/>
Aug 09 18:44:11 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:44:11 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:44:11 user nova-compute[72418]:       <target dev="tap2caa8c0b-8a"/>
Aug 09 18:44:11 user nova-compute[72418]:     </interface>
Aug 09 18:44:11 user nova-compute[72418]:     <serial type="pty">
Aug 09 18:44:11 user nova-compute[72418]:       <log file="/opt/stack/data/nova/instances/2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c/console.log" append="off"/>
Aug 09 18:44:11 user nova-compute[72418]:     </serial>
Aug 09 18:44:11 user nova-compute[72418]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 18:44:11 user nova-compute[72418]:     <video>
Aug 09 18:44:11 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:44:11 user nova-compute[72418]:     </video>
Aug 09 18:44:11 user nova-compute[72418]:     <rng model="virtio">
Aug 09 18:44:11 user nova-compute[72418]:       <backend model="random">/dev/urandom</backend>
Aug 09 18:44:11 user nova-compute[72418]:     </rng>
Aug 09 18:44:11 user nova-compute[72418]:     <controller type="usb" index="0" model="none"/>
Aug 09 18:44:11 user nova-compute[72418]:     <memballoon model="virtio">
Aug 09 18:44:11 user nova-compute[72418]:       <stats period="10"/>
Aug 09 18:44:11 user nova-compute[72418]:     </memballoon>
Aug 09 18:44:11 user nova-compute[72418]:   </devices>
Aug 09 18:44:11 user nova-compute[72418]: </domain>
Aug 09 18:44:11 user nova-compute[72418]:  {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 18:44:11 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T18:40:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1804567865',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1804567865',id=33,image_ref='e8cbb842-e8e3-4b72-9fca-5bae10945d60',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-885533390',keypairs=<?>,launch_index=0,launched_at=2023-08-09T18:40:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2d9ba244a629475189a823dd40c4afb9',ramdisk_id='',reservation_id='r-hlq30p7b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-531665400',owner_user_name='tempest-AttachVolumeShelveTestJSON-531665400-project-member',shelved_at='2023-08-09T18:42:05.882937',shelved_host='user',shelved_image_id='e8cbb842-e8e3-4b72-9fca-5bae10945d60'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:43:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8908bf793844843a5f5953d5d5569c9',uuid=2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "2caa8c0b-8aea-4f61-9e3a-0728beb92ff1", "address": "fa:16:3e:96:4c:20", "network": {"id": "ea44ae8b-622b-48d7-8a2b-52c482edf74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1686271510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9ba244a629475189a823dd40c4afb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2caa8c0b-8a", "ovs_interfaceid": "2caa8c0b-8aea-4f61-9e3a-0728beb92ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:44:11 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Converting VIF {"id": "2caa8c0b-8aea-4f61-9e3a-0728beb92ff1", "address": "fa:16:3e:96:4c:20", "network": {"id": "ea44ae8b-622b-48d7-8a2b-52c482edf74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1686271510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9ba244a629475189a823dd40c4afb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2caa8c0b-8a", "ovs_interfaceid": "2caa8c0b-8aea-4f61-9e3a-0728beb92ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:44:11 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:4c:20,bridge_name='br-int',has_traffic_filtering=True,id=2caa8c0b-8aea-4f61-9e3a-0728beb92ff1,network=Network(ea44ae8b-622b-48d7-8a2b-52c482edf74a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2caa8c0b-8a') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:44:11 user nova-compute[72418]: DEBUG os_vif [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:4c:20,bridge_name='br-int',has_traffic_filtering=True,id=2caa8c0b-8aea-4f61-9e3a-0728beb92ff1,network=Network(ea44ae8b-622b-48d7-8a2b-52c482edf74a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2caa8c0b-8a') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:44:11 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:44:11 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:44:11 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:44:11 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:44:11 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2caa8c0b-8a, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:44:11 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2caa8c0b-8a, col_values=(('external_ids', {'iface-id': '2caa8c0b-8aea-4f61-9e3a-0728beb92ff1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:4c:20', 'vm-uuid': '2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:44:11 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:44:11 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:44:11 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:44:11 user nova-compute[72418]: INFO os_vif [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:4c:20,bridge_name='br-int',has_traffic_filtering=True,id=2caa8c0b-8aea-4f61-9e3a-0728beb92ff1,network=Network(ea44ae8b-622b-48d7-8a2b-52c482edf74a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2caa8c0b-8a')
Aug 09 18:44:11 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:44:11 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:44:11 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] No VIF found with MAC fa:16:3e:96:4c:20, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:44:11 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:44:11 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:44:11 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:44:11 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:44:11 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Auditing locally available compute resources for user (node: user) {{(pid=72418) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 18:44:12 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:44:12 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:44:12 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:44:13 user nova-compute[72418]: DEBUG nova.compute.manager [req-6999cac9-62a8-4c62-9f49-4117adb1bdca req-e258f292-ad7b-4ed5-8c36-77da126e4ab8 service nova] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Received event network-vif-plugged-2caa8c0b-8aea-4f61-9e3a-0728beb92ff1 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:44:13 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-6999cac9-62a8-4c62-9f49-4117adb1bdca req-e258f292-ad7b-4ed5-8c36-77da126e4ab8 service nova] Acquiring lock "2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:44:13 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-6999cac9-62a8-4c62-9f49-4117adb1bdca req-e258f292-ad7b-4ed5-8c36-77da126e4ab8 service nova] Lock "2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:44:13 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-6999cac9-62a8-4c62-9f49-4117adb1bdca req-e258f292-ad7b-4ed5-8c36-77da126e4ab8 service nova] Lock "2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:44:13 user nova-compute[72418]: DEBUG nova.compute.manager [req-6999cac9-62a8-4c62-9f49-4117adb1bdca req-e258f292-ad7b-4ed5-8c36-77da126e4ab8 service nova] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] No waiting events found dispatching network-vif-plugged-2caa8c0b-8aea-4f61-9e3a-0728beb92ff1 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:44:13 user nova-compute[72418]: WARNING nova.compute.manager [req-6999cac9-62a8-4c62-9f49-4117adb1bdca req-e258f292-ad7b-4ed5-8c36-77da126e4ab8 service nova] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Received unexpected event network-vif-plugged-2caa8c0b-8aea-4f61-9e3a-0728beb92ff1 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 09 18:44:13 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:13 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:44:13 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:44:13 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:44:13 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:13 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:13 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:13 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:13 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:13 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:13 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:13 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:44:13 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f917dfe-409a-474f-9dbb-edbf0eea7871/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:14 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f917dfe-409a-474f-9dbb-edbf0eea7871/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:14 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f917dfe-409a-474f-9dbb-edbf0eea7871/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:14 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f917dfe-409a-474f-9dbb-edbf0eea7871/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:14 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:44:14 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:44:14 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Hypervisor/Node resource view: name=user free_ram=8448MB free_disk=25.415260314941406GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72418) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 18:44:14 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:44:14 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:44:14 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 0f917dfe-409a-474f-9dbb-edbf0eea7871 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:44:14 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:44:14 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (50628e48-0a01-4c3f-9ff5-2a66453cd194): {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. Skipping heal of allocations during the task state transition. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Aug 09 18:44:14 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 18:44:14 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 18:44:15 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:44:15 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:44:15 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Compute_service record updated for user:user {{(pid=72418) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 18:44:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.288s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:44:15 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691606655.121438, 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c => Resumed> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:44:15 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] VM Resumed (Lifecycle Event)
Aug 09 18:44:15 user nova-compute[72418]: DEBUG nova.compute.manager [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Instance event wait completed in 0 seconds for  {{(pid=72418) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 18:44:15 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Guest created on hypervisor {{(pid=72418) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 18:44:15 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Instance spawned successfully.
Aug 09 18:44:15 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:44:15 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:44:15 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:44:15 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691606655.1233644, 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c => Started> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:44:15 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] VM Started (Lifecycle Event)
Aug 09 18:44:15 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:44:15 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:44:15 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:44:15 user nova-compute[72418]: DEBUG nova.compute.manager [req-26c289ac-a685-450d-8f3c-5ef9974737c1 req-1ac85cfd-c748-4016-9113-c0cca124e92f service nova] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Received event network-vif-plugged-2caa8c0b-8aea-4f61-9e3a-0728beb92ff1 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:44:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-26c289ac-a685-450d-8f3c-5ef9974737c1 req-1ac85cfd-c748-4016-9113-c0cca124e92f service nova] Acquiring lock "2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:44:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-26c289ac-a685-450d-8f3c-5ef9974737c1 req-1ac85cfd-c748-4016-9113-c0cca124e92f service nova] Lock "2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:44:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-26c289ac-a685-450d-8f3c-5ef9974737c1 req-1ac85cfd-c748-4016-9113-c0cca124e92f service nova] Lock "2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:44:15 user nova-compute[72418]: DEBUG nova.compute.manager [req-26c289ac-a685-450d-8f3c-5ef9974737c1 req-1ac85cfd-c748-4016-9113-c0cca124e92f service nova] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] No waiting events found dispatching network-vif-plugged-2caa8c0b-8aea-4f61-9e3a-0728beb92ff1 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:44:15 user nova-compute[72418]: WARNING nova.compute.manager [req-26c289ac-a685-450d-8f3c-5ef9974737c1 req-1ac85cfd-c748-4016-9113-c0cca124e92f service nova] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Received unexpected event network-vif-plugged-2caa8c0b-8aea-4f61-9e3a-0728beb92ff1 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 09 18:44:15 user nova-compute[72418]: DEBUG nova.compute.manager [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:44:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-3b238130-453f-43be-b419-236b0be2f61c tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Lock "2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 21.715s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:44:16 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:44:16 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:44:18 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:44:20 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:44:21 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:44:26 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:44:26 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:44:26 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72418) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 18:44:26 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72418) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 18:44:26 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72418) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 18:44:26 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:44:31 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:44:33 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:44:36 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:44:37 user nova-compute[72418]: DEBUG nova.compute.manager [req-837f9df9-2aed-4d89-8ce5-79e8e5e1eac4 req-293d8459-b62b-432d-bb3c-a875ef484070 service nova] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] Received event network-changed-388535bb-a59e-45d2-96a1-faa742a03ebc {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:44:37 user nova-compute[72418]: DEBUG nova.compute.manager [req-837f9df9-2aed-4d89-8ce5-79e8e5e1eac4 req-293d8459-b62b-432d-bb3c-a875ef484070 service nova] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] Refreshing instance network info cache due to event network-changed-388535bb-a59e-45d2-96a1-faa742a03ebc. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:44:37 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-837f9df9-2aed-4d89-8ce5-79e8e5e1eac4 req-293d8459-b62b-432d-bb3c-a875ef484070 service nova] Acquiring lock "refresh_cache-0f917dfe-409a-474f-9dbb-edbf0eea7871" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:44:37 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-837f9df9-2aed-4d89-8ce5-79e8e5e1eac4 req-293d8459-b62b-432d-bb3c-a875ef484070 service nova] Acquired lock "refresh_cache-0f917dfe-409a-474f-9dbb-edbf0eea7871" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:44:37 user nova-compute[72418]: DEBUG nova.network.neutron [req-837f9df9-2aed-4d89-8ce5-79e8e5e1eac4 req-293d8459-b62b-432d-bb3c-a875ef484070 service nova] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] Refreshing network info cache for port 388535bb-a59e-45d2-96a1-faa742a03ebc {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:44:37 user nova-compute[72418]: DEBUG nova.network.neutron [req-837f9df9-2aed-4d89-8ce5-79e8e5e1eac4 req-293d8459-b62b-432d-bb3c-a875ef484070 service nova] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] Updated VIF entry in instance network info cache for port 388535bb-a59e-45d2-96a1-faa742a03ebc. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:44:37 user nova-compute[72418]: DEBUG nova.network.neutron [req-837f9df9-2aed-4d89-8ce5-79e8e5e1eac4 req-293d8459-b62b-432d-bb3c-a875ef484070 service nova] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] Updating instance_info_cache with network_info: [{"id": "388535bb-a59e-45d2-96a1-faa742a03ebc", "address": "fa:16:3e:d9:05:d0", "network": {"id": "c525572b-cf59-4359-88c8-cef227847c3c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2043600619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8456a86110d1420c9107c38dd3fad34f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388535bb-a5", "ovs_interfaceid": "388535bb-a59e-45d2-96a1-faa742a03ebc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:44:37 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-837f9df9-2aed-4d89-8ce5-79e8e5e1eac4 req-293d8459-b62b-432d-bb3c-a875ef484070 service nova] Releasing lock "refresh_cache-0f917dfe-409a-474f-9dbb-edbf0eea7871" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:44:38 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:44:39 user nova-compute[72418]: DEBUG nova.compute.manager [req-98364601-fa3f-477f-b434-a998f76208f0 req-3f3e3ca6-6323-4242-b0d3-a2ddf7e88615 service nova] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Received event network-changed-7b985408-5155-4fef-963e-34a7ce4561ad {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:44:39 user nova-compute[72418]: DEBUG nova.compute.manager [req-98364601-fa3f-477f-b434-a998f76208f0 req-3f3e3ca6-6323-4242-b0d3-a2ddf7e88615 service nova] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Refreshing instance network info cache due to event network-changed-7b985408-5155-4fef-963e-34a7ce4561ad. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:44:39 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-98364601-fa3f-477f-b434-a998f76208f0 req-3f3e3ca6-6323-4242-b0d3-a2ddf7e88615 service nova] Acquiring lock "refresh_cache-a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:44:39 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-98364601-fa3f-477f-b434-a998f76208f0 req-3f3e3ca6-6323-4242-b0d3-a2ddf7e88615 service nova] Acquired lock "refresh_cache-a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:44:39 user nova-compute[72418]: DEBUG nova.network.neutron [req-98364601-fa3f-477f-b434-a998f76208f0 req-3f3e3ca6-6323-4242-b0d3-a2ddf7e88615 service nova] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Refreshing network info cache for port 7b985408-5155-4fef-963e-34a7ce4561ad {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:44:39 user nova-compute[72418]: DEBUG nova.network.neutron [req-98364601-fa3f-477f-b434-a998f76208f0 req-3f3e3ca6-6323-4242-b0d3-a2ddf7e88615 service nova] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Updated VIF entry in instance network info cache for port 7b985408-5155-4fef-963e-34a7ce4561ad. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:44:39 user nova-compute[72418]: DEBUG nova.network.neutron [req-98364601-fa3f-477f-b434-a998f76208f0 req-3f3e3ca6-6323-4242-b0d3-a2ddf7e88615 service nova] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Updating instance_info_cache with network_info: [{"id": "7b985408-5155-4fef-963e-34a7ce4561ad", "address": "fa:16:3e:ae:d6:b4", "network": {"id": "dc901a3f-b5ca-47ad-9f8b-7f3aa30f24b2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-907587267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "877d9f19910d444b8d45c61f9c39bfbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b985408-51", "ovs_interfaceid": "7b985408-5155-4fef-963e-34a7ce4561ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:44:39 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-98364601-fa3f-477f-b434-a998f76208f0 req-3f3e3ca6-6323-4242-b0d3-a2ddf7e88615 service nova] Releasing lock "refresh_cache-a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:44:40 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-66bb613b-b789-4bf6-bce9-4965ebc25ada tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Acquiring lock "0f917dfe-409a-474f-9dbb-edbf0eea7871" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:44:40 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-66bb613b-b789-4bf6-bce9-4965ebc25ada tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Lock "0f917dfe-409a-474f-9dbb-edbf0eea7871" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:44:40 user nova-compute[72418]: DEBUG nova.objects.instance [None req-66bb613b-b789-4bf6-bce9-4965ebc25ada tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Lazy-loading 'flavor' on Instance uuid 0f917dfe-409a-474f-9dbb-edbf0eea7871 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:44:40 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-66bb613b-b789-4bf6-bce9-4965ebc25ada tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Lock "0f917dfe-409a-474f-9dbb-edbf0eea7871" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:44:40 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-57882136-2a91-4423-80c8-d6d24641a7e8 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Acquiring lock "a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:44:40 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-57882136-2a91-4423-80c8-d6d24641a7e8 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Lock "a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:44:40 user nova-compute[72418]: DEBUG nova.objects.instance [None req-57882136-2a91-4423-80c8-d6d24641a7e8 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Lazy-loading 'flavor' on Instance uuid a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:44:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-57882136-2a91-4423-80c8-d6d24641a7e8 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Lock "a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:44:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-66bb613b-b789-4bf6-bce9-4965ebc25ada tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Acquiring lock "0f917dfe-409a-474f-9dbb-edbf0eea7871" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:44:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-66bb613b-b789-4bf6-bce9-4965ebc25ada tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Lock "0f917dfe-409a-474f-9dbb-edbf0eea7871" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:44:41 user nova-compute[72418]: INFO nova.compute.manager [None req-66bb613b-b789-4bf6-bce9-4965ebc25ada tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] Attaching volume 3b89d3fe-0150-48ad-ba71-927d3d2207b5 to /dev/vdb
Aug 09 18:44:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-57882136-2a91-4423-80c8-d6d24641a7e8 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Acquiring lock "a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:44:41 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-57882136-2a91-4423-80c8-d6d24641a7e8 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Lock "a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:44:41 user nova-compute[72418]: INFO nova.compute.manager [None req-57882136-2a91-4423-80c8-d6d24641a7e8 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Attaching volume 82cb9116-9fd0-499b-92ec-0f2b48289768 to /dev/vdb
Aug 09 18:44:41 user nova-compute[72418]: DEBUG os_brick.utils [None req-66bb613b-b789-4bf6-bce9-4965ebc25ada tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:44:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:41 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[214e954b-8383-438e-b35c-9fc9332ad32b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ad56b243ad71\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:44:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:41 user nova-compute[72418]: DEBUG os_brick.utils [None req-57882136-2a91-4423-80c8-d6d24641a7e8 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:44:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:41 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fd8fad-365a-4eae-9a88-12a9a7bb838d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:44:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:41 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dfdac52-0e6e-4090-9d90-643cc9e87232]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ad56b243ad71\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:44:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:41 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec75f89-bf6d-48a0-8905-dc9bebc9ba10]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:44:41 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd6fe33-a8b2-46fe-b61b-2fb9186b9eac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:44:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-66bb613b-b789-4bf6-bce9-4965ebc25ada tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Running cmd (subprocess): nvme version {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-66bb613b-b789-4bf6-bce9-4965ebc25ada tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] 'nvme version' failed. Not Retrying. {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:44:41 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:44:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:41 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb592fa9-3b19-4f05-9df4-dfd8f4ae5b30]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:44:41 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.nvmeof [None req-66bb613b-b789-4bf6-bce9-4965ebc25ada tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] nvme not present on system {{(pid=72418) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 18:44:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:41 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de80826-dde2-4e27-93c3-bee54672bf16]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:44:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:44:41 user nova-compute[72418]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 18:44:41 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce5a6e4-1954-42f7-b8dd-052da2388e58]: (4, '') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:44:41 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[d219678e-99cc-4433-b56a-05ceae56036b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:44:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-57882136-2a91-4423-80c8-d6d24641a7e8 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Running cmd (subprocess): nvme version {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-57882136-2a91-4423-80c8-d6d24641a7e8 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] 'nvme version' failed. Not Retrying. {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:44:41 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-66bb613b-b789-4bf6-bce9-4965ebc25ada tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72418) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 18:44:41 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-66bb613b-b789-4bf6-bce9-4965ebc25ada tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 18:44:41 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-66bb613b-b789-4bf6-bce9-4965ebc25ada tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] LIGHTOS: no hostnqn found. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 18:44:41 user nova-compute[72418]: DEBUG os_brick.utils [None req-66bb613b-b789-4bf6-bce9-4965ebc25ada tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] <== get_connector_properties: return (306ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ad56b243ad71', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:44:41 user nova-compute[72418]: DEBUG nova.virt.block_device [None req-66bb613b-b789-4bf6-bce9-4965ebc25ada tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] Updating existing volume attachment record: d8da5d6b-c765-46bf-a292-d52418f3fa24 {{(pid=72418) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 18:44:41 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.nvmeof [None req-57882136-2a91-4423-80c8-d6d24641a7e8 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] nvme not present on system {{(pid=72418) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 18:44:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:41 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:44:41 user nova-compute[72418]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 18:44:41 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[111e5ded-443d-47a3-ab16-9da69a9f6e44]: (4, '') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:44:41 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-57882136-2a91-4423-80c8-d6d24641a7e8 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72418) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 18:44:41 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-57882136-2a91-4423-80c8-d6d24641a7e8 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 18:44:41 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-57882136-2a91-4423-80c8-d6d24641a7e8 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] LIGHTOS: no hostnqn found. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 18:44:41 user nova-compute[72418]: DEBUG os_brick.utils [None req-57882136-2a91-4423-80c8-d6d24641a7e8 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] <== get_connector_properties: return (275ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ad56b243ad71', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:44:41 user nova-compute[72418]: DEBUG nova.virt.block_device [None req-57882136-2a91-4423-80c8-d6d24641a7e8 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Updating existing volume attachment record: 2a81fb9f-0879-4d4d-a344-e5ab99ca7dc2 {{(pid=72418) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 18:44:43 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:44:46 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:44:48 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57882136-2a91-4423-80c8-d6d24641a7e8 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Calling os-brick to attach iSCSI Volume {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-57882136-2a91-4423-80c8-d6d24641a7e8 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BVdUELch', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:44:50 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-57882136-2a91-4423-80c8-d6d24641a7e8 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:44:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-57882136-2a91-4423-80c8-d6d24641a7e8 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-57882136-2a91-4423-80c8-d6d24641a7e8 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:44:50 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-57882136-2a91-4423-80c8-d6d24641a7e8 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:44:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-57882136-2a91-4423-80c8-d6d24641a7e8 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-57882136-2a91-4423-80c8-d6d24641a7e8 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:44:50 user nova-compute[72418]: INFO os_brick.initiator.connectors.iscsi [None req-57882136-2a91-4423-80c8-d6d24641a7e8 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 18:44:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768 -p 172.16.0.220:3260 {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5693866-7407-4e16-9de7-bf2286cad4b5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-57882136-2a91-4423-80c8-d6d24641a7e8 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 18:44:50 user nova-compute[72418]:  {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768 -p 172.16.0.220:3260 --interface default --op new {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf00df6-268a-48d2-acae-e4d095a29252]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768] added\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-57882136-2a91-4423-80c8-d6d24641a7e8 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768] added
Aug 09 18:44:50 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66bb613b-b789-4bf6-bce9-4965ebc25ada tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] Calling os-brick to attach iSCSI Volume {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-66bb613b-b789-4bf6-bce9-4965ebc25ada tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3b89d3fe-0150-48ad-ba71-927d3d2207b5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iowEWCGA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:44:50 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-66bb613b-b789-4bf6-bce9-4965ebc25ada tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:44:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-66bb613b-b789-4bf6-bce9-4965ebc25ada tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb62a60-0252-4ae6-83fd-b6e8dd850118]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-57882136-2a91-4423-80c8-d6d24641a7e8 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[1011f433-4d48-498c-9666-79a8c7813d54]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-57882136-2a91-4423-80c8-d6d24641a7e8 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BVdUELch {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BVdUELch" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4241d7-190b-4c48-90eb-cfee6be62be4]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-57882136-2a91-4423-80c8-d6d24641a7e8 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BVdUELch'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] Acquiring lock "fc488d1e-bc21-4041-99ad-222588c9b34f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] Lock "fc488d1e-bc21-4041-99ad-222588c9b34f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a034ad21-8baa-4b30-abc4-c0d5e8d0c136]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-57882136-2a91-4423-80c8-d6d24641a7e8 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG nova.compute.manager [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] [instance: fc488d1e-bc21-4041-99ad-222588c9b34f] Starting instance... {{(pid=72418) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fb6287-2d75-4df7-aa4e-2ce428ebb4cf]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-57882136-2a91-4423-80c8-d6d24641a7e8 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d (non-flash)
Aug 09 18:44:50 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-57882136-2a91-4423-80c8-d6d24641a7e8 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d (non-flash)
Aug 09 18:44:50 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768 -p 172.16.0.220:3260 --login {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6cfec8c-af09-439f-b1c6-230b5d779c45]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-57882136-2a91-4423-80c8-d6d24641a7e8 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768, portal: 172.16.0.220,3260]
Aug 09 18:44:50 user nova-compute[72418]: Login to [iface: default, target: iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768, portal: 172.16.0.220,3260] successful.
Aug 09 18:44:50 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.039s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed099dfd-b0b2-4726-8122-565a097210b9]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-57882136-2a91-4423-80c8-d6d24641a7e8 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72418) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 18:44:50 user nova-compute[72418]: INFO nova.compute.claims [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] [instance: fc488d1e-bc21-4041-99ad-222588c9b34f] Claim successful on node user
Aug 09 18:44:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[58380ac5-dfdf-4370-8f5d-70742d10d54a]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-57882136-2a91-4423-80c8-d6d24641a7e8 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d (non-flash)
Aug 09 18:44:50 user nova-compute[72418]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768 (non-flash)
Aug 09 18:44:50 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-57882136-2a91-4423-80c8-d6d24641a7e8 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d (non-flash)
Aug 09 18:44:50 user nova-compute[72418]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768 (non-flash)
Aug 09 18:44:50 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-57882136-2a91-4423-80c8-d6d24641a7e8 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-57882136-2a91-4423-80c8-d6d24641a7e8 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Connected to 172.16.0.220:3260 {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-57882136-2a91-4423-80c8-d6d24641a7e8 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] HCTL ('34', '-', '-', 0) found on session 41 with lun 0 {{(pid=72418) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-57882136-2a91-4423-80c8-d6d24641a7e8 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72418) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c88dce-594a-44ef-9e02-5836e6a65121]: (4, ('- - 0', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-57882136-2a91-4423-80c8-d6d24641a7e8 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72418) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-57882136-2a91-4423-80c8-d6d24641a7e8 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BVdUELch', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.319s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG nova.compute.manager [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] [instance: fc488d1e-bc21-4041-99ad-222588c9b34f] Start building networks asynchronously for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG nova.compute.manager [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] [instance: fc488d1e-bc21-4041-99ad-222588c9b34f] Allocating IP information in the background. {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG nova.network.neutron [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] [instance: fc488d1e-bc21-4041-99ad-222588c9b34f] allocate_for_instance() {{(pid=72418) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 18:44:50 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] [instance: fc488d1e-bc21-4041-99ad-222588c9b34f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 18:44:50 user nova-compute[72418]: DEBUG nova.compute.manager [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] [instance: fc488d1e-bc21-4041-99ad-222588c9b34f] Start building block device mappings for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG nova.compute.manager [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] [instance: fc488d1e-bc21-4041-99ad-222588c9b34f] Start spawning the instance on the hypervisor. {{(pid=72418) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] [instance: fc488d1e-bc21-4041-99ad-222588c9b34f] Creating instance directory {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 18:44:50 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] [instance: fc488d1e-bc21-4041-99ad-222588c9b34f] Creating image(s)
Aug 09 18:44:50 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] Acquiring lock "/opt/stack/data/nova/instances/fc488d1e-bc21-4041-99ad-222588c9b34f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] Lock "/opt/stack/data/nova/instances/fc488d1e-bc21-4041-99ad-222588c9b34f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] Lock "/opt/stack/data/nova/instances/fc488d1e-bc21-4041-99ad-222588c9b34f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:50 user nova-compute[72418]: DEBUG nova.policy [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'df8de2294058452abe5ca54a43d2a661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada0841d92764de0ae62ebc8cdc97eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72418) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.136s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] Acquiring lock "458773cfa7230b717e41c60277832e9f83806d71" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.135s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/fc488d1e-bc21-4041-99ad-222588c9b34f/disk 1073741824 {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/fc488d1e-bc21-4041-99ad-222588c9b34f/disk 1073741824" returned: 0 in 0.054s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.138s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fc488d1e-bc21-4041-99ad-222588c9b34f/disk. size=1073741824 {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc488d1e-bc21-4041-99ad-222588c9b34f/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-57882136-2a91-4423-80c8-d6d24641a7e8 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-57882136-2a91-4423-80c8-d6d24641a7e8 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '23162383964636236', 'path': '/dev/sdc'} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57882136-2a91-4423-80c8-d6d24641a7e8 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162383964636236', 'path': '/dev/sdc'} {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-66bb613b-b789-4bf6-bce9-4965ebc25ada tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.308s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:44:51 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-66bb613b-b789-4bf6-bce9-4965ebc25ada tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:44:51 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-66bb613b-b789-4bf6-bce9-4965ebc25ada tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b89d3fe-0150-48ad-ba71-927d3d2207b5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-66bb613b-b789-4bf6-bce9-4965ebc25ada tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b89d3fe-0150-48ad-ba71-927d3d2207b5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:44:51 user nova-compute[72418]: INFO os_brick.initiator.connectors.iscsi [None req-66bb613b-b789-4bf6-bce9-4965ebc25ada tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 18:44:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b89d3fe-0150-48ad-ba71-927d3d2207b5 -p 172.16.0.220:3260 {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG nova.objects.instance [None req-57882136-2a91-4423-80c8-d6d24641a7e8 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Lazy-loading 'flavor' on Instance uuid a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b89d3fe-0150-48ad-ba71-927d3d2207b5 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e15d0a0-41e0-4b0d-8f26-7986f288dbc9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-66bb613b-b789-4bf6-bce9-4965ebc25ada tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 18:44:51 user nova-compute[72418]:  {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b89d3fe-0150-48ad-ba71-927d3d2207b5 -p 172.16.0.220:3260 --interface default --op new {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-57882136-2a91-4423-80c8-d6d24641a7e8 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 18:44:51 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:44:51 user nova-compute[72418]:   <source dev="/dev/sdc"/>
Aug 09 18:44:51 user nova-compute[72418]:   <target dev="vdb" bus="virtio"/>
Aug 09 18:44:51 user nova-compute[72418]:   <serial>82cb9116-9fd0-499b-92ec-0f2b48289768</serial>
Aug 09 18:44:51 user nova-compute[72418]: </disk>
Aug 09 18:44:51 user nova-compute[72418]:  {{(pid=72418) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b89d3fe-0150-48ad-ba71-927d3d2207b5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[619e81e6-fe07-40d4-ab11-4eb4308cc007]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b89d3fe-0150-48ad-ba71-927d3d2207b5] added\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-66bb613b-b789-4bf6-bce9-4965ebc25ada tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b89d3fe-0150-48ad-ba71-927d3d2207b5] added
Aug 09 18:44:51 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b89d3fe-0150-48ad-ba71-927d3d2207b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b89d3fe-0150-48ad-ba71-927d3d2207b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e288e1-2fa4-4fad-9031-f8bc1face002]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-66bb613b-b789-4bf6-bce9-4965ebc25ada tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b89d3fe-0150-48ad-ba71-927d3d2207b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b89d3fe-0150-48ad-ba71-927d3d2207b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b295082-4e27-4ff7-9fdb-510cabdc3a74]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-66bb613b-b789-4bf6-bce9-4965ebc25ada tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b89d3fe-0150-48ad-ba71-927d3d2207b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iowEWCGA {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc488d1e-bc21-4041-99ad-222588c9b34f/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] Cannot resize image /opt/stack/data/nova/instances/fc488d1e-bc21-4041-99ad-222588c9b34f/disk to a smaller size. {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG nova.objects.instance [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] Lazy-loading 'migration_context' on Instance uuid fc488d1e-bc21-4041-99ad-222588c9b34f {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] [instance: fc488d1e-bc21-4041-99ad-222588c9b34f] Created local disks {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] [instance: fc488d1e-bc21-4041-99ad-222588c9b34f] Ensure instance console log exists: /opt/stack/data/nova/instances/fc488d1e-bc21-4041-99ad-222588c9b34f/console.log {{(pid=72418) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b89d3fe-0150-48ad-ba71-927d3d2207b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iowEWCGA" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[96cf50d8-499e-40d5-8086-b2a049123b24]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-66bb613b-b789-4bf6-bce9-4965ebc25ada tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iowEWCGA'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b89d3fe-0150-48ad-ba71-927d3d2207b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b89d3fe-0150-48ad-ba71-927d3d2207b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a702b9-025e-4658-97d5-12f9c8fd80f0]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-66bb613b-b789-4bf6-bce9-4965ebc25ada tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b612be-ff2b-4000-82b9-ae18fb5848c4]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-66bb613b-b789-4bf6-bce9-4965ebc25ada tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d (non-flash)
Aug 09 18:44:51 user nova-compute[72418]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768 (non-flash)
Aug 09 18:44:51 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-66bb613b-b789-4bf6-bce9-4965ebc25ada tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d (non-flash)
Aug 09 18:44:51 user nova-compute[72418]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768 (non-flash)
Aug 09 18:44:51 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b89d3fe-0150-48ad-ba71-927d3d2207b5 -p 172.16.0.220:3260 --login {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG nova.network.neutron [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] [instance: fc488d1e-bc21-4041-99ad-222588c9b34f] Successfully created port: 462b42c4-9dde-4c61-80aa-458631b34e46 {{(pid=72418) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b89d3fe-0150-48ad-ba71-927d3d2207b5 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[028539b3-32dd-49ff-9555-bd8fd71792d4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b89d3fe-0150-48ad-ba71-927d3d2207b5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3b89d3fe-0150-48ad-ba71-927d3d2207b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-66bb613b-b789-4bf6-bce9-4965ebc25ada tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b89d3fe-0150-48ad-ba71-927d3d2207b5, portal: 172.16.0.220,3260]
Aug 09 18:44:51 user nova-compute[72418]: Login to [iface: default, target: iqn.2010-10.org.openstack:3b89d3fe-0150-48ad-ba71-927d3d2207b5, portal: 172.16.0.220,3260] successful.
Aug 09 18:44:51 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b89d3fe-0150-48ad-ba71-927d3d2207b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b89d3fe-0150-48ad-ba71-927d3d2207b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[d436688f-b25e-4594-8be0-fa0f3b9f9890]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-66bb613b-b789-4bf6-bce9-4965ebc25ada tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[00cd38ef-7762-4825-8a1b-e2c726b108c1]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b89d3fe-0150-48ad-ba71-927d3d2207b5 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-66bb613b-b789-4bf6-bce9-4965ebc25ada tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d (non-flash)
Aug 09 18:44:51 user nova-compute[72418]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768 (non-flash)
Aug 09 18:44:51 user nova-compute[72418]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b89d3fe-0150-48ad-ba71-927d3d2207b5 (non-flash)
Aug 09 18:44:51 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-66bb613b-b789-4bf6-bce9-4965ebc25ada tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d (non-flash)
Aug 09 18:44:51 user nova-compute[72418]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768 (non-flash)
Aug 09 18:44:51 user nova-compute[72418]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b89d3fe-0150-48ad-ba71-927d3d2207b5 (non-flash)
Aug 09 18:44:51 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-66bb613b-b789-4bf6-bce9-4965ebc25ada tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b89d3fe-0150-48ad-ba71-927d3d2207b5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-66bb613b-b789-4bf6-bce9-4965ebc25ada tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Connected to 172.16.0.220:3260 {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-66bb613b-b789-4bf6-bce9-4965ebc25ada tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] HCTL ('35', '-', '-', 0) found on session 42 with lun 0 {{(pid=72418) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-66bb613b-b789-4bf6-bce9-4965ebc25ada tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72418) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45b3fbe-1b19-49b8-854d-bd9a8af3e0a5]: (4, ('- - 0', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-66bb613b-b789-4bf6-bce9-4965ebc25ada tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Searching for a device in session 42 and hctl ['35', '*', '*', 0] yield: None {{(pid=72418) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-57882136-2a91-4423-80c8-d6d24641a7e8 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-57882136-2a91-4423-80c8-d6d24641a7e8 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-57882136-2a91-4423-80c8-d6d24641a7e8 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] No VIF found with MAC fa:16:3e:ae:d6:b4, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:44:51 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-57882136-2a91-4423-80c8-d6d24641a7e8 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Lock "a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.788s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:44:52 user nova-compute[72418]: DEBUG nova.network.neutron [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] [instance: fc488d1e-bc21-4041-99ad-222588c9b34f] Successfully updated port: 462b42c4-9dde-4c61-80aa-458631b34e46 {{(pid=72418) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 18:44:52 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] Acquiring lock "refresh_cache-fc488d1e-bc21-4041-99ad-222588c9b34f" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:44:52 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] Acquired lock "refresh_cache-fc488d1e-bc21-4041-99ad-222588c9b34f" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:44:52 user nova-compute[72418]: DEBUG nova.network.neutron [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] [instance: fc488d1e-bc21-4041-99ad-222588c9b34f] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:44:52 user nova-compute[72418]: DEBUG nova.compute.manager [req-77eed599-a886-4ced-8efe-2b4700b7b587 req-fd95236d-a5ed-44ca-b423-4c7cb6501458 service nova] [instance: fc488d1e-bc21-4041-99ad-222588c9b34f] Received event network-changed-462b42c4-9dde-4c61-80aa-458631b34e46 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:44:52 user nova-compute[72418]: DEBUG nova.compute.manager [req-77eed599-a886-4ced-8efe-2b4700b7b587 req-fd95236d-a5ed-44ca-b423-4c7cb6501458 service nova] [instance: fc488d1e-bc21-4041-99ad-222588c9b34f] Refreshing instance network info cache due to event network-changed-462b42c4-9dde-4c61-80aa-458631b34e46. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:44:52 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-77eed599-a886-4ced-8efe-2b4700b7b587 req-fd95236d-a5ed-44ca-b423-4c7cb6501458 service nova] Acquiring lock "refresh_cache-fc488d1e-bc21-4041-99ad-222588c9b34f" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:44:52 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-66bb613b-b789-4bf6-bce9-4965ebc25ada tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Searching for a device in session 42 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72418) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 18:44:52 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-66bb613b-b789-4bf6-bce9-4965ebc25ada tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iowEWCGA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 18:44:52 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-66bb613b-b789-4bf6-bce9-4965ebc25ada tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:44:52 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-66bb613b-b789-4bf6-bce9-4965ebc25ada tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] <== connect_volume: return (2616ms) {'type': 'block', 'scsi_wwn': '23332626437393463', 'path': '/dev/sdd'} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:44:52 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66bb613b-b789-4bf6-bce9-4965ebc25ada tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 0f917dfe-409a-474f-9dbb-edbf0eea7871] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23332626437393463', 'path': '/dev/sdd'} {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 18:44:52 user nova-compute[72418]: DEBUG nova.objects.instance [None req-66bb613b-b789-4bf6-bce9-4965ebc25ada tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Lazy-loading 'flavor' on Instance uuid 0f917dfe-409a-474f-9dbb-edbf0eea7871 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:44:52 user nova-compute[72418]: DEBUG nova.network.neutron [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] [instance: fc488d1e-bc21-4041-99ad-222588c9b34f] Instance cache missing network info. {{(pid=72418) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 18:44:52 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-66bb613b-b789-4bf6-bce9-4965ebc25ada tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 18:44:52 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:44:52 user nova-compute[72418]:   <source dev="/dev/sdd"/>
Aug 09 18:44:52 user nova-compute[72418]:   <target dev="vdb" bus="virtio"/>
Aug 09 18:44:52 user nova-compute[72418]:   <serial>3b89d3fe-0150-48ad-ba71-927d3d2207b5</serial>
Aug 09 18:44:52 user nova-compute[72418]: </disk>
Aug 09 18:44:52 user nova-compute[72418]:  {{(pid=72418) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 18:44:52 user nova-compute[72418]: DEBUG nova.network.neutron [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] [instance: fc488d1e-bc21-4041-99ad-222588c9b34f] Updating instance_info_cache with network_info: [{"id": "462b42c4-9dde-4c61-80aa-458631b34e46", "address": "fa:16:3e:4e:63:a3", "network": {"id": "1a32fb92-3c8d-48e7-bf67-e70cec1fcb06", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e5e1e0f3be3043b2938cf82d8e78b9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462b42c4-9d", "ovs_interfaceid": "462b42c4-9dde-4c61-80aa-458631b34e46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:44:53 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] Releasing lock "refresh_cache-fc488d1e-bc21-4041-99ad-222588c9b34f" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:44:53 user nova-compute[72418]: DEBUG nova.compute.manager [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] [instance: fc488d1e-bc21-4041-99ad-222588c9b34f] Instance network_info: |[{"id": "462b42c4-9dde-4c61-80aa-458631b34e46", "address": "fa:16:3e:4e:63:a3", "network": {"id": "1a32fb92-3c8d-48e7-bf67-e70cec1fcb06", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e5e1e0f3be3043b2938cf82d8e78b9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462b42c4-9d", "ovs_interfaceid": "462b42c4-9dde-4c61-80aa-458631b34e46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 18:44:53 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-77eed599-a886-4ced-8efe-2b4700b7b587 req-fd95236d-a5ed-44ca-b423-4c7cb6501458 service nova] Acquired lock "refresh_cache-fc488d1e-bc21-4041-99ad-222588c9b34f" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:44:53 user nova-compute[72418]: DEBUG nova.network.neutron [req-77eed599-a886-4ced-8efe-2b4700b7b587 req-fd95236d-a5ed-44ca-b423-4c7cb6501458 service nova] [instance: fc488d1e-bc21-4041-99ad-222588c9b34f] Refreshing network info cache for port 462b42c4-9dde-4c61-80aa-458631b34e46 {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:44:53 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] [instance: fc488d1e-bc21-4041-99ad-222588c9b34f] Start _get_guest_xml network_info=[{"id": "462b42c4-9dde-4c61-80aa-458631b34e46", "address": "fa:16:3e:4e:63:a3", "network": {"id": "1a32fb92-3c8d-48e7-bf67-e70cec1fcb06", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e5e1e0f3be3043b2938cf82d8e78b9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462b42c4-9d", "ovs_interfaceid": "462b42c4-9dde-4c61-80aa-458631b34e46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 18:44:53 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:44:53 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:44:53 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 18:44:53 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] CPU controller missing on host. {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 18:44:53 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 18:44:53 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] CPU controller found on host. {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 18:44:53 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72418) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 18:44:53 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T18:17:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 18:44:53 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] Flavor limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 18:44:53 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] Image limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 18:44:53 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] Flavor pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 18:44:53 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] Image pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 18:44:53 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 18:44:53 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 18:44:53 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 18:44:53 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] Got 1 possible topologies {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 18:44:53 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 18:44:53 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 18:44:53 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:44:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1313643491',display_name='tempest-VolumesNegativeTest-instance-1313643491',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1313643491',id=37,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ada0841d92764de0ae62ebc8cdc97eb1',ramdisk_id='',reservation_id='r-yp3otukz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1490236946',owner_user_name='tempest-VolumesNegativeTest-1490236946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:44:51Z,user_data=None,user_id='df8de2294058452abe5ca54a43d2a661',uuid=fc488d1e-bc21-4041-99ad-222588c9b34f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "462b42c4-9dde-4c61-80aa-458631b34e46", "address": "fa:16:3e:4e:63:a3", "network": {"id": "1a32fb92-3c8d-48e7-bf67-e70cec1fcb06", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e5e1e0f3be3043b2938cf82d8e78b9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462b42c4-9d", "ovs_interfaceid": "462b42c4-9dde-4c61-80aa-458631b34e46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:44:53 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] Converting VIF {"id": "462b42c4-9dde-4c61-80aa-458631b34e46", "address": "fa:16:3e:4e:63:a3", "network": {"id": "1a32fb92-3c8d-48e7-bf67-e70cec1fcb06", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e5e1e0f3be3043b2938cf82d8e78b9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462b42c4-9d", "ovs_interfaceid": "462b42c4-9dde-4c61-80aa-458631b34e46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:44:53 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:63:a3,bridge_name='br-int',has_traffic_filtering=True,id=462b42c4-9dde-4c61-80aa-458631b34e46,network=Network(1a32fb92-3c8d-48e7-bf67-e70cec1fcb06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap462b42c4-9d') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:44:53 user nova-compute[72418]: DEBUG nova.objects.instance [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] Lazy-loading 'pci_devices' on Instance uuid fc488d1e-bc21-4041-99ad-222588c9b34f {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:44:53 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] [instance: fc488d1e-bc21-4041-99ad-222588c9b34f] End _get_guest_xml xml=<domain type="kvm">
Aug 09 18:44:53 user nova-compute[72418]:   <uuid>fc488d1e-bc21-4041-99ad-222588c9b34f</uuid>
Aug 09 18:44:53 user nova-compute[72418]:   <name>instance-00000025</name>
Aug 09 18:44:53 user nova-compute[72418]:   <memory>524288</memory>
Aug 09 18:44:53 user nova-compute[72418]:   <vcpu>1</vcpu>
Aug 09 18:44:53 user nova-compute[72418]:   <metadata>
Aug 09 18:44:53 user nova-compute[72418]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:44:53 user nova-compute[72418]:       <nova:package version="0.0.0"/>
Aug 09 18:44:53 user nova-compute[72418]:       <nova:name>tempest-VolumesNegativeTest-instance-1313643491</nova:name>
Aug 09 18:44:53 user nova-compute[72418]:       <nova:creationTime>2023-08-09 18:44:53</nova:creationTime>
Aug 09 18:44:53 user nova-compute[72418]:       <nova:flavor name="m1.tiny">
Aug 09 18:44:53 user nova-compute[72418]:         <nova:memory>512</nova:memory>
Aug 09 18:44:53 user nova-compute[72418]:         <nova:disk>1</nova:disk>
Aug 09 18:44:53 user nova-compute[72418]:         <nova:swap>0</nova:swap>
Aug 09 18:44:53 user nova-compute[72418]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:44:53 user nova-compute[72418]:         <nova:vcpus>1</nova:vcpus>
Aug 09 18:44:53 user nova-compute[72418]:       </nova:flavor>
Aug 09 18:44:53 user nova-compute[72418]:       <nova:owner>
Aug 09 18:44:53 user nova-compute[72418]:         <nova:user uuid="df8de2294058452abe5ca54a43d2a661">tempest-VolumesNegativeTest-1490236946-project-member</nova:user>
Aug 09 18:44:53 user nova-compute[72418]:         <nova:project uuid="ada0841d92764de0ae62ebc8cdc97eb1">tempest-VolumesNegativeTest-1490236946</nova:project>
Aug 09 18:44:53 user nova-compute[72418]:       </nova:owner>
Aug 09 18:44:53 user nova-compute[72418]:       <nova:root type="image" uuid="8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e"/>
Aug 09 18:44:53 user nova-compute[72418]:       <nova:ports>
Aug 09 18:44:53 user nova-compute[72418]:         <nova:port uuid="462b42c4-9dde-4c61-80aa-458631b34e46">
Aug 09 18:44:53 user nova-compute[72418]:           <nova:ip type="fixed" address="192.168.233.175" ipVersion="4"/>
Aug 09 18:44:53 user nova-compute[72418]:         </nova:port>
Aug 09 18:44:53 user nova-compute[72418]:       </nova:ports>
Aug 09 18:44:53 user nova-compute[72418]:     </nova:instance>
Aug 09 18:44:53 user nova-compute[72418]:   </metadata>
Aug 09 18:44:53 user nova-compute[72418]:   <sysinfo type="smbios">
Aug 09 18:44:53 user nova-compute[72418]:     <system>
Aug 09 18:44:53 user nova-compute[72418]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 18:44:53 user nova-compute[72418]:       <entry name="product">OpenStack Nova</entry>
Aug 09 18:44:53 user nova-compute[72418]:       <entry name="version">0.0.0</entry>
Aug 09 18:44:53 user nova-compute[72418]:       <entry name="serial">fc488d1e-bc21-4041-99ad-222588c9b34f</entry>
Aug 09 18:44:53 user nova-compute[72418]:       <entry name="uuid">fc488d1e-bc21-4041-99ad-222588c9b34f</entry>
Aug 09 18:44:53 user nova-compute[72418]:       <entry name="family">Virtual Machine</entry>
Aug 09 18:44:53 user nova-compute[72418]:     </system>
Aug 09 18:44:53 user nova-compute[72418]:   </sysinfo>
Aug 09 18:44:53 user nova-compute[72418]:   <os>
Aug 09 18:44:53 user nova-compute[72418]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 18:44:53 user nova-compute[72418]:     <boot dev="hd"/>
Aug 09 18:44:53 user nova-compute[72418]:     <smbios mode="sysinfo"/>
Aug 09 18:44:53 user nova-compute[72418]:   </os>
Aug 09 18:44:53 user nova-compute[72418]:   <features>
Aug 09 18:44:53 user nova-compute[72418]:     <acpi/>
Aug 09 18:44:53 user nova-compute[72418]:     <apic/>
Aug 09 18:44:53 user nova-compute[72418]:     <vmcoreinfo/>
Aug 09 18:44:53 user nova-compute[72418]:   </features>
Aug 09 18:44:53 user nova-compute[72418]:   <clock offset="utc">
Aug 09 18:44:53 user nova-compute[72418]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 18:44:53 user nova-compute[72418]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 18:44:53 user nova-compute[72418]:     <timer name="hpet" present="no"/>
Aug 09 18:44:53 user nova-compute[72418]:   </clock>
Aug 09 18:44:53 user nova-compute[72418]:   <cpu mode="custom" match="exact">
Aug 09 18:44:53 user nova-compute[72418]:     <model>Nehalem</model>
Aug 09 18:44:53 user nova-compute[72418]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 18:44:53 user nova-compute[72418]:   </cpu>
Aug 09 18:44:53 user nova-compute[72418]:   <devices>
Aug 09 18:44:53 user nova-compute[72418]:     <disk type="file" device="disk">
Aug 09 18:44:53 user nova-compute[72418]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 18:44:53 user nova-compute[72418]:       <source file="/opt/stack/data/nova/instances/fc488d1e-bc21-4041-99ad-222588c9b34f/disk"/>
Aug 09 18:44:53 user nova-compute[72418]:       <target dev="vda" bus="virtio"/>
Aug 09 18:44:53 user nova-compute[72418]:     </disk>
Aug 09 18:44:53 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:44:53 user nova-compute[72418]:       <mac address="fa:16:3e:4e:63:a3"/>
Aug 09 18:44:53 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:44:53 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:44:53 user nova-compute[72418]:       <target dev="tap462b42c4-9d"/>
Aug 09 18:44:53 user nova-compute[72418]:     </interface>
Aug 09 18:44:53 user nova-compute[72418]:     <serial type="pty">
Aug 09 18:44:53 user nova-compute[72418]:       <log file="/opt/stack/data/nova/instances/fc488d1e-bc21-4041-99ad-222588c9b34f/console.log" append="off"/>
Aug 09 18:44:53 user nova-compute[72418]:     </serial>
Aug 09 18:44:53 user nova-compute[72418]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 18:44:53 user nova-compute[72418]:     <video>
Aug 09 18:44:53 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:44:53 user nova-compute[72418]:     </video>
Aug 09 18:44:53 user nova-compute[72418]:     <rng model="virtio">
Aug 09 18:44:53 user nova-compute[72418]:       <backend model="random">/dev/urandom</backend>
Aug 09 18:44:53 user nova-compute[72418]:     </rng>
Aug 09 18:44:53 user nova-compute[72418]:     <controller type="usb" index="0" model="none"/>
Aug 09 18:44:53 user nova-compute[72418]:     <memballoon model="virtio">
Aug 09 18:44:53 user nova-compute[72418]:       <stats period="10"/>
Aug 09 18:44:53 user nova-compute[72418]:     </memballoon>
Aug 09 18:44:53 user nova-compute[72418]:   </devices>
Aug 09 18:44:53 user nova-compute[72418]: </domain>
Aug 09 18:44:53 user nova-compute[72418]:  {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 18:44:53 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:44:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1313643491',display_name='tempest-VolumesNegativeTest-instance-1313643491',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1313643491',id=37,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ada0841d92764de0ae62ebc8cdc97eb1',ramdisk_id='',reservation_id='r-yp3otukz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1490236946',owner_user_name='tempest-VolumesNegativeTest-1490236946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:44:51Z,user_data=None,user_id='df8de2294058452abe5ca54a43d2a661',uuid=fc488d1e-bc21-4041-99ad-222588c9b34f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "462b42c4-9dde-4c61-80aa-458631b34e46", "address": "fa:16:3e:4e:63:a3", "network": {"id": "1a32fb92-3c8d-48e7-bf67-e70cec1fcb06", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e5e1e0f3be3043b2938cf82d8e78b9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462b42c4-9d", "ovs_interfaceid": "462b42c4-9dde-4c61-80aa-458631b34e46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:44:53 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] Converting VIF {"id": "462b42c4-9dde-4c61-80aa-458631b34e46", "address": "fa:16:3e:4e:63:a3", "network": {"id": "1a32fb92-3c8d-48e7-bf67-e70cec1fcb06", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e5e1e0f3be3043b2938cf82d8e78b9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462b42c4-9d", "ovs_interfaceid": "462b42c4-9dde-4c61-80aa-458631b34e46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:44:53 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:63:a3,bridge_name='br-int',has_traffic_filtering=True,id=462b42c4-9dde-4c61-80aa-458631b34e46,network=Network(1a32fb92-3c8d-48e7-bf67-e70cec1fcb06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap462b42c4-9d') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:44:53 user nova-compute[72418]: DEBUG os_vif [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:63:a3,bridge_name='br-int',has_traffic_filtering=True,id=462b42c4-9dde-4c61-80aa-458631b34e46,network=Network(1a32fb92-3c8d-48e7-bf67-e70cec1fcb06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap462b42c4-9d') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:44:53 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:44:53 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:44:53 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:44:53 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:44:53 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap462b42c4-9d, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:44:53 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap462b42c4-9d, col_values=(('external_ids', {'iface-id': '462b42c4-9dde-4c61-80aa-458631b34e46', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:63:a3', 'vm-uuid': 'fc488d1e-bc21-4041-99ad-222588c9b34f'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:44:53 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:44:53 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:44:53 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:44:53 user nova-compute[72418]: INFO os_vif [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:63:a3,bridge_name='br-int',has_traffic_filtering=True,id=462b42c4-9dde-4c61-80aa-458631b34e46,network=Network(1a32fb92-3c8d-48e7-bf67-e70cec1fcb06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap462b42c4-9d')
Aug 09 18:44:53 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-66bb613b-b789-4bf6-bce9-4965ebc25ada tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:44:53 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-66bb613b-b789-4bf6-bce9-4965ebc25ada tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:44:53 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-66bb613b-b789-4bf6-bce9-4965ebc25ada tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] No VIF found with MAC fa:16:3e:d9:05:d0, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:44:53 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:44:53 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] No VIF found with MAC fa:16:3e:4e:63:a3, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:44:53 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-66bb613b-b789-4bf6-bce9-4965ebc25ada tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Lock "0f917dfe-409a-474f-9dbb-edbf0eea7871" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.228s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:44:53 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:44:53 user nova-compute[72418]: DEBUG nova.network.neutron [req-77eed599-a886-4ced-8efe-2b4700b7b587 req-fd95236d-a5ed-44ca-b423-4c7cb6501458 service nova] [instance: fc488d1e-bc21-4041-99ad-222588c9b34f] Updated VIF entry in instance network info cache for port 462b42c4-9dde-4c61-80aa-458631b34e46. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:44:53 user nova-compute[72418]: DEBUG nova.network.neutron [req-77eed599-a886-4ced-8efe-2b4700b7b587 req-fd95236d-a5ed-44ca-b423-4c7cb6501458 service nova] [instance: fc488d1e-bc21-4041-99ad-222588c9b34f] Updating instance_info_cache with network_info: [{"id": "462b42c4-9dde-4c61-80aa-458631b34e46", "address": "fa:16:3e:4e:63:a3", "network": {"id": "1a32fb92-3c8d-48e7-bf67-e70cec1fcb06", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e5e1e0f3be3043b2938cf82d8e78b9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462b42c4-9d", "ovs_interfaceid": "462b42c4-9dde-4c61-80aa-458631b34e46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:44:53 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-77eed599-a886-4ced-8efe-2b4700b7b587 req-fd95236d-a5ed-44ca-b423-4c7cb6501458 service nova] Releasing lock "refresh_cache-fc488d1e-bc21-4041-99ad-222588c9b34f" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:44:53 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:44:54 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:44:54 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:44:54 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:44:54 user nova-compute[72418]: DEBUG nova.compute.manager [req-ff0105e5-2b5b-4bb2-b351-f0f59032ecbb req-1c17e514-e11d-4d32-88d5-c89a86fd89fe service nova] [instance: fc488d1e-bc21-4041-99ad-222588c9b34f] Received event network-vif-plugged-462b42c4-9dde-4c61-80aa-458631b34e46 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:44:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-ff0105e5-2b5b-4bb2-b351-f0f59032ecbb req-1c17e514-e11d-4d32-88d5-c89a86fd89fe service nova] Acquiring lock "fc488d1e-bc21-4041-99ad-222588c9b34f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:44:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-ff0105e5-2b5b-4bb2-b351-f0f59032ecbb req-1c17e514-e11d-4d32-88d5-c89a86fd89fe service nova] Lock "fc488d1e-bc21-4041-99ad-222588c9b34f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:44:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-ff0105e5-2b5b-4bb2-b351-f0f59032ecbb req-1c17e514-e11d-4d32-88d5-c89a86fd89fe service nova] Lock "fc488d1e-bc21-4041-99ad-222588c9b34f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:44:54 user nova-compute[72418]: DEBUG nova.compute.manager [req-ff0105e5-2b5b-4bb2-b351-f0f59032ecbb req-1c17e514-e11d-4d32-88d5-c89a86fd89fe service nova] [instance: fc488d1e-bc21-4041-99ad-222588c9b34f] No waiting events found dispatching network-vif-plugged-462b42c4-9dde-4c61-80aa-458631b34e46 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:44:54 user nova-compute[72418]: WARNING nova.compute.manager [req-ff0105e5-2b5b-4bb2-b351-f0f59032ecbb req-1c17e514-e11d-4d32-88d5-c89a86fd89fe service nova] [instance: fc488d1e-bc21-4041-99ad-222588c9b34f] Received unexpected event network-vif-plugged-462b42c4-9dde-4c61-80aa-458631b34e46 for instance with vm_state building and task_state spawning.
Aug 09 18:44:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-319ea8a3-41bc-4cbe-ab2a-b17ae68e7b45 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Acquiring lock "a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:44:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-319ea8a3-41bc-4cbe-ab2a-b17ae68e7b45 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Lock "a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:44:54 user nova-compute[72418]: DEBUG nova.objects.instance [None req-319ea8a3-41bc-4cbe-ab2a-b17ae68e7b45 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Lazy-loading 'flavor' on Instance uuid a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:44:54 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-319ea8a3-41bc-4cbe-ab2a-b17ae68e7b45 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Lock "a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:44:55 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-319ea8a3-41bc-4cbe-ab2a-b17ae68e7b45 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Acquiring lock "a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:44:55 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-319ea8a3-41bc-4cbe-ab2a-b17ae68e7b45 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Lock "a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:44:55 user nova-compute[72418]: INFO nova.compute.manager [None req-319ea8a3-41bc-4cbe-ab2a-b17ae68e7b45 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Attaching volume 88e1318c-40fe-4f6f-a988-5fe9dc2875a8 to /dev/vdc
Aug 09 18:44:55 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:44:55 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:44:55 user nova-compute[72418]: DEBUG os_brick.utils [None req-319ea8a3-41bc-4cbe-ab2a-b17ae68e7b45 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:44:55 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:55 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:55 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f42ddf-664d-44c6-b7b4-c748e3d8cdca]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ad56b243ad71\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:44:55 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:55 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:55 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ffd4ce3-2676-4d10-ac8f-0ae28d4f63be]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:44:55 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:55 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:55 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[041ad6ec-e10b-430e-92a6-255553c8fb39]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:44:55 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[702593fd-4179-4bf5-b32d-dfa9224eceba]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:44:55 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-319ea8a3-41bc-4cbe-ab2a-b17ae68e7b45 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Running cmd (subprocess): nvme version {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:55 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-319ea8a3-41bc-4cbe-ab2a-b17ae68e7b45 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] 'nvme version' failed. Not Retrying. {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:44:55 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.nvmeof [None req-319ea8a3-41bc-4cbe-ab2a-b17ae68e7b45 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] nvme not present on system {{(pid=72418) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 18:44:55 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:55 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 18:44:55 user nova-compute[72418]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 18:44:55 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c81a6f-2a3f-4aa5-92c2-6edec8d05424]: (4, '') {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:44:55 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-319ea8a3-41bc-4cbe-ab2a-b17ae68e7b45 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72418) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 18:44:55 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-319ea8a3-41bc-4cbe-ab2a-b17ae68e7b45 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 18:44:55 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.lightos [None req-319ea8a3-41bc-4cbe-ab2a-b17ae68e7b45 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] LIGHTOS: no hostnqn found. {{(pid=72418) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 18:44:55 user nova-compute[72418]: DEBUG os_brick.utils [None req-319ea8a3-41bc-4cbe-ab2a-b17ae68e7b45 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ad56b243ad71', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:44:55 user nova-compute[72418]: DEBUG nova.virt.block_device [None req-319ea8a3-41bc-4cbe-ab2a-b17ae68e7b45 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Updating existing volume attachment record: 77299dc1-55fc-4a56-bd81-76f9b6bc4e02 {{(pid=72418) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 18:44:56 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Acquiring lock "1afce6e7-5362-4cca-a111-61a96f2f5a02" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:44:56 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Lock "1afce6e7-5362-4cca-a111-61a96f2f5a02" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:44:56 user nova-compute[72418]: DEBUG nova.compute.manager [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 1afce6e7-5362-4cca-a111-61a96f2f5a02] Starting instance... {{(pid=72418) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 18:44:56 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:44:56 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:44:56 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72418) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 18:44:56 user nova-compute[72418]: INFO nova.compute.claims [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 1afce6e7-5362-4cca-a111-61a96f2f5a02] Claim successful on node user
Aug 09 18:44:56 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691606696.7455695, fc488d1e-bc21-4041-99ad-222588c9b34f => Resumed> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:44:56 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: fc488d1e-bc21-4041-99ad-222588c9b34f] VM Resumed (Lifecycle Event)
Aug 09 18:44:56 user nova-compute[72418]: DEBUG nova.compute.manager [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] [instance: fc488d1e-bc21-4041-99ad-222588c9b34f] Instance event wait completed in 0 seconds for  {{(pid=72418) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 18:44:56 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] [instance: fc488d1e-bc21-4041-99ad-222588c9b34f] Guest created on hypervisor {{(pid=72418) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 18:44:56 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: fc488d1e-bc21-4041-99ad-222588c9b34f] Instance spawned successfully.
Aug 09 18:44:56 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] [instance: fc488d1e-bc21-4041-99ad-222588c9b34f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 18:44:56 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: fc488d1e-bc21-4041-99ad-222588c9b34f] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:44:56 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: fc488d1e-bc21-4041-99ad-222588c9b34f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:44:56 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] [instance: fc488d1e-bc21-4041-99ad-222588c9b34f] Found default for hw_cdrom_bus of ide {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:44:56 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] [instance: fc488d1e-bc21-4041-99ad-222588c9b34f] Found default for hw_disk_bus of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:44:56 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] [instance: fc488d1e-bc21-4041-99ad-222588c9b34f] Found default for hw_input_bus of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:44:56 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] [instance: fc488d1e-bc21-4041-99ad-222588c9b34f] Found default for hw_pointer_model of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:44:56 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] [instance: fc488d1e-bc21-4041-99ad-222588c9b34f] Found default for hw_video_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:44:56 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] [instance: fc488d1e-bc21-4041-99ad-222588c9b34f] Found default for hw_vif_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:44:56 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: fc488d1e-bc21-4041-99ad-222588c9b34f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:44:56 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691606696.7473292, fc488d1e-bc21-4041-99ad-222588c9b34f => Started> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:44:56 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: fc488d1e-bc21-4041-99ad-222588c9b34f] VM Started (Lifecycle Event)
Aug 09 18:44:56 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:44:56 user nova-compute[72418]: DEBUG nova.compute.manager [req-cafebe90-e000-4e4a-9d90-b2beda88966b req-54f20ebf-5d3f-4ea1-9948-c968144ae92f service nova] [instance: fc488d1e-bc21-4041-99ad-222588c9b34f] Received event network-vif-plugged-462b42c4-9dde-4c61-80aa-458631b34e46 {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:44:56 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-cafebe90-e000-4e4a-9d90-b2beda88966b req-54f20ebf-5d3f-4ea1-9948-c968144ae92f service nova] Acquiring lock "fc488d1e-bc21-4041-99ad-222588c9b34f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:44:56 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-cafebe90-e000-4e4a-9d90-b2beda88966b req-54f20ebf-5d3f-4ea1-9948-c968144ae92f service nova] Lock "fc488d1e-bc21-4041-99ad-222588c9b34f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:44:56 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-cafebe90-e000-4e4a-9d90-b2beda88966b req-54f20ebf-5d3f-4ea1-9948-c968144ae92f service nova] Lock "fc488d1e-bc21-4041-99ad-222588c9b34f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:44:56 user nova-compute[72418]: DEBUG nova.compute.manager [req-cafebe90-e000-4e4a-9d90-b2beda88966b req-54f20ebf-5d3f-4ea1-9948-c968144ae92f service nova] [instance: fc488d1e-bc21-4041-99ad-222588c9b34f] No waiting events found dispatching network-vif-plugged-462b42c4-9dde-4c61-80aa-458631b34e46 {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:44:56 user nova-compute[72418]: WARNING nova.compute.manager [req-cafebe90-e000-4e4a-9d90-b2beda88966b req-54f20ebf-5d3f-4ea1-9948-c968144ae92f service nova] [instance: fc488d1e-bc21-4041-99ad-222588c9b34f] Received unexpected event network-vif-plugged-462b42c4-9dde-4c61-80aa-458631b34e46 for instance with vm_state building and task_state spawning.
Aug 09 18:44:56 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:44:56 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: fc488d1e-bc21-4041-99ad-222588c9b34f] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:44:56 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: fc488d1e-bc21-4041-99ad-222588c9b34f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:44:56 user nova-compute[72418]: INFO nova.compute.manager [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] [instance: fc488d1e-bc21-4041-99ad-222588c9b34f] Took 6.01 seconds to spawn the instance on the hypervisor.
Aug 09 18:44:56 user nova-compute[72418]: DEBUG nova.compute.manager [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] [instance: fc488d1e-bc21-4041-99ad-222588c9b34f] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:44:56 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: fc488d1e-bc21-4041-99ad-222588c9b34f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:44:56 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.324s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:44:56 user nova-compute[72418]: DEBUG nova.compute.manager [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 1afce6e7-5362-4cca-a111-61a96f2f5a02] Start building networks asynchronously for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 18:44:56 user nova-compute[72418]: DEBUG nova.compute.manager [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 1afce6e7-5362-4cca-a111-61a96f2f5a02] Allocating IP information in the background. {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 18:44:56 user nova-compute[72418]: DEBUG nova.network.neutron [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 1afce6e7-5362-4cca-a111-61a96f2f5a02] allocate_for_instance() {{(pid=72418) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 18:44:56 user nova-compute[72418]: INFO nova.compute.manager [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] [instance: fc488d1e-bc21-4041-99ad-222588c9b34f] Took 6.70 seconds to build instance.
Aug 09 18:44:56 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 1afce6e7-5362-4cca-a111-61a96f2f5a02] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 18:44:56 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-c34af969-42c6-48a4-98e1-00c9121d12c4 tempest-VolumesNegativeTest-1490236946 tempest-VolumesNegativeTest-1490236946-project-member] Lock "fc488d1e-bc21-4041-99ad-222588c9b34f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.825s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:44:56 user nova-compute[72418]: DEBUG nova.compute.manager [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 1afce6e7-5362-4cca-a111-61a96f2f5a02] Start building block device mappings for instance. {{(pid=72418) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 18:44:57 user nova-compute[72418]: DEBUG nova.policy [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f6691a938b024ac9abbf81f417065f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8456a86110d1420c9107c38dd3fad34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72418) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 18:44:57 user nova-compute[72418]: DEBUG nova.compute.manager [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 1afce6e7-5362-4cca-a111-61a96f2f5a02] Start spawning the instance on the hypervisor. {{(pid=72418) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 18:44:57 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 1afce6e7-5362-4cca-a111-61a96f2f5a02] Creating instance directory {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 18:44:57 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 1afce6e7-5362-4cca-a111-61a96f2f5a02] Creating image(s)
Aug 09 18:44:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Acquiring lock "/opt/stack/data/nova/instances/1afce6e7-5362-4cca-a111-61a96f2f5a02/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:44:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Lock "/opt/stack/data/nova/instances/1afce6e7-5362-4cca-a111-61a96f2f5a02/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:44:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Lock "/opt/stack/data/nova/instances/1afce6e7-5362-4cca-a111-61a96f2f5a02/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:44:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.148s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Acquiring lock "458773cfa7230b717e41c60277832e9f83806d71" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:44:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:44:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.200s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/1afce6e7-5362-4cca-a111-61a96f2f5a02/disk 1073741824 {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71,backing_fmt=raw /opt/stack/data/nova/instances/1afce6e7-5362-4cca-a111-61a96f2f5a02/disk 1073741824" returned: 0 in 0.059s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Lock "458773cfa7230b717e41c60277832e9f83806d71" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:44:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/458773cfa7230b717e41c60277832e9f83806d71 --force-share --output=json" returned: 0 in 0.143s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:57 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1afce6e7-5362-4cca-a111-61a96f2f5a02/disk. size=1073741824 {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 18:44:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1afce6e7-5362-4cca-a111-61a96f2f5a02/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:44:57 user nova-compute[72418]: DEBUG nova.network.neutron [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 1afce6e7-5362-4cca-a111-61a96f2f5a02] Successfully created port: 58621c5a-2cd4-4919-aa44-31b76fed7faf {{(pid=72418) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 18:44:57 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1afce6e7-5362-4cca-a111-61a96f2f5a02/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:44:57 user nova-compute[72418]: DEBUG nova.virt.disk.api [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Cannot resize image /opt/stack/data/nova/instances/1afce6e7-5362-4cca-a111-61a96f2f5a02/disk to a smaller size. {{(pid=72418) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 18:44:57 user nova-compute[72418]: DEBUG nova.objects.instance [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Lazy-loading 'migration_context' on Instance uuid 1afce6e7-5362-4cca-a111-61a96f2f5a02 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:44:57 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 1afce6e7-5362-4cca-a111-61a96f2f5a02] Created local disks {{(pid=72418) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 18:44:57 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 1afce6e7-5362-4cca-a111-61a96f2f5a02] Ensure instance console log exists: /opt/stack/data/nova/instances/1afce6e7-5362-4cca-a111-61a96f2f5a02/console.log {{(pid=72418) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 18:44:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:44:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:44:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:44:58 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:44:58 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:44:58 user nova-compute[72418]: DEBUG nova.network.neutron [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 1afce6e7-5362-4cca-a111-61a96f2f5a02] Successfully updated port: 58621c5a-2cd4-4919-aa44-31b76fed7faf {{(pid=72418) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 18:44:58 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Acquiring lock "refresh_cache-1afce6e7-5362-4cca-a111-61a96f2f5a02" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:44:58 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Acquired lock "refresh_cache-1afce6e7-5362-4cca-a111-61a96f2f5a02" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:44:58 user nova-compute[72418]: DEBUG nova.network.neutron [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 1afce6e7-5362-4cca-a111-61a96f2f5a02] Building network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 18:44:58 user nova-compute[72418]: DEBUG nova.compute.manager [req-0b2b3400-273a-4e63-9c77-255732159b31 req-6f7cd7b1-a09f-40dd-8abc-c7d4e9cd850b service nova] [instance: 1afce6e7-5362-4cca-a111-61a96f2f5a02] Received event network-changed-58621c5a-2cd4-4919-aa44-31b76fed7faf {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:44:58 user nova-compute[72418]: DEBUG nova.compute.manager [req-0b2b3400-273a-4e63-9c77-255732159b31 req-6f7cd7b1-a09f-40dd-8abc-c7d4e9cd850b service nova] [instance: 1afce6e7-5362-4cca-a111-61a96f2f5a02] Refreshing instance network info cache due to event network-changed-58621c5a-2cd4-4919-aa44-31b76fed7faf. {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 18:44:58 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-0b2b3400-273a-4e63-9c77-255732159b31 req-6f7cd7b1-a09f-40dd-8abc-c7d4e9cd850b service nova] Acquiring lock "refresh_cache-1afce6e7-5362-4cca-a111-61a96f2f5a02" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:44:58 user nova-compute[72418]: DEBUG nova.network.neutron [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 1afce6e7-5362-4cca-a111-61a96f2f5a02] Instance cache missing network info. {{(pid=72418) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 18:44:58 user nova-compute[72418]: DEBUG nova.network.neutron [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 1afce6e7-5362-4cca-a111-61a96f2f5a02] Updating instance_info_cache with network_info: [{"id": "58621c5a-2cd4-4919-aa44-31b76fed7faf", "address": "fa:16:3e:00:8d:67", "network": {"id": "c525572b-cf59-4359-88c8-cef227847c3c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2043600619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8456a86110d1420c9107c38dd3fad34f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58621c5a-2c", "ovs_interfaceid": "58621c5a-2cd4-4919-aa44-31b76fed7faf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:44:58 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Releasing lock "refresh_cache-1afce6e7-5362-4cca-a111-61a96f2f5a02" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:44:58 user nova-compute[72418]: DEBUG nova.compute.manager [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 1afce6e7-5362-4cca-a111-61a96f2f5a02] Instance network_info: |[{"id": "58621c5a-2cd4-4919-aa44-31b76fed7faf", "address": "fa:16:3e:00:8d:67", "network": {"id": "c525572b-cf59-4359-88c8-cef227847c3c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2043600619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8456a86110d1420c9107c38dd3fad34f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58621c5a-2c", "ovs_interfaceid": "58621c5a-2cd4-4919-aa44-31b76fed7faf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72418) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 18:44:58 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-0b2b3400-273a-4e63-9c77-255732159b31 req-6f7cd7b1-a09f-40dd-8abc-c7d4e9cd850b service nova] Acquired lock "refresh_cache-1afce6e7-5362-4cca-a111-61a96f2f5a02" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:44:58 user nova-compute[72418]: DEBUG nova.network.neutron [req-0b2b3400-273a-4e63-9c77-255732159b31 req-6f7cd7b1-a09f-40dd-8abc-c7d4e9cd850b service nova] [instance: 1afce6e7-5362-4cca-a111-61a96f2f5a02] Refreshing network info cache for port 58621c5a-2cd4-4919-aa44-31b76fed7faf {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 18:44:58 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 1afce6e7-5362-4cca-a111-61a96f2f5a02] Start _get_guest_xml network_info=[{"id": "58621c5a-2cd4-4919-aa44-31b76fed7faf", "address": "fa:16:3e:00:8d:67", "network": {"id": "c525572b-cf59-4359-88c8-cef227847c3c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2043600619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8456a86110d1420c9107c38dd3fad34f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58621c5a-2c", "ovs_interfaceid": "58621c5a-2cd4-4919-aa44-31b76fed7faf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'disk_bus': 'virtio', 'encryption_options': None, 'size': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'image_id': '8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 18:44:58 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:44:58 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:44:58 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 18:44:58 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] CPU controller missing on host. {{(pid=72418) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 18:44:58 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 18:44:58 user nova-compute[72418]: DEBUG nova.virt.libvirt.host [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] CPU controller found on host. {{(pid=72418) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 18:44:58 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72418) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 18:44:58 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T18:17:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T18:18:08Z,direct_url=<?>,disk_format='qcow2',id=8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e5e1e0f3be3043b2938cf82d8e78b9bb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T18:18:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 18:44:58 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Flavor limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 18:44:58 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Image limits 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 18:44:58 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Flavor pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 18:44:58 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Image pref 0:0:0 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 18:44:58 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 18:44:58 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 18:44:58 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 18:44:58 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Got 1 possible topologies {{(pid=72418) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 18:44:58 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 18:44:58 user nova-compute[72418]: DEBUG nova.virt.hardware [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72418) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 18:44:58 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:44:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-124989129',display_name='tempest-AttachVolumeNegativeTest-server-124989129',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-124989129',id=38,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzNt9BGnRuFniOhrBwg/SYPvWzzGBo9rocd57aaSJQqOJC9kUNQJ62LckbYSapVjvOcYLDSLlKkGbWyZQfpFp5s8VpZEqekTf5ZNAW/qkqvVb1ZJRPHojG/OjVLbODj7g==',key_name='tempest-keypair-100153773',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8456a86110d1420c9107c38dd3fad34f',ramdisk_id='',reservation_id='r-cct36q4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-892551734',owner_user_name='tempest-AttachVolumeNegativeTest-892551734-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:44:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6691a938b024ac9abbf81f417065f1b',uuid=1afce6e7-5362-4cca-a111-61a96f2f5a02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58621c5a-2cd4-4919-aa44-31b76fed7faf", "address": "fa:16:3e:00:8d:67", "network": {"id": "c525572b-cf59-4359-88c8-cef227847c3c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2043600619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8456a86110d1420c9107c38dd3fad34f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58621c5a-2c", "ovs_interfaceid": "58621c5a-2cd4-4919-aa44-31b76fed7faf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72418) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 18:44:58 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Converting VIF {"id": "58621c5a-2cd4-4919-aa44-31b76fed7faf", "address": "fa:16:3e:00:8d:67", "network": {"id": "c525572b-cf59-4359-88c8-cef227847c3c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2043600619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8456a86110d1420c9107c38dd3fad34f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58621c5a-2c", "ovs_interfaceid": "58621c5a-2cd4-4919-aa44-31b76fed7faf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:44:58 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:8d:67,bridge_name='br-int',has_traffic_filtering=True,id=58621c5a-2cd4-4919-aa44-31b76fed7faf,network=Network(c525572b-cf59-4359-88c8-cef227847c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58621c5a-2c') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:44:58 user nova-compute[72418]: DEBUG nova.objects.instance [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Lazy-loading 'pci_devices' on Instance uuid 1afce6e7-5362-4cca-a111-61a96f2f5a02 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:44:59 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 1afce6e7-5362-4cca-a111-61a96f2f5a02] End _get_guest_xml xml=<domain type="kvm">
Aug 09 18:44:59 user nova-compute[72418]:   <uuid>1afce6e7-5362-4cca-a111-61a96f2f5a02</uuid>
Aug 09 18:44:59 user nova-compute[72418]:   <name>instance-00000026</name>
Aug 09 18:44:59 user nova-compute[72418]:   <memory>524288</memory>
Aug 09 18:44:59 user nova-compute[72418]:   <vcpu>1</vcpu>
Aug 09 18:44:59 user nova-compute[72418]:   <metadata>
Aug 09 18:44:59 user nova-compute[72418]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 18:44:59 user nova-compute[72418]:       <nova:package version="0.0.0"/>
Aug 09 18:44:59 user nova-compute[72418]:       <nova:name>tempest-AttachVolumeNegativeTest-server-124989129</nova:name>
Aug 09 18:44:59 user nova-compute[72418]:       <nova:creationTime>2023-08-09 18:44:58</nova:creationTime>
Aug 09 18:44:59 user nova-compute[72418]:       <nova:flavor name="m1.tiny">
Aug 09 18:44:59 user nova-compute[72418]:         <nova:memory>512</nova:memory>
Aug 09 18:44:59 user nova-compute[72418]:         <nova:disk>1</nova:disk>
Aug 09 18:44:59 user nova-compute[72418]:         <nova:swap>0</nova:swap>
Aug 09 18:44:59 user nova-compute[72418]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 18:44:59 user nova-compute[72418]:         <nova:vcpus>1</nova:vcpus>
Aug 09 18:44:59 user nova-compute[72418]:       </nova:flavor>
Aug 09 18:44:59 user nova-compute[72418]:       <nova:owner>
Aug 09 18:44:59 user nova-compute[72418]:         <nova:user uuid="f6691a938b024ac9abbf81f417065f1b">tempest-AttachVolumeNegativeTest-892551734-project-member</nova:user>
Aug 09 18:44:59 user nova-compute[72418]:         <nova:project uuid="8456a86110d1420c9107c38dd3fad34f">tempest-AttachVolumeNegativeTest-892551734</nova:project>
Aug 09 18:44:59 user nova-compute[72418]:       </nova:owner>
Aug 09 18:44:59 user nova-compute[72418]:       <nova:root type="image" uuid="8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e"/>
Aug 09 18:44:59 user nova-compute[72418]:       <nova:ports>
Aug 09 18:44:59 user nova-compute[72418]:         <nova:port uuid="58621c5a-2cd4-4919-aa44-31b76fed7faf">
Aug 09 18:44:59 user nova-compute[72418]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 18:44:59 user nova-compute[72418]:         </nova:port>
Aug 09 18:44:59 user nova-compute[72418]:       </nova:ports>
Aug 09 18:44:59 user nova-compute[72418]:     </nova:instance>
Aug 09 18:44:59 user nova-compute[72418]:   </metadata>
Aug 09 18:44:59 user nova-compute[72418]:   <sysinfo type="smbios">
Aug 09 18:44:59 user nova-compute[72418]:     <system>
Aug 09 18:44:59 user nova-compute[72418]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 18:44:59 user nova-compute[72418]:       <entry name="product">OpenStack Nova</entry>
Aug 09 18:44:59 user nova-compute[72418]:       <entry name="version">0.0.0</entry>
Aug 09 18:44:59 user nova-compute[72418]:       <entry name="serial">1afce6e7-5362-4cca-a111-61a96f2f5a02</entry>
Aug 09 18:44:59 user nova-compute[72418]:       <entry name="uuid">1afce6e7-5362-4cca-a111-61a96f2f5a02</entry>
Aug 09 18:44:59 user nova-compute[72418]:       <entry name="family">Virtual Machine</entry>
Aug 09 18:44:59 user nova-compute[72418]:     </system>
Aug 09 18:44:59 user nova-compute[72418]:   </sysinfo>
Aug 09 18:44:59 user nova-compute[72418]:   <os>
Aug 09 18:44:59 user nova-compute[72418]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 18:44:59 user nova-compute[72418]:     <boot dev="hd"/>
Aug 09 18:44:59 user nova-compute[72418]:     <smbios mode="sysinfo"/>
Aug 09 18:44:59 user nova-compute[72418]:   </os>
Aug 09 18:44:59 user nova-compute[72418]:   <features>
Aug 09 18:44:59 user nova-compute[72418]:     <acpi/>
Aug 09 18:44:59 user nova-compute[72418]:     <apic/>
Aug 09 18:44:59 user nova-compute[72418]:     <vmcoreinfo/>
Aug 09 18:44:59 user nova-compute[72418]:   </features>
Aug 09 18:44:59 user nova-compute[72418]:   <clock offset="utc">
Aug 09 18:44:59 user nova-compute[72418]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 18:44:59 user nova-compute[72418]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 18:44:59 user nova-compute[72418]:     <timer name="hpet" present="no"/>
Aug 09 18:44:59 user nova-compute[72418]:   </clock>
Aug 09 18:44:59 user nova-compute[72418]:   <cpu mode="custom" match="exact">
Aug 09 18:44:59 user nova-compute[72418]:     <model>Nehalem</model>
Aug 09 18:44:59 user nova-compute[72418]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 18:44:59 user nova-compute[72418]:   </cpu>
Aug 09 18:44:59 user nova-compute[72418]:   <devices>
Aug 09 18:44:59 user nova-compute[72418]:     <disk type="file" device="disk">
Aug 09 18:44:59 user nova-compute[72418]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 18:44:59 user nova-compute[72418]:       <source file="/opt/stack/data/nova/instances/1afce6e7-5362-4cca-a111-61a96f2f5a02/disk"/>
Aug 09 18:44:59 user nova-compute[72418]:       <target dev="vda" bus="virtio"/>
Aug 09 18:44:59 user nova-compute[72418]:     </disk>
Aug 09 18:44:59 user nova-compute[72418]:     <interface type="ethernet">
Aug 09 18:44:59 user nova-compute[72418]:       <mac address="fa:16:3e:00:8d:67"/>
Aug 09 18:44:59 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:44:59 user nova-compute[72418]:       <mtu size="1442"/>
Aug 09 18:44:59 user nova-compute[72418]:       <target dev="tap58621c5a-2c"/>
Aug 09 18:44:59 user nova-compute[72418]:     </interface>
Aug 09 18:44:59 user nova-compute[72418]:     <serial type="pty">
Aug 09 18:44:59 user nova-compute[72418]:       <log file="/opt/stack/data/nova/instances/1afce6e7-5362-4cca-a111-61a96f2f5a02/console.log" append="off"/>
Aug 09 18:44:59 user nova-compute[72418]:     </serial>
Aug 09 18:44:59 user nova-compute[72418]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 18:44:59 user nova-compute[72418]:     <video>
Aug 09 18:44:59 user nova-compute[72418]:       <model type="virtio"/>
Aug 09 18:44:59 user nova-compute[72418]:     </video>
Aug 09 18:44:59 user nova-compute[72418]:     <rng model="virtio">
Aug 09 18:44:59 user nova-compute[72418]:       <backend model="random">/dev/urandom</backend>
Aug 09 18:44:59 user nova-compute[72418]:     </rng>
Aug 09 18:44:59 user nova-compute[72418]:     <controller type="usb" index="0" model="none"/>
Aug 09 18:44:59 user nova-compute[72418]:     <memballoon model="virtio">
Aug 09 18:44:59 user nova-compute[72418]:       <stats period="10"/>
Aug 09 18:44:59 user nova-compute[72418]:     </memballoon>
Aug 09 18:44:59 user nova-compute[72418]:   </devices>
Aug 09 18:44:59 user nova-compute[72418]: </domain>
Aug 09 18:44:59 user nova-compute[72418]:  {{(pid=72418) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 18:44:59 user nova-compute[72418]: DEBUG nova.virt.libvirt.vif [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T18:44:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-124989129',display_name='tempest-AttachVolumeNegativeTest-server-124989129',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-124989129',id=38,image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzNt9BGnRuFniOhrBwg/SYPvWzzGBo9rocd57aaSJQqOJC9kUNQJ62LckbYSapVjvOcYLDSLlKkGbWyZQfpFp5s8VpZEqekTf5ZNAW/qkqvVb1ZJRPHojG/OjVLbODj7g==',key_name='tempest-keypair-100153773',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8456a86110d1420c9107c38dd3fad34f',ramdisk_id='',reservation_id='r-cct36q4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bc4d8e0-34d6-4e03-9f63-03d8c69aae2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-892551734',owner_user_name='tempest-AttachVolumeNegativeTest-892551734-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T18:44:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6691a938b024ac9abbf81f417065f1b',uuid=1afce6e7-5362-4cca-a111-61a96f2f5a02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58621c5a-2cd4-4919-aa44-31b76fed7faf", "address": "fa:16:3e:00:8d:67", "network": {"id": "c525572b-cf59-4359-88c8-cef227847c3c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2043600619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8456a86110d1420c9107c38dd3fad34f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58621c5a-2c", "ovs_interfaceid": "58621c5a-2cd4-4919-aa44-31b76fed7faf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 18:44:59 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Converting VIF {"id": "58621c5a-2cd4-4919-aa44-31b76fed7faf", "address": "fa:16:3e:00:8d:67", "network": {"id": "c525572b-cf59-4359-88c8-cef227847c3c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2043600619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8456a86110d1420c9107c38dd3fad34f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58621c5a-2c", "ovs_interfaceid": "58621c5a-2cd4-4919-aa44-31b76fed7faf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 18:44:59 user nova-compute[72418]: DEBUG nova.network.os_vif_util [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:8d:67,bridge_name='br-int',has_traffic_filtering=True,id=58621c5a-2cd4-4919-aa44-31b76fed7faf,network=Network(c525572b-cf59-4359-88c8-cef227847c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58621c5a-2c') {{(pid=72418) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 18:44:59 user nova-compute[72418]: DEBUG os_vif [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:8d:67,bridge_name='br-int',has_traffic_filtering=True,id=58621c5a-2cd4-4919-aa44-31b76fed7faf,network=Network(c525572b-cf59-4359-88c8-cef227847c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58621c5a-2c') {{(pid=72418) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 18:44:59 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:44:59 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:44:59 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 18:44:59 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:44:59 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap58621c5a-2c, may_exist=True, interface_attrs={}) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:44:59 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap58621c5a-2c, col_values=(('external_ids', {'iface-id': '58621c5a-2cd4-4919-aa44-31b76fed7faf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:8d:67', 'vm-uuid': '1afce6e7-5362-4cca-a111-61a96f2f5a02'}),), if_exists=True) {{(pid=72418) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 18:44:59 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:44:59 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:44:59 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:44:59 user nova-compute[72418]: INFO os_vif [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:8d:67,bridge_name='br-int',has_traffic_filtering=True,id=58621c5a-2cd4-4919-aa44-31b76fed7faf,network=Network(c525572b-cf59-4359-88c8-cef227847c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58621c5a-2c')
Aug 09 18:44:59 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:44:59 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] No VIF found with MAC fa:16:3e:00:8d:67, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:44:59 user nova-compute[72418]: DEBUG nova.network.neutron [req-0b2b3400-273a-4e63-9c77-255732159b31 req-6f7cd7b1-a09f-40dd-8abc-c7d4e9cd850b service nova] [instance: 1afce6e7-5362-4cca-a111-61a96f2f5a02] Updated VIF entry in instance network info cache for port 58621c5a-2cd4-4919-aa44-31b76fed7faf. {{(pid=72418) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 18:44:59 user nova-compute[72418]: DEBUG nova.network.neutron [req-0b2b3400-273a-4e63-9c77-255732159b31 req-6f7cd7b1-a09f-40dd-8abc-c7d4e9cd850b service nova] [instance: 1afce6e7-5362-4cca-a111-61a96f2f5a02] Updating instance_info_cache with network_info: [{"id": "58621c5a-2cd4-4919-aa44-31b76fed7faf", "address": "fa:16:3e:00:8d:67", "network": {"id": "c525572b-cf59-4359-88c8-cef227847c3c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2043600619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8456a86110d1420c9107c38dd3fad34f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58621c5a-2c", "ovs_interfaceid": "58621c5a-2cd4-4919-aa44-31b76fed7faf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:44:59 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-0b2b3400-273a-4e63-9c77-255732159b31 req-6f7cd7b1-a09f-40dd-8abc-c7d4e9cd850b service nova] Releasing lock "refresh_cache-1afce6e7-5362-4cca-a111-61a96f2f5a02" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:45:00 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:45:00 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:45:00 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:45:00 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:45:00 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:45:00 user nova-compute[72418]: DEBUG nova.compute.manager [req-0f7c9176-13a9-4a49-9ae0-f40ae97b0ee7 req-f76b3c60-b639-444e-ab10-05074ce1dc2c service nova] [instance: 1afce6e7-5362-4cca-a111-61a96f2f5a02] Received event network-vif-plugged-58621c5a-2cd4-4919-aa44-31b76fed7faf {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:45:00 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-0f7c9176-13a9-4a49-9ae0-f40ae97b0ee7 req-f76b3c60-b639-444e-ab10-05074ce1dc2c service nova] Acquiring lock "1afce6e7-5362-4cca-a111-61a96f2f5a02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:45:00 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-0f7c9176-13a9-4a49-9ae0-f40ae97b0ee7 req-f76b3c60-b639-444e-ab10-05074ce1dc2c service nova] Lock "1afce6e7-5362-4cca-a111-61a96f2f5a02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:45:00 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-0f7c9176-13a9-4a49-9ae0-f40ae97b0ee7 req-f76b3c60-b639-444e-ab10-05074ce1dc2c service nova] Lock "1afce6e7-5362-4cca-a111-61a96f2f5a02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:45:00 user nova-compute[72418]: DEBUG nova.compute.manager [req-0f7c9176-13a9-4a49-9ae0-f40ae97b0ee7 req-f76b3c60-b639-444e-ab10-05074ce1dc2c service nova] [instance: 1afce6e7-5362-4cca-a111-61a96f2f5a02] No waiting events found dispatching network-vif-plugged-58621c5a-2cd4-4919-aa44-31b76fed7faf {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:45:00 user nova-compute[72418]: WARNING nova.compute.manager [req-0f7c9176-13a9-4a49-9ae0-f40ae97b0ee7 req-f76b3c60-b639-444e-ab10-05074ce1dc2c service nova] [instance: 1afce6e7-5362-4cca-a111-61a96f2f5a02] Received unexpected event network-vif-plugged-58621c5a-2cd4-4919-aa44-31b76fed7faf for instance with vm_state building and task_state spawning.
Aug 09 18:45:02 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691606702.8877952, 1afce6e7-5362-4cca-a111-61a96f2f5a02 => Resumed> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:45:02 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 1afce6e7-5362-4cca-a111-61a96f2f5a02] VM Resumed (Lifecycle Event)
Aug 09 18:45:02 user nova-compute[72418]: DEBUG nova.compute.manager [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 1afce6e7-5362-4cca-a111-61a96f2f5a02] Instance event wait completed in 0 seconds for  {{(pid=72418) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 18:45:02 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 1afce6e7-5362-4cca-a111-61a96f2f5a02] Guest created on hypervisor {{(pid=72418) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 18:45:02 user nova-compute[72418]: INFO nova.virt.libvirt.driver [-] [instance: 1afce6e7-5362-4cca-a111-61a96f2f5a02] Instance spawned successfully.
Aug 09 18:45:02 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 1afce6e7-5362-4cca-a111-61a96f2f5a02] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 18:45:02 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 1afce6e7-5362-4cca-a111-61a96f2f5a02] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:45:02 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 1afce6e7-5362-4cca-a111-61a96f2f5a02] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:45:02 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 1afce6e7-5362-4cca-a111-61a96f2f5a02] Found default for hw_cdrom_bus of ide {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:45:02 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 1afce6e7-5362-4cca-a111-61a96f2f5a02] Found default for hw_disk_bus of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:45:02 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 1afce6e7-5362-4cca-a111-61a96f2f5a02] Found default for hw_input_bus of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:45:02 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 1afce6e7-5362-4cca-a111-61a96f2f5a02] Found default for hw_pointer_model of None {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:45:02 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 1afce6e7-5362-4cca-a111-61a96f2f5a02] Found default for hw_video_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:45:02 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 1afce6e7-5362-4cca-a111-61a96f2f5a02] Found default for hw_vif_model of virtio {{(pid=72418) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 18:45:02 user nova-compute[72418]: DEBUG nova.compute.manager [req-42d994a4-8d22-41f2-aa55-29a783d47794 req-639657e4-6290-4e53-9f14-9373a124d37b service nova] [instance: 1afce6e7-5362-4cca-a111-61a96f2f5a02] Received event network-vif-plugged-58621c5a-2cd4-4919-aa44-31b76fed7faf {{(pid=72418) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 18:45:02 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-42d994a4-8d22-41f2-aa55-29a783d47794 req-639657e4-6290-4e53-9f14-9373a124d37b service nova] Acquiring lock "1afce6e7-5362-4cca-a111-61a96f2f5a02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:45:02 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-42d994a4-8d22-41f2-aa55-29a783d47794 req-639657e4-6290-4e53-9f14-9373a124d37b service nova] Lock "1afce6e7-5362-4cca-a111-61a96f2f5a02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:45:02 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [req-42d994a4-8d22-41f2-aa55-29a783d47794 req-639657e4-6290-4e53-9f14-9373a124d37b service nova] Lock "1afce6e7-5362-4cca-a111-61a96f2f5a02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:45:02 user nova-compute[72418]: DEBUG nova.compute.manager [req-42d994a4-8d22-41f2-aa55-29a783d47794 req-639657e4-6290-4e53-9f14-9373a124d37b service nova] [instance: 1afce6e7-5362-4cca-a111-61a96f2f5a02] No waiting events found dispatching network-vif-plugged-58621c5a-2cd4-4919-aa44-31b76fed7faf {{(pid=72418) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 18:45:02 user nova-compute[72418]: WARNING nova.compute.manager [req-42d994a4-8d22-41f2-aa55-29a783d47794 req-639657e4-6290-4e53-9f14-9373a124d37b service nova] [instance: 1afce6e7-5362-4cca-a111-61a96f2f5a02] Received unexpected event network-vif-plugged-58621c5a-2cd4-4919-aa44-31b76fed7faf for instance with vm_state building and task_state spawning.
Aug 09 18:45:02 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 1afce6e7-5362-4cca-a111-61a96f2f5a02] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:45:02 user nova-compute[72418]: DEBUG nova.virt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Emitting event <LifecycleEvent: 1691606702.8914394, 1afce6e7-5362-4cca-a111-61a96f2f5a02 => Started> {{(pid=72418) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 18:45:02 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 1afce6e7-5362-4cca-a111-61a96f2f5a02] VM Started (Lifecycle Event)
Aug 09 18:45:02 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 1afce6e7-5362-4cca-a111-61a96f2f5a02] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:45:03 user nova-compute[72418]: DEBUG nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 1afce6e7-5362-4cca-a111-61a96f2f5a02] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72418) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 18:45:03 user nova-compute[72418]: INFO nova.compute.manager [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 1afce6e7-5362-4cca-a111-61a96f2f5a02] Took 5.94 seconds to spawn the instance on the hypervisor.
Aug 09 18:45:03 user nova-compute[72418]: DEBUG nova.compute.manager [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 1afce6e7-5362-4cca-a111-61a96f2f5a02] Checking state {{(pid=72418) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 18:45:03 user nova-compute[72418]: INFO nova.compute.manager [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] [instance: 1afce6e7-5362-4cca-a111-61a96f2f5a02] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 18:45:03 user nova-compute[72418]: INFO nova.compute.manager [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] [instance: 1afce6e7-5362-4cca-a111-61a96f2f5a02] Took 6.59 seconds to build instance.
Aug 09 18:45:03 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-732453d1-565f-44cc-8ebf-fda4e98050b2 tempest-AttachVolumeNegativeTest-892551734 tempest-AttachVolumeNegativeTest-892551734-project-member] Lock "1afce6e7-5362-4cca-a111-61a96f2f5a02" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.678s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:45:03 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:45:04 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:45:04 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-319ea8a3-41bc-4cbe-ab2a-b17ae68e7b45 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Calling os-brick to attach iSCSI Volume {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 18:45:04 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-319ea8a3-41bc-4cbe-ab2a-b17ae68e7b45 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:88e1318c-40fe-4f6f-a988-5fe9dc2875a8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QOWdIoJm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:45:04 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-319ea8a3-41bc-4cbe-ab2a-b17ae68e7b45 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:45:04 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-319ea8a3-41bc-4cbe-ab2a-b17ae68e7b45 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:45:04 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-319ea8a3-41bc-4cbe-ab2a-b17ae68e7b45 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:45:04 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-319ea8a3-41bc-4cbe-ab2a-b17ae68e7b45 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:45:04 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-319ea8a3-41bc-4cbe-ab2a-b17ae68e7b45 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88e1318c-40fe-4f6f-a988-5fe9dc2875a8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:45:04 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-319ea8a3-41bc-4cbe-ab2a-b17ae68e7b45 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88e1318c-40fe-4f6f-a988-5fe9dc2875a8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:45:04 user nova-compute[72418]: INFO os_brick.initiator.connectors.iscsi [None req-319ea8a3-41bc-4cbe-ab2a-b17ae68e7b45 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 18:45:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88e1318c-40fe-4f6f-a988-5fe9dc2875a8 -p 172.16.0.220:3260 {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:45:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88e1318c-40fe-4f6f-a988-5fe9dc2875a8 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:45:04 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[546014b0-8638-40e9-aaad-c5c8bc4fbb8c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:45:04 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-319ea8a3-41bc-4cbe-ab2a-b17ae68e7b45 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 18:45:04 user nova-compute[72418]:  {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:45:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88e1318c-40fe-4f6f-a988-5fe9dc2875a8 -p 172.16.0.220:3260 --interface default --op new {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:45:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88e1318c-40fe-4f6f-a988-5fe9dc2875a8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.035s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:45:04 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6443c7-e94e-44f0-b1dc-86ac2233dcc2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88e1318c-40fe-4f6f-a988-5fe9dc2875a8] added\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:45:04 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-319ea8a3-41bc-4cbe-ab2a-b17ae68e7b45 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88e1318c-40fe-4f6f-a988-5fe9dc2875a8] added
Aug 09 18:45:04 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:45:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88e1318c-40fe-4f6f-a988-5fe9dc2875a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:45:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88e1318c-40fe-4f6f-a988-5fe9dc2875a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:45:04 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe3df1c-4174-4201-a62e-1dbcf8d174d0]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:45:04 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-319ea8a3-41bc-4cbe-ab2a-b17ae68e7b45 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:45:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88e1318c-40fe-4f6f-a988-5fe9dc2875a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:45:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88e1318c-40fe-4f6f-a988-5fe9dc2875a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:45:04 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b177430-2088-4df7-a448-cc49b0f8bb21]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:45:04 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-319ea8a3-41bc-4cbe-ab2a-b17ae68e7b45 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:45:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88e1318c-40fe-4f6f-a988-5fe9dc2875a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QOWdIoJm {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:45:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88e1318c-40fe-4f6f-a988-5fe9dc2875a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QOWdIoJm" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:45:04 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[735afe94-7e75-4c73-ab25-623fcb8d9dd0]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:45:04 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-319ea8a3-41bc-4cbe-ab2a-b17ae68e7b45 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QOWdIoJm'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:45:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88e1318c-40fe-4f6f-a988-5fe9dc2875a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:45:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88e1318c-40fe-4f6f-a988-5fe9dc2875a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:45:04 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[654454e3-d9a7-4381-b77a-5723ce279666]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:45:04 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-319ea8a3-41bc-4cbe-ab2a-b17ae68e7b45 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:45:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:45:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:45:04 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a64994a-81b7-432c-9db5-4345afcadbc7]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b89d3fe-0150-48ad-ba71-927d3d2207b5 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:45:04 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-319ea8a3-41bc-4cbe-ab2a-b17ae68e7b45 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d (non-flash)
Aug 09 18:45:04 user nova-compute[72418]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768 (non-flash)
Aug 09 18:45:04 user nova-compute[72418]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b89d3fe-0150-48ad-ba71-927d3d2207b5 (non-flash)
Aug 09 18:45:04 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:45:04 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-319ea8a3-41bc-4cbe-ab2a-b17ae68e7b45 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d (non-flash)
Aug 09 18:45:04 user nova-compute[72418]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768 (non-flash)
Aug 09 18:45:04 user nova-compute[72418]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b89d3fe-0150-48ad-ba71-927d3d2207b5 (non-flash)
Aug 09 18:45:04 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:45:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88e1318c-40fe-4f6f-a988-5fe9dc2875a8 -p 172.16.0.220:3260 --login {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:45:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88e1318c-40fe-4f6f-a988-5fe9dc2875a8 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:45:04 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e64ef74-d4a9-476d-9367-c69325997cc9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:88e1318c-40fe-4f6f-a988-5fe9dc2875a8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:88e1318c-40fe-4f6f-a988-5fe9dc2875a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:45:04 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-319ea8a3-41bc-4cbe-ab2a-b17ae68e7b45 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:88e1318c-40fe-4f6f-a988-5fe9dc2875a8, portal: 172.16.0.220,3260]
Aug 09 18:45:04 user nova-compute[72418]: Login to [iface: default, target: iqn.2010-10.org.openstack:88e1318c-40fe-4f6f-a988-5fe9dc2875a8, portal: 172.16.0.220,3260] successful.
Aug 09 18:45:04 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:45:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88e1318c-40fe-4f6f-a988-5fe9dc2875a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:45:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88e1318c-40fe-4f6f-a988-5fe9dc2875a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:45:04 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c3f2ec-1df6-4b11-bdea-3268aef1f396]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:45:04 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-319ea8a3-41bc-4cbe-ab2a-b17ae68e7b45 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:45:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:45:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:45:04 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7709fe-05c8-41c3-971c-68c9e2711e4a]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b89d3fe-0150-48ad-ba71-927d3d2207b5 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88e1318c-40fe-4f6f-a988-5fe9dc2875a8 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:45:04 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-319ea8a3-41bc-4cbe-ab2a-b17ae68e7b45 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d (non-flash)
Aug 09 18:45:04 user nova-compute[72418]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768 (non-flash)
Aug 09 18:45:04 user nova-compute[72418]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b89d3fe-0150-48ad-ba71-927d3d2207b5 (non-flash)
Aug 09 18:45:04 user nova-compute[72418]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88e1318c-40fe-4f6f-a988-5fe9dc2875a8 (non-flash)
Aug 09 18:45:04 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:45:04 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-319ea8a3-41bc-4cbe-ab2a-b17ae68e7b45 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d (non-flash)
Aug 09 18:45:04 user nova-compute[72418]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768 (non-flash)
Aug 09 18:45:04 user nova-compute[72418]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b89d3fe-0150-48ad-ba71-927d3d2207b5 (non-flash)
Aug 09 18:45:04 user nova-compute[72418]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88e1318c-40fe-4f6f-a988-5fe9dc2875a8 (non-flash)
Aug 09 18:45:04 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:45:04 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-319ea8a3-41bc-4cbe-ab2a-b17ae68e7b45 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88e1318c-40fe-4f6f-a988-5fe9dc2875a8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:45:04 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-319ea8a3-41bc-4cbe-ab2a-b17ae68e7b45 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Connected to 172.16.0.220:3260 {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 18:45:04 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-319ea8a3-41bc-4cbe-ab2a-b17ae68e7b45 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] HCTL ('36', '-', '-', 0) found on session 43 with lun 0 {{(pid=72418) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 18:45:04 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-319ea8a3-41bc-4cbe-ab2a-b17ae68e7b45 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72418) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 18:45:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:45:04 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:45:04 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb24274-5d0d-4e11-a0fe-f1f174ba5b43]: (4, ('- - 0', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:45:04 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-319ea8a3-41bc-4cbe-ab2a-b17ae68e7b45 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Searching for a device in session 43 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72418) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 18:45:04 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-319ea8a3-41bc-4cbe-ab2a-b17ae68e7b45 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QOWdIoJm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72418) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 18:45:05 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:45:05 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:45:05 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:45:05 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72418) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 18:45:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-319ea8a3-41bc-4cbe-ab2a-b17ae68e7b45 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:45:05 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-319ea8a3-41bc-4cbe-ab2a-b17ae68e7b45 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '26361363135336134', 'path': '/dev/sde'} {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:45:05 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-319ea8a3-41bc-4cbe-ab2a-b17ae68e7b45 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361363135336134', 'path': '/dev/sde'} {{(pid=72418) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 18:45:05 user nova-compute[72418]: DEBUG nova.objects.instance [None req-319ea8a3-41bc-4cbe-ab2a-b17ae68e7b45 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Lazy-loading 'flavor' on Instance uuid a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:45:05 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-319ea8a3-41bc-4cbe-ab2a-b17ae68e7b45 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 18:45:05 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:45:05 user nova-compute[72418]:   <source dev="/dev/sde"/>
Aug 09 18:45:05 user nova-compute[72418]:   <target dev="vdc" bus="virtio"/>
Aug 09 18:45:05 user nova-compute[72418]:   <serial>88e1318c-40fe-4f6f-a988-5fe9dc2875a8</serial>
Aug 09 18:45:05 user nova-compute[72418]: </disk>
Aug 09 18:45:05 user nova-compute[72418]:  {{(pid=72418) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 18:45:05 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:45:05 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Starting heal instance info cache {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 18:45:05 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Didn't find any instances for network info cache update. {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 18:45:05 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:45:05 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:45:06 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-319ea8a3-41bc-4cbe-ab2a-b17ae68e7b45 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] No BDM found with device name vda, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:45:06 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-319ea8a3-41bc-4cbe-ab2a-b17ae68e7b45 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:45:06 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-319ea8a3-41bc-4cbe-ab2a-b17ae68e7b45 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72418) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 18:45:06 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-319ea8a3-41bc-4cbe-ab2a-b17ae68e7b45 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] No VIF found with MAC fa:16:3e:ae:d6:b4, not building metadata {{(pid=72418) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 18:45:06 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-319ea8a3-41bc-4cbe-ab2a-b17ae68e7b45 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Lock "a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.351s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:45:07 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-2eb15bd4-04d4-4a02-a9e6-5ffb9b29bfaf tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Acquiring lock "a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:45:07 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-2eb15bd4-04d4-4a02-a9e6-5ffb9b29bfaf tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Lock "a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:45:07 user nova-compute[72418]: INFO nova.compute.manager [None req-2eb15bd4-04d4-4a02-a9e6-5ffb9b29bfaf tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Detaching volume 88e1318c-40fe-4f6f-a988-5fe9dc2875a8
Aug 09 18:45:07 user nova-compute[72418]: INFO nova.virt.block_device [None req-2eb15bd4-04d4-4a02-a9e6-5ffb9b29bfaf tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Attempting to driver detach volume 88e1318c-40fe-4f6f-a988-5fe9dc2875a8 from mountpoint /dev/vdc
Aug 09 18:45:07 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-2eb15bd4-04d4-4a02-a9e6-5ffb9b29bfaf tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Attempting to detach device vdc from instance a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507 from the persistent domain config. {{(pid=72418) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 18:45:07 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-2eb15bd4-04d4-4a02-a9e6-5ffb9b29bfaf tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 18:45:07 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:45:07 user nova-compute[72418]:   <source dev="/dev/sde"/>
Aug 09 18:45:07 user nova-compute[72418]:   <target dev="vdc" bus="virtio"/>
Aug 09 18:45:07 user nova-compute[72418]:   <serial>88e1318c-40fe-4f6f-a988-5fe9dc2875a8</serial>
Aug 09 18:45:07 user nova-compute[72418]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 09 18:45:07 user nova-compute[72418]: </disk>
Aug 09 18:45:07 user nova-compute[72418]:  {{(pid=72418) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 18:45:07 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-2eb15bd4-04d4-4a02-a9e6-5ffb9b29bfaf tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Successfully detached device vdc from instance a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507 from the persistent domain config.
Aug 09 18:45:07 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-2eb15bd4-04d4-4a02-a9e6-5ffb9b29bfaf tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507 from the live domain config. {{(pid=72418) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 18:45:07 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-2eb15bd4-04d4-4a02-a9e6-5ffb9b29bfaf tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 18:45:07 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:45:07 user nova-compute[72418]:   <source dev="/dev/sde"/>
Aug 09 18:45:07 user nova-compute[72418]:   <target dev="vdc" bus="virtio"/>
Aug 09 18:45:07 user nova-compute[72418]:   <serial>88e1318c-40fe-4f6f-a988-5fe9dc2875a8</serial>
Aug 09 18:45:07 user nova-compute[72418]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 09 18:45:07 user nova-compute[72418]: </disk>
Aug 09 18:45:07 user nova-compute[72418]:  {{(pid=72418) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 18:45:07 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Received event <DeviceRemovedEvent: 1691606707.9348726, a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72418) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 18:45:07 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:45:07 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-2eb15bd4-04d4-4a02-a9e6-5ffb9b29bfaf tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507 {{(pid=72418) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 18:45:07 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-2eb15bd4-04d4-4a02-a9e6-5ffb9b29bfaf tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Successfully detached device vdc from instance a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507 from the live domain config.
Aug 09 18:45:07 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2eb15bd4-04d4-4a02-a9e6-5ffb9b29bfaf tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] calling os-brick to detach iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 18:45:07 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb15bd4-04d4-4a02-a9e6-5ffb9b29bfaf tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, {'target_iqns': ['iqn.2010-10.org.openstack:88e1318c-40fe-4f6f-a988-5fe9dc2875a8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QOWdIoJm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:45:07 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-2eb15bd4-04d4-4a02-a9e6-5ffb9b29bfaf tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:45:07 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-2eb15bd4-04d4-4a02-a9e6-5ffb9b29bfaf tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:45:07 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-2eb15bd4-04d4-4a02-a9e6-5ffb9b29bfaf tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:45:07 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb15bd4-04d4-4a02-a9e6-5ffb9b29bfaf tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88e1318c-40fe-4f6f-a988-5fe9dc2875a8', 0)] {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 18:45:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:45:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:45:07 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb319a2e-d3a2-4df1-842b-96394ee2b1b6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b89d3fe-0150-48ad-ba71-927d3d2207b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88e1318c-40fe-4f6f-a988-5fe9dc2875a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:45:07 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:45:08 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:45:08 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd703e1-7357-4625-92df-a85dd0dd221f]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b89d3fe-0150-48ad-ba71-927d3d2207b5 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88e1318c-40fe-4f6f-a988-5fe9dc2875a8 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:45:08 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb15bd4-04d4-4a02-a9e6-5ffb9b29bfaf tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d (non-flash)
Aug 09 18:45:08 user nova-compute[72418]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768 (non-flash)
Aug 09 18:45:08 user nova-compute[72418]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b89d3fe-0150-48ad-ba71-927d3d2207b5 (non-flash)
Aug 09 18:45:08 user nova-compute[72418]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88e1318c-40fe-4f6f-a988-5fe9dc2875a8 (non-flash)
Aug 09 18:45:08 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:45:08 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb15bd4-04d4-4a02-a9e6-5ffb9b29bfaf tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d (non-flash)
Aug 09 18:45:08 user nova-compute[72418]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768 (non-flash)
Aug 09 18:45:08 user nova-compute[72418]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b89d3fe-0150-48ad-ba71-927d3d2207b5 (non-flash)
Aug 09 18:45:08 user nova-compute[72418]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88e1318c-40fe-4f6f-a988-5fe9dc2875a8 (non-flash)
Aug 09 18:45:08 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:45:08 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb15bd4-04d4-4a02-a9e6-5ffb9b29bfaf tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f42f859dd80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88e1318c-40fe-4f6f-a988-5fe9dc2875a8'): ({'sde'}, set())}) {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 18:45:08 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-2eb15bd4-04d4-4a02-a9e6-5ffb9b29bfaf tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Removing single pathed devices sde {{(pid=72418) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 18:45:08 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:45:08 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:45:08 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6f3684-5e15-4bd1-ba93-4aa434eaf780]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:45:08 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:45:08 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:45:08 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[df67a92d-34e9-43b3-9185-80df5a3611ce]: (4, ('ok\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:45:08 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-2eb15bd4-04d4-4a02-a9e6-5ffb9b29bfaf tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Flushing IO for device /dev/sde {{(pid=72418) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 18:45:08 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:45:08 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:45:08 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe4912b-3f2f-4c8d-9167-d73e5f617937]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:45:08 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-2eb15bd4-04d4-4a02-a9e6-5ffb9b29bfaf tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72418) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 18:45:08 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:45:08 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:45:08 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e30bd5-6626-4ddc-b63e-47a8a99a0e79]: (4, ('1', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:45:08 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-2eb15bd4-04d4-4a02-a9e6-5ffb9b29bfaf tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 18:45:08 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-2eb15bd4-04d4-4a02-a9e6-5ffb9b29bfaf tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] SCSI volumes sde have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 18:45:08 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb15bd4-04d4-4a02-a9e6-5ffb9b29bfaf tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88e1318c-40fe-4f6f-a988-5fe9dc2875a8')] {{(pid=72418) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 18:45:08 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88e1318c-40fe-4f6f-a988-5fe9dc2875a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:45:08 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88e1318c-40fe-4f6f-a988-5fe9dc2875a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:45:08 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df9fd81-1979-49cd-81ef-5f86ecdc4c8f]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:45:08 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb15bd4-04d4-4a02-a9e6-5ffb9b29bfaf tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:45:08 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88e1318c-40fe-4f6f-a988-5fe9dc2875a8 -p 172.16.0.220:3260 --logout {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:45:08 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88e1318c-40fe-4f6f-a988-5fe9dc2875a8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:45:08 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e78e00-0e37-44ba-8ada-a9bf995bdd21]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:88e1318c-40fe-4f6f-a988-5fe9dc2875a8, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:88e1318c-40fe-4f6f-a988-5fe9dc2875a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:45:08 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb15bd4-04d4-4a02-a9e6-5ffb9b29bfaf tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:88e1318c-40fe-4f6f-a988-5fe9dc2875a8, portal: 172.16.0.220,3260]
Aug 09 18:45:08 user nova-compute[72418]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:88e1318c-40fe-4f6f-a988-5fe9dc2875a8, portal: 172.16.0.220,3260] successful.
Aug 09 18:45:08 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:45:08 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88e1318c-40fe-4f6f-a988-5fe9dc2875a8 -p 172.16.0.220:3260 --op delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:45:08 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88e1318c-40fe-4f6f-a988-5fe9dc2875a8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:45:08 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d57038-3471-4e49-a256-7b2cce3b0c88]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:45:08 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb15bd4-04d4-4a02-a9e6-5ffb9b29bfaf tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:45:08 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-2eb15bd4-04d4-4a02-a9e6-5ffb9b29bfaf tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:45:08 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eb15bd4-04d4-4a02-a9e6-5ffb9b29bfaf tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] <== disconnect_volume: return (322ms) None {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:45:08 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2eb15bd4-04d4-4a02-a9e6-5ffb9b29bfaf tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Disconnected iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 18:45:08 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:45:08 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:45:08 user nova-compute[72418]: DEBUG nova.objects.instance [None req-2eb15bd4-04d4-4a02-a9e6-5ffb9b29bfaf tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Lazy-loading 'flavor' on Instance uuid a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:45:09 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:45:09 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-2eb15bd4-04d4-4a02-a9e6-5ffb9b29bfaf tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Lock "a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.698s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:45:12 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:45:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:45:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:45:12 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:45:12 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Auditing locally available compute resources for user (node: user) {{(pid=72418) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 18:45:13 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:45:13 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:45:13 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:45:13 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:45:13 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:45:13 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:45:13 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:45:13 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:45:13 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:45:13 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:45:13 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:45:13 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc488d1e-bc21-4041-99ad-222588c9b34f/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:45:13 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc488d1e-bc21-4041-99ad-222588c9b34f/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:45:13 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc488d1e-bc21-4041-99ad-222588c9b34f/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:45:13 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc488d1e-bc21-4041-99ad-222588c9b34f/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:45:13 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1afce6e7-5362-4cca-a111-61a96f2f5a02/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:45:14 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:45:14 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1afce6e7-5362-4cca-a111-61a96f2f5a02/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:45:14 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1afce6e7-5362-4cca-a111-61a96f2f5a02/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:45:14 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1afce6e7-5362-4cca-a111-61a96f2f5a02/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:45:14 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f917dfe-409a-474f-9dbb-edbf0eea7871/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:45:14 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f917dfe-409a-474f-9dbb-edbf0eea7871/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:45:14 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f917dfe-409a-474f-9dbb-edbf0eea7871/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:45:14 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f917dfe-409a-474f-9dbb-edbf0eea7871/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:45:14 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:45:14 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:45:14 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:45:14 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Hypervisor/Node resource view: name=user free_ram=8128MB free_disk=25.470924377441406GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72418) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 18:45:14 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:45:14 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:45:15 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 0f917dfe-409a-474f-9dbb-edbf0eea7871 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:45:15 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:45:15 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:45:15 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance fc488d1e-bc21-4041-99ad-222588c9b34f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:45:15 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 1afce6e7-5362-4cca-a111-61a96f2f5a02 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:45:15 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 18:45:15 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 18:45:15 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:45:15 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:45:15 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Compute_service record updated for user:user {{(pid=72418) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 18:45:15 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.314s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:45:18 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:45:19 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:45:23 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:45:24 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:45:28 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:45:29 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:45:33 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:45:34 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:45:39 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:45:43 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:45:44 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:45:44 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d6312bd9-5f20-49fa-9c83-e5fdae252fe1 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Acquiring lock "2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:45:44 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d6312bd9-5f20-49fa-9c83-e5fdae252fe1 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Lock "2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:45:44 user nova-compute[72418]: INFO nova.compute.manager [None req-d6312bd9-5f20-49fa-9c83-e5fdae252fe1 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Detaching volume a9bc0826-cec0-488c-867c-a19085b5cb4d
Aug 09 18:45:44 user nova-compute[72418]: INFO nova.virt.block_device [None req-d6312bd9-5f20-49fa-9c83-e5fdae252fe1 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Attempting to driver detach volume a9bc0826-cec0-488c-867c-a19085b5cb4d from mountpoint /dev/vdc
Aug 09 18:45:44 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-d6312bd9-5f20-49fa-9c83-e5fdae252fe1 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Attempting to detach device vdc from instance 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c from the persistent domain config. {{(pid=72418) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 18:45:44 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-d6312bd9-5f20-49fa-9c83-e5fdae252fe1 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 18:45:44 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:45:44 user nova-compute[72418]:   <source dev="/dev/sdb"/>
Aug 09 18:45:44 user nova-compute[72418]:   <target dev="vdc" bus="virtio"/>
Aug 09 18:45:44 user nova-compute[72418]:   <serial>a9bc0826-cec0-488c-867c-a19085b5cb4d</serial>
Aug 09 18:45:44 user nova-compute[72418]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 18:45:44 user nova-compute[72418]: </disk>
Aug 09 18:45:44 user nova-compute[72418]:  {{(pid=72418) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 18:45:44 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-d6312bd9-5f20-49fa-9c83-e5fdae252fe1 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Successfully detached device vdc from instance 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c from the persistent domain config.
Aug 09 18:45:44 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-d6312bd9-5f20-49fa-9c83-e5fdae252fe1 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c from the live domain config. {{(pid=72418) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 18:45:44 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-d6312bd9-5f20-49fa-9c83-e5fdae252fe1 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 18:45:44 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:45:44 user nova-compute[72418]:   <source dev="/dev/sdb"/>
Aug 09 18:45:44 user nova-compute[72418]:   <target dev="vdc" bus="virtio"/>
Aug 09 18:45:44 user nova-compute[72418]:   <serial>a9bc0826-cec0-488c-867c-a19085b5cb4d</serial>
Aug 09 18:45:44 user nova-compute[72418]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 18:45:44 user nova-compute[72418]: </disk>
Aug 09 18:45:44 user nova-compute[72418]:  {{(pid=72418) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 18:45:44 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Received event <DeviceRemovedEvent: 1691606744.7892802, 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72418) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 18:45:44 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-d6312bd9-5f20-49fa-9c83-e5fdae252fe1 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c {{(pid=72418) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 18:45:44 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-d6312bd9-5f20-49fa-9c83-e5fdae252fe1 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Successfully detached device vdc from instance 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c from the live domain config.
Aug 09 18:45:44 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6312bd9-5f20-49fa-9c83-e5fdae252fe1 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] calling os-brick to detach iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 18:45:44 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6312bd9-5f20-49fa-9c83-e5fdae252fe1 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, {'target_iqns': ['iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SCAjxtsi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:45:44 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-d6312bd9-5f20-49fa-9c83-e5fdae252fe1 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:45:44 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-d6312bd9-5f20-49fa-9c83-e5fdae252fe1 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:45:44 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-d6312bd9-5f20-49fa-9c83-e5fdae252fe1 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:45:44 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6312bd9-5f20-49fa-9c83-e5fdae252fe1 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d', 0)] {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 18:45:44 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:45:44 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:45:44 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde54dbc-8c9a-41ca-af42-2542e77df8cb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b89d3fe-0150-48ad-ba71-927d3d2207b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:45:44 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:45:44 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:45:44 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb3340a-569b-4c19-ba48-e20a0d549c4c]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b89d3fe-0150-48ad-ba71-927d3d2207b5 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:45:44 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6312bd9-5f20-49fa-9c83-e5fdae252fe1 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d (non-flash)
Aug 09 18:45:44 user nova-compute[72418]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768 (non-flash)
Aug 09 18:45:44 user nova-compute[72418]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b89d3fe-0150-48ad-ba71-927d3d2207b5 (non-flash)
Aug 09 18:45:44 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:45:44 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6312bd9-5f20-49fa-9c83-e5fdae252fe1 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d (non-flash)
Aug 09 18:45:44 user nova-compute[72418]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768 (non-flash)
Aug 09 18:45:44 user nova-compute[72418]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b89d3fe-0150-48ad-ba71-927d3d2207b5 (non-flash)
Aug 09 18:45:44 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:45:44 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6312bd9-5f20-49fa-9c83-e5fdae252fe1 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f43002dcc10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d'): ({'sdb'}, set())}) {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 18:45:44 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-d6312bd9-5f20-49fa-9c83-e5fdae252fe1 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Removing single pathed devices sdb {{(pid=72418) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 18:45:44 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:45:44 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:45:44 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[5931e295-42bc-4702-9e36-096ec5ef7942]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:45:44 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:45:44 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:45:44 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea57015-3d1d-4c19-887f-27fddab2b476]: (4, ('ok\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:45:44 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-d6312bd9-5f20-49fa-9c83-e5fdae252fe1 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Flushing IO for device /dev/sdb {{(pid=72418) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 18:45:44 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:45:44 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:45:44 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d09a9d-7354-4c40-8ae8-46b419606e55]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:45:44 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-d6312bd9-5f20-49fa-9c83-e5fdae252fe1 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72418) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 18:45:44 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:45:44 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:45:44 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[b400b7b6-c6a4-46ec-99b9-1bf703415d12]: (4, ('1', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:45:44 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-d6312bd9-5f20-49fa-9c83-e5fdae252fe1 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 18:45:44 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-d6312bd9-5f20-49fa-9c83-e5fdae252fe1 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] SCSI volumes sdb have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 18:45:44 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6312bd9-5f20-49fa-9c83-e5fdae252fe1 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d')] {{(pid=72418) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 18:45:44 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:45:44 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:45:44 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[95533d46-d654-4593-868b-0906e226d571]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:45:44 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6312bd9-5f20-49fa-9c83-e5fdae252fe1 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:45:44 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d -p 172.16.0.220:3260 --logout {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:45:45 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:45:45 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec50bde-5445-4a00-9d10-60ec43adb088]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:45:45 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6312bd9-5f20-49fa-9c83-e5fdae252fe1 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d, portal: 172.16.0.220,3260]
Aug 09 18:45:45 user nova-compute[72418]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d, portal: 172.16.0.220,3260] successful.
Aug 09 18:45:45 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:45:45 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d -p 172.16.0.220:3260 --op delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:45:45 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9bc0826-cec0-488c-867c-a19085b5cb4d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:45:45 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[4487b26a-c708-4c13-a76b-7284d6c7c2c2]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:45:45 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6312bd9-5f20-49fa-9c83-e5fdae252fe1 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:45:45 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-d6312bd9-5f20-49fa-9c83-e5fdae252fe1 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:45:45 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6312bd9-5f20-49fa-9c83-e5fdae252fe1 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] <== disconnect_volume: return (283ms) None {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:45:45 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6312bd9-5f20-49fa-9c83-e5fdae252fe1 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Disconnected iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 18:45:45 user nova-compute[72418]: DEBUG nova.objects.instance [None req-d6312bd9-5f20-49fa-9c83-e5fdae252fe1 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Lazy-loading 'flavor' on Instance uuid 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:45:45 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-d6312bd9-5f20-49fa-9c83-e5fdae252fe1 tempest-AttachVolumeShelveTestJSON-531665400 tempest-AttachVolumeShelveTestJSON-531665400-project-member] Lock "2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.757s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:45:48 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:45:49 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:45:54 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:45:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-c77896ca-694b-4f54-85ce-9f80e7825995 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Acquiring lock "a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:45:57 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-c77896ca-694b-4f54-85ce-9f80e7825995 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Lock "a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:45:57 user nova-compute[72418]: INFO nova.compute.manager [None req-c77896ca-694b-4f54-85ce-9f80e7825995 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Detaching volume 82cb9116-9fd0-499b-92ec-0f2b48289768
Aug 09 18:45:57 user nova-compute[72418]: INFO nova.virt.block_device [None req-c77896ca-694b-4f54-85ce-9f80e7825995 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Attempting to driver detach volume 82cb9116-9fd0-499b-92ec-0f2b48289768 from mountpoint /dev/vdb
Aug 09 18:45:57 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-c77896ca-694b-4f54-85ce-9f80e7825995 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Attempting to detach device vdb from instance a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507 from the persistent domain config. {{(pid=72418) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 18:45:57 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-c77896ca-694b-4f54-85ce-9f80e7825995 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 18:45:57 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:45:57 user nova-compute[72418]:   <source dev="/dev/sdc"/>
Aug 09 18:45:57 user nova-compute[72418]:   <target dev="vdb" bus="virtio"/>
Aug 09 18:45:57 user nova-compute[72418]:   <serial>82cb9116-9fd0-499b-92ec-0f2b48289768</serial>
Aug 09 18:45:57 user nova-compute[72418]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 18:45:57 user nova-compute[72418]: </disk>
Aug 09 18:45:57 user nova-compute[72418]:  {{(pid=72418) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 18:45:57 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-c77896ca-694b-4f54-85ce-9f80e7825995 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Successfully detached device vdb from instance a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507 from the persistent domain config.
Aug 09 18:45:57 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-c77896ca-694b-4f54-85ce-9f80e7825995 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507 from the live domain config. {{(pid=72418) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 18:45:57 user nova-compute[72418]: DEBUG nova.virt.libvirt.guest [None req-c77896ca-694b-4f54-85ce-9f80e7825995 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 18:45:57 user nova-compute[72418]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 18:45:57 user nova-compute[72418]:   <source dev="/dev/sdc"/>
Aug 09 18:45:57 user nova-compute[72418]:   <target dev="vdb" bus="virtio"/>
Aug 09 18:45:57 user nova-compute[72418]:   <serial>82cb9116-9fd0-499b-92ec-0f2b48289768</serial>
Aug 09 18:45:57 user nova-compute[72418]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 18:45:57 user nova-compute[72418]: </disk>
Aug 09 18:45:57 user nova-compute[72418]:  {{(pid=72418) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 18:45:58 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-487fbde0-56cd-4a9f-8ddd-6fe627fcb9b7 None None] Received event <DeviceRemovedEvent: 1691606758.3402288, a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72418) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 18:45:58 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-c77896ca-694b-4f54-85ce-9f80e7825995 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507 {{(pid=72418) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 18:45:58 user nova-compute[72418]: INFO nova.virt.libvirt.driver [None req-c77896ca-694b-4f54-85ce-9f80e7825995 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Successfully detached device vdb from instance a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507 from the live domain config.
Aug 09 18:45:58 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c77896ca-694b-4f54-85ce-9f80e7825995 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] calling os-brick to detach iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 18:45:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77896ca-694b-4f54-85ce-9f80e7825995 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f42f866d270>, {'target_iqns': ['iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BVdUELch', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 18:45:58 user nova-compute[72418]: WARNING os_brick.initiator.connectors.base [None req-c77896ca-694b-4f54-85ce-9f80e7825995 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 18:45:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-c77896ca-694b-4f54-85ce-9f80e7825995 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 18:45:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-c77896ca-694b-4f54-85ce-9f80e7825995 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 18:45:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77896ca-694b-4f54-85ce-9f80e7825995 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768', 0)] {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 18:45:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:45:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:45:58 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a483fdd-492f-4902-8d83-81f547cad141]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b89d3fe-0150-48ad-ba71-927d3d2207b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:45:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:45:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:45:58 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[53135c12-ce29-4776-a2f9-abcd4f70cff7]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b89d3fe-0150-48ad-ba71-927d3d2207b5 (non-flash)\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:45:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77896ca-694b-4f54-85ce-9f80e7825995 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768 (non-flash)
Aug 09 18:45:58 user nova-compute[72418]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b89d3fe-0150-48ad-ba71-927d3d2207b5 (non-flash)
Aug 09 18:45:58 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 18:45:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77896ca-694b-4f54-85ce-9f80e7825995 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768 (non-flash)
Aug 09 18:45:58 user nova-compute[72418]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b89d3fe-0150-48ad-ba71-927d3d2207b5 (non-flash)
Aug 09 18:45:58 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 18:45:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77896ca-694b-4f54-85ce-9f80e7825995 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f43000be9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768'): ({'sdc'}, set())}) {{(pid=72418) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 18:45:58 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-c77896ca-694b-4f54-85ce-9f80e7825995 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Removing single pathed devices sdc {{(pid=72418) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 18:45:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:45:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:45:58 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d215e3-d9dc-40be-b80e-76738db6246d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:45:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:45:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:45:58 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[809b64fb-61c0-4c4e-8a95-2a5a86196e48]: (4, ('ok\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:45:58 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-c77896ca-694b-4f54-85ce-9f80e7825995 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Flushing IO for device /dev/sdc {{(pid=72418) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 18:45:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:45:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:45:58 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca56d0a8-6ae2-4904-a703-3d659645c66c]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:45:58 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-c77896ca-694b-4f54-85ce-9f80e7825995 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72418) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 18:45:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:45:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:45:58 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[8906df86-3ccb-42c4-b9ed-2924d3d0d5dc]: (4, ('1', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:45:58 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-c77896ca-694b-4f54-85ce-9f80e7825995 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 18:45:58 user nova-compute[72418]: DEBUG os_brick.initiator.linuxscsi [None req-c77896ca-694b-4f54-85ce-9f80e7825995 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] SCSI volumes sdc have been removed. {{(pid=72418) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 18:45:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77896ca-694b-4f54-85ce-9f80e7825995 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768')] {{(pid=72418) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 18:45:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:45:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:45:58 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[28748628-a407-42a5-a8b2-e598aa58b9a1]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:45:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77896ca-694b-4f54-85ce-9f80e7825995 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:45:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768 -p 172.16.0.220:3260 --logout {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:45:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:45:58 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9926873-3d49-426f-a3ab-2ee8499434f2]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:45:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77896ca-694b-4f54-85ce-9f80e7825995 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768, portal: 172.16.0.220,3260]
Aug 09 18:45:58 user nova-compute[72418]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768, portal: 172.16.0.220,3260] successful.
Aug 09 18:45:58 user nova-compute[72418]:  stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:45:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768 -p 172.16.0.220:3260 --op delete {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:45:58 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82cb9116-9fd0-499b-92ec-0f2b48289768 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83046) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:45:58 user nova-compute[72418]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe7e217-f2e0-466f-8d3d-6d924e26952d]: (4, ('', '')) {{(pid=83046) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 18:45:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77896ca-694b-4f54-85ce-9f80e7825995 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72418) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 18:45:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.base [None req-c77896ca-694b-4f54-85ce-9f80e7825995 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 18:45:58 user nova-compute[72418]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77896ca-694b-4f54-85ce-9f80e7825995 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] <== disconnect_volume: return (288ms) None {{(pid=72418) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 18:45:58 user nova-compute[72418]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c77896ca-694b-4f54-85ce-9f80e7825995 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] [instance: a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507] Disconnected iSCSI Volume {{(pid=72418) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 18:45:59 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:45:59 user nova-compute[72418]: DEBUG nova.objects.instance [None req-c77896ca-694b-4f54-85ce-9f80e7825995 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Lazy-loading 'flavor' on Instance uuid a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507 {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:45:59 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-c77896ca-694b-4f54-85ce-9f80e7825995 tempest-TestServerVolumeAttachmentScenario-1757618506 tempest-TestServerVolumeAttachmentScenario-1757618506-project-member] Lock "a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.581s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:46:04 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:46:04 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:46:04 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:46:04 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72418) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 18:46:05 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:46:05 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:46:07 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:46:07 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Starting heal instance info cache {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 18:46:07 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Rebuilding the list of instances to heal {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 18:46:08 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "refresh_cache-2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 18:46:08 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquired lock "refresh_cache-2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 18:46:08 user nova-compute[72418]: DEBUG nova.network.neutron [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Forcefully refreshing network info cache for instance {{(pid=72418) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 18:46:08 user nova-compute[72418]: DEBUG nova.objects.instance [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lazy-loading 'info_cache' on Instance uuid 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c {{(pid=72418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 18:46:08 user nova-compute[72418]: DEBUG nova.network.neutron [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Updating instance_info_cache with network_info: [{"id": "2caa8c0b-8aea-4f61-9e3a-0728beb92ff1", "address": "fa:16:3e:96:4c:20", "network": {"id": "ea44ae8b-622b-48d7-8a2b-52c482edf74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1686271510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d9ba244a629475189a823dd40c4afb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2caa8c0b-8a", "ovs_interfaceid": "2caa8c0b-8aea-4f61-9e3a-0728beb92ff1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72418) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 18:46:08 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Releasing lock "refresh_cache-2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c" {{(pid=72418) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 18:46:08 user nova-compute[72418]: DEBUG nova.compute.manager [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] [instance: 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c] Updated the network info_cache for instance {{(pid=72418) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 18:46:08 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:46:08 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:46:08 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:46:09 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:46:09 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:46:14 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:46:14 user nova-compute[72418]: DEBUG oslo_service.periodic_task [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72418) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 18:46:14 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:46:14 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:46:14 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:46:14 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Auditing locally available compute resources for user (node: user) {{(pid=72418) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 18:46:15 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:46:15 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:46:15 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:46:15 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:46:15 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:46:15 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:46:15 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:46:15 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:46:15 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc488d1e-bc21-4041-99ad-222588c9b34f/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:46:15 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc488d1e-bc21-4041-99ad-222588c9b34f/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:46:15 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc488d1e-bc21-4041-99ad-222588c9b34f/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:46:15 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc488d1e-bc21-4041-99ad-222588c9b34f/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:46:15 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1afce6e7-5362-4cca-a111-61a96f2f5a02/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:46:16 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1afce6e7-5362-4cca-a111-61a96f2f5a02/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:46:16 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1afce6e7-5362-4cca-a111-61a96f2f5a02/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:46:16 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1afce6e7-5362-4cca-a111-61a96f2f5a02/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:46:16 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f917dfe-409a-474f-9dbb-edbf0eea7871/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:46:16 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f917dfe-409a-474f-9dbb-edbf0eea7871/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:46:16 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f917dfe-409a-474f-9dbb-edbf0eea7871/disk --force-share --output=json {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 18:46:16 user nova-compute[72418]: DEBUG oslo_concurrency.processutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f917dfe-409a-474f-9dbb-edbf0eea7871/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72418) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 18:46:16 user nova-compute[72418]: DEBUG nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72418) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 18:46:16 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:46:16 user nova-compute[72418]: WARNING nova.virt.libvirt.driver [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 18:46:16 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Hypervisor/Node resource view: name=user free_ram=8263MB free_disk=25.440441131591797GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72418) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 18:46:16 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 18:46:16 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 18:46:17 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 0f917dfe-409a-474f-9dbb-edbf0eea7871 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:46:17 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance a1eb5679-58f9-40a3-9f3d-a6b4c9fb3507 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:46:17 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 2e9f4118-0d1f-4b6a-a5f2-39eda0aafb0c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:46:17 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance fc488d1e-bc21-4041-99ad-222588c9b34f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:46:17 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Instance 1afce6e7-5362-4cca-a111-61a96f2f5a02 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72418) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 18:46:17 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 18:46:17 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72418) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 18:46:17 user nova-compute[72418]: DEBUG nova.compute.provider_tree [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Inventory has not changed in ProviderTree for provider: 50628e48-0a01-4c3f-9ff5-2a66453cd194 {{(pid=72418) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 18:46:17 user nova-compute[72418]: DEBUG nova.scheduler.client.report [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Inventory has not changed for provider 50628e48-0a01-4c3f-9ff5-2a66453cd194 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72418) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 18:46:17 user nova-compute[72418]: DEBUG nova.compute.resource_tracker [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Compute_service record updated for user:user {{(pid=72418) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 18:46:17 user nova-compute[72418]: DEBUG oslo_concurrency.lockutils [None req-52217245-548b-42ec-b3e7-a53ca63ac474 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.298s {{(pid=72418) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 18:46:19 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:46:24 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 18:46:24 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 18:46:24 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72418) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 18:46:24 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72418) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 18:46:24 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72418) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 18:46:24 user nova-compute[72418]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72418) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}